Objects duplicate strangely when joined
The problem was that I was using unapplied modifiers on the objects. To apply the modifiers to so many objects, I used the command Alt+C while having all the objects selected. Then used Ctrl+J to join like normal.