Object duplicates cause lag
I ended up figuring it out. It was the size of the texture. I was using a large texture atlas and that was its limit. I did a test where I shrunk the atlas to 1/4th and I no longer have that issue. I can use a smaller texture atlas for modeling and then use the original texture when I import it into the game.