How to properly align the rear wheel to the bike (granny bike, single speed)
I suspect you either are missing the lock washer (toothed lock washer, picture follows) on the drive side or the one that is there is worn out. Place one outside of the dropout, between the dropout and the hanger for the rack/stand.

And the promised picture of the washer I meant: