Artificially expanding the datasets through rotation of images in MNIST
The problem is that numbers are not invariant to rotations. 

For example, see what happens when you rotate a 4 in steps of 90 degrees:



So unless your task includes recognizing numbers which are written sideways or upside-down this does not provide a proper data augmentation.