Training a Bit Vision Transformer from scratch on CIAFR-10 dataset , lots to learn can't reach even 12% accuracy.

If anyone is interested in the code , please do take a look and let me know if you know the solution.