Training finished (float32, Xavier Init), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=8.6898, perplexity=nan

Training finished (float32, no LayerNorm), epochs=3, lr=1e-07, clip=1, batch_size=4, loss=9.0133, perplexity=nan

initial commit