What's the input dimension for transformer decoder during TRAINING?
For feeding word one by one in transformer network we pass the whole sentence along with a mask to the network. And the mask will do the job by unmasking one new word at a time.