Theoretical and practical comparison of CTC and seq2seq loss in Tensorflow
From my own work, I give a few, sparse empirical reports:


bLSTMs are suitable for seq2seq loss in Tensorflow in case they are used within the encoder of an encoding-decoding scheme. I have not tried to use bLSTMs within the decoder.
--
seq2seq loss could be trained almost equally well with both RMSProp and ADAM on both G2P and P2G tasks.
--