To train our best model we chose the best network from our experiments (6-layer bLSTM with 1024 hidden units), trained it with Adam optimizer and fine-tuned with SGD with momentum using exponential learning rate decay. 
 Question: Which architecture is their best model?
6-layer bLSTM with 1024 hidden units