We find that all the factors we tested can qualitatively affect how a model generalizes on the question formation task. These factors are the type of recurrent unit, the type of attention, and the choice of sequential vs. tree-based model structure. 
 Question: What architectural factors were investigated?
type of recurrent unit type of attention choice of sequential vs. tree-based model structure