The vector gate is inspired by BIBREF11 and BIBREF12 , but is different to the former in that the gating mechanism acts upon each dimension of the word and character-level vectors, and different to the latter in that it does not rely on external sources of information for calculating the gating mechanism. 
 Question: Where do they employ feature-wise sigmoid gating?
gating mechanism acts upon each dimension of the word and character-level vectors