Using the fine-grained gating mechanism conditioned on the lexical features, we can accurately control the information flows between word-level and char-level. Intuitively, the formulation is as follows: INLINEFORM0

where INLINEFORM0 is the element-wise multiplication operator. when the gate has high value, more information flows from the word-level representation; otherwise, char-level will take the dominating place. It is practical in real scenarios. For example, for unfamiliar noun entities, the gates tend to bias towards char-level representation in order to care richer morphological structure. 
 Question: How does the gatint mechanism combine word and character information?
when the gate has high value, more information flows from the word-level representation; otherwise, char-level will take the dominating place  for unfamiliar noun entities, the gates tend to bias towards char-level representation in order to care richer morphological structure