Because our approach is specifically intended to yield sentences that are grammatical, we additionally consider the following log ratio (i.e., the grammatical phrase over the ungrammatical phrase): 
 Question: How do they measure grammaticality?
by calculating log ratio of grammatical phrase over ungrammatical phrase