NLP - Deep belief neural networks or logic?
Very briefly: 

Option 1 faces difficulties since certain connectionist models are incapable of learning natural languages.

Option 2 faces grave difficulties due to many negative results, notably Gold's theorem.
There's a nice overview which includes a discussion of probabilistic approaches.

Generally, the response to these difficulties has been to look at other sources of information beyond the linguistic input alone.