The ability to obtain accurate food security metrics in developing areas where relevant data can be sparse is critically important for policy makers tasked with implementing food aid programs. As a result, a great deal of work has been dedicated to predicting important food security metrics such as annual crop yields using a variety of methods including simulation, remote sensing, weather models, and human expert input. As a complement to existing techniques in crop yield prediction, this work develops neural network models for predicting the sentiment of Twitter feeds from farming communities. Specifically, we investigate the potential of both direct learning on a small dataset of agriculturally-relevant tweets and transfer learning from larger, well-labeled sentiment datasets from other domains (e.g. politics) to accurately predict agricultural sentiment, which we hope would ultimately serve as a useful crop yield predictor. We find that direct learning from small, relevant datasets outperforms transfer learning from large, fully-labeled datasets, that convolutional neural networks broadly outperform recurrent neural networks on Twitter sentiment classification, and that these models perform substantially less well on ternary sentiment problems characteristic of practical settings than on binary problems often found in the literature.
@cite_4: A method for sentiment polarity assignment for textual content written in Polish using supervised machine learning approach with transfer learning scheme is proposed in the paper. It has been shown that performing simple natural language processing steps prior to classification, provides inspiring results without redundant computation overhead. The documents containing subjective opinions were classified using N-gram and Bi-gram language model that is able to encode some of complex word phrases. The experiments carried out on two real datasets taken from different domains proved that learning on one dataset and testing on another, which is commonly called transfer learning, can be effective and may result in very high classification quality.
---Previous work by @cite_4 demonstrates that transfer learning can be effective, even for a simple SVM classifier. We hypothesize that by consistently using GloVe word embeddings that capture the semantic similarities among words, we could enable effective cross-domain transfer learning on sentiment prediction tasks.