Datasets in NLP research papers
I have come across such a dataset in CS 20SI GitHub repo: it's a collection of abstracts from 7200 research papers.

If you need even more, you can always write a simple crawler of arXiv web-site. The abstracts are outlined right on the webpage in a &lt;blockquote&gt; tag, no need to download and parse a pdf.