How to determine how unique a word is?
<p>I have a text file with around 300,000 words. Each word is 5 letters.</p>

<p>I'd like to be able to determine how unique each word is on the internet.</p>

<p>An idea I had was to Google the word and see how many results it yielded. Unfortunately, this is against their TOS.</p>

<p>I was trying to think of any other way but it would have to involve querying some website a lot and I doubt they would appreciate that much.</p>

<p>Anyone have any other ideas? Programming language doesn't matter that much but I would prefer C#.</p>
