Is there a lazy/iterator equivalent to `str.split()`?
<blockquote>
  <p><strong>Possible Duplicate:</strong><br>
  <a href="http://stackoverflow.com/questions/3862010/is-there-a-generator-version-of-string-split-in-python">Is there a generator version of <code>string.split()</code> in Python?</a>  </p>
</blockquote>



<p><code>str.split(delim)</code> splits a string into a list of tokens, separated by <code>delim</code>. The entire list of tokens is returned in one hit.</p>

<p>When dealing with large blocks of text, it might be advantageous to process tokens lazily. That is, only get one token at a time, as needed. (The example that springs to mind is processing a large chunk of text in memory.)</p>

<p>Is there a builtin or a standard library function that will perform a lazy <code>split()</code>? Something from <code>itertools</code>?</p>
