issue regarding tokenize.py
<p>In python2.x tokenize() function has two arguments namely, 'readline' and 'tokeneater'. Second argument takes care of the output mechanism for tokenize() and is called once for each token. Now we know that in python3.x second argument 'tokeneater' is not there. How is output mechanism in python3.x being taken care of ?      </p>
