recursively collect paths of a given root dir, when tens of millions files expected
<p>I need to create a list/lists of file paths under a given root directory, 
when I expect the number of files under this directory to be tens of millions.</p>

<p>What would be a good and efficient way to do this?</p>

<p>I currently run a python script which runs os.walk multithreaded.</p>

<p>Any better way to achieve what I need?</p>

<p>should be noted that the direcotry is a nfs mounted drive.</p>
