title: What is the best way to speed up a find command on a huge directory tree using GNU parallel?
body: <p>I've been using GNU parallel for a while, mostly to grep large files or run the same command for various arguments when each command/arg instance is slow and needs to be spread out across cores/hosts.</p>
  
  <p>One thing which would be great to do across multiple cores and hosts as well would be to find a file on a large directory subtree. For example, something like this:</p>
  
  <p><code>find /some/path -name 'regex'</code></p>
  
  <p>will take a very long time if <code>/some/path</code> contains many files and other directories with many files. I'm not sure if this is as easy to speed up. For example:</p>
  
  <p><code>ls -R -1 /some/path | parallel --profile manyhosts --pipe egrep regex</code></p>
  
  <p>something like that comes to mind but <code>ls</code> would be very slow to come up with the files to search. What's a good way then to speed up such a find?</p>