title: Parallel Pip install
body: <p>Our Django project is getting huge. We have hundreds of apps and use a ton of 3rd party python packages, many of which need to have C compiled. Our deployments are taking a long time when we need to create a new virtual environment for major releases. With that said, I'm looking to speed things up, starting with Pip. Does anyone know of a fork of Pip that will install packages in parallel?</p>
  
  <p>Steps I've taken so far:</p>
  
  <ul>
  <li><p>I've looked for a project that does just this with little success. I did find this Github Gist: <a href="https://gist.github.com/1971720">https://gist.github.com/1971720</a> but the results are almost exactly the same as our single threaded friend.</p></li>
  <li><p>I then found the Pip project on Github and started looking through the network of forks to see if I could find any commits that mentioned doing what I'm trying to do. It's a mess in there. I will fork it and try to parallelize it myself if I have to, I just want to avoid spending time doing that.</p></li>
  <li><p>I saw a talk at DjangoCon 2011 from ep.io explaining their deployment stuff and they mention parallelizing pip, shipping .so files instead of compiling C and mirroring Pypi, but they didn't touch on how they did it or what they used.</p></li>
  </ul>