title: Shipping Python modules in pyspark to other nodes
body: <p>How can I ship C compiled modules (for example, python-Levenshtein) to each node in a <a href="https://en.wikipedia.org/wiki/Apache_Spark" rel="noreferrer">Spark</a> cluster?</p>
  
  <p>I know that I can ship Python files in Spark using a standalone Python script (example code below):</p>
  
  <pre><code>from pyspark import SparkContext
  sc = SparkContext("local", "App Name", pyFiles=['MyFile.py', 'MyOtherFile.py'])
  </code></pre>
  
  <p>But in situations where there is no '.py', how do I ship the module?</p>