title: How to write on HDFS using pyarrow
body: <p>I'm using python with pyarrow library and I'd like to write a pandas dataframe on HDFS. Here is the code I have</p>
  
  <pre><code>import pandas as pd
  import pyarrow as pa
  
  fs = pa.hdfs.connect(namenode, port, username, kerb_ticket)
  df = pd.DataFrame(...)
  table = pa.Table.from_pandas(df)
  </code></pre>
  
  <p>According to the documentation I should use the following code to write a pyarrow.Table on HDFS</p>
  
  <pre><code>import pyarrow.parquet as pq
  pq.write_parquet(table, 'filename.parquet')
  </code></pre>
  
  <p>What I don't understand is where should I use my connection (<code>fs</code>), because if I don't use it in the <code>write_parquet</code> then how come it knows where the HDFS is?</p>