title: Hive UDF with Python
body: <p>I'm new to python, pandas, and hive and would definitely appreciate some tips.</p>
  
  <p>I have the python code below, which I would like to turn into a UDF in hive.  Only instead of taking a csv as the input, doing the transformations and then exporting another csv, I would like to take a hive table as the input, and then export the results as a new hive table containing the transformed data.</p>
  
  <p>Python Code:</p>
  
  <pre><code>import pandas as pd
  data = pd.read_csv('Input.csv')
  df = data
  df = df.set_index(['Field1','Field2'])
  Dummies=pd.get_dummies(df['Field3']).reset_index()
  df2=Dummies.drop_duplicates()
  df3=df2.groupby(['Field1','Field2']).sum()
  df3.to_csv('Output.csv')
  </code></pre>