title: sparkR with Cassandra
body: <p>I want to read a dataframe that comes from a cassandra keyspace and column_family. When running sparkR, I am calling the respective spark-cassandra-connector package, and setting the conf to my local spark cassandra host. I do not get any error when running the below. </p>
  
  <pre><code>$ ./bin/sparkR --packages com.datastax.spark:spark-cassandra-connector_2.10:1.5.0-M2 --conf spark.cassandra.connection.host=127.0.0.1
  </code></pre>
  
  
  
  <pre><code>sc &lt;- sparkR.init(master="local")
  sqlContext &lt;- sparkRSQL.init(sc)
  people &lt;-read.df(sqlContext,
      source = "org.apache.spark.sql.cassandra",
      keyspace = "keyspace_name", table = "table_name")
  </code></pre>
  
  <p>I get the following error, </p>
  
  <pre><code>Error in writeJobj(con, object) : invalid jobj 1
  </code></pre>
  
  <p>Do I have to pass conf into the <code>sparkContext</code> assignment (sc), and how in sparkR?</p>
  
  <p>Below is my spark and cassandra versions,  </p>
  
  <p>Spark: 1.5.1
  Cassandra: 2.1.6
  Cassandra Connector updated to use 1.5.0-M2 per zero323 advice</p>
  
  <p>Here is a gist to my stack trace. </p>
  
  <p><a href="https://gist.github.com/bhajer3/419561edcb0dc5db2f71" rel="nofollow">https://gist.github.com/bhajer3/419561edcb0dc5db2f71</a></p>
  
  <p><strong>Edit</strong>:</p>
  
  <p>I am able to create data frames from tables which do not include any Cassandra collection datatypes, 
  such as Map, Set and List.  But, many of the schemas that I need data from, do include these collection data types. </p>
  
  <p>Thus, sparkR does not have support for cassandra collection data types, when reading a dataframe that comes from a Cassandra keyspace and column_family. See here for my detailed report/testing procedures. </p>
  
  <p><a href="https://gist.github.com/bhajer3/c3effa92de8e3cfc4fee" rel="nofollow">https://gist.github.com/bhajer3/c3effa92de8e3cfc4fee</a></p>