title: Checkpoint RDD ReliableCheckpointRDD has different number of partitions from original RDD
body: <p>I have a spark cluster of two machines and I when I run a spark streaming application I get the following errors :</p>
  
  <pre><code>Exception in thread "main" org.apache.spark.SparkException: Checkpoint RDD ReliableCheckpointRDD[11] at print at StatefulNetworkWordCount.scala:78(1) has different number of partitions from original RDD MapPartitionsRDD[10] at updateStateByKey at StatefulNetworkWordCount.scala:76(2)
      at org.apache.spark.rdd.ReliableRDDCheckpointData.doCheckpoint(ReliableRDDCheckpointData.scala:73)
      at org.apache.spark.rdd.RDDCheckpointData.checkpoint(RDDCheckpointData.scala:74)
  </code></pre>
  
  <p>How can I give a checkpoint directory on file system that is not HDFS/Cassandra/any other data store ? </p>
  
  <p>I have thought of two possible solutions, but I do not know how to code them :</p>
  
  <ol>
  <li><p>have one remote directory which is local to both the workers </p></li>
  <li><p>specify a remote directory on to both the workers</p></li>
  </ol>
  
  <p>Any suggestions ?</p>