title: hadoop map-reduce job crashes with initialization failed: java.io.IOException: Split metadata size exceeded 10000000. Aborting job
body: <p>I am also getting the error "Split metadata size exceeded 10000000" the issue on CDH3 -Hadoop 0.20.2-cdh3u1. In my case the there were two inputs
  inp1 size = 1GB
  inp2 size = 7 MB</p>
  
  <p>When I am using mapred.max.split.size = 256MB, it throws the below error.</p>
  
  <pre><code>Job initialization failed: java.io.IOException: Split metadata size exceeded 10000000. Aborting job job_201412112225_1046114 at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:48) at org.apache.hadoop.mapred.JobInProgress.createSplits(JobInProgress.java:814) at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:708) at org.apache.hadoop.mapred.JobTracker.initJob(JobTracker.java:4016) at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:79) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662)
  </code></pre>
  
  <p>When I change the mapred.max.split.size = 8MB, then it runs successfully BUT takes too many mappers.</p>
  
  <p>The same job with same configurations is running fine on cdh4.6</p>
  
  <p>Any hints/suggestions to fix this.</p>