title: yarn hadoop 2.4.0: info message: ipc.Client Retrying connect to server
body: <p>i've searched for two days for a solution. but nothing worked.</p>
  
  <p>First, i'm new to the whole hadoop/yarn/hdfs topic and want to configure a small cluster.</p>
  
  <p>the message above doesn't show up everytime i run an example from the mapreduce-examples.jar
  sometimes teragen works, sometimes not. 
  in some cases the whole job failed, in others the job finishes successfully. sometimes the job failes, without printing the message above.</p>
  
  <pre><code>14/06/08 15:42:46 INFO ipc.Client: Retrying connect to server: FQDN-HOSTNAME/XXX.XX.XX.XXX:53022. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
  </code></pre>
  
  <p>this message is print 30 times. also the port (in code example: 53022) changes with every time a job is started.
  if job finished succesfuly, this is print</p>
  
  <pre><code>14/06/08 15:34:20 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
  14/06/08 15:34:20 INFO mapreduce.Job: Job job_1402234146062_0002 running in uber mode : false
  14/06/08 15:34:20 INFO mapreduce.Job:  map 100% reduce 100%
  14/06/08 15:34:20 INFO mapreduce.Job: Job job_1402234146062_0002 completed successfully
  </code></pre>
  
  <p>if it fails,this is shown.</p>
  
  <pre><code>INFO mapreduce.Job: Job job_1402234146062_0005 failed with state FAILED due to: Task failed task_1402234146062_0005_m_000002
  Job failed as tasks failed. failedMaps:1 failedReduces:0
  </code></pre>
  
  <p>in this case, some tasks failed. but in log files of nodemanager, datanode, resourcemanager, ... is no reason or message to find.</p>
  
  <pre><code>INFO mapreduce.Job: Task Id : attempt_1402234146062_0006_m_000002_1, Status : FAILED
  </code></pre>
  
  <p>Additional Information about my Configuration:
  used OS: centOS 6.5
  Java Version: OpenJDK Runtime Environment (rhel-2.4.7.1.el6_5-x86_64 u55-b13)
                OpenJDK 64-Bit Server VM (build 24.51-b03, mixed mode)</p>
  
  <p>yarn-site.xml</p>
  
  <pre><code>&lt;configuration&gt;
  
  &lt;!-- Site specific YARN configuration properties --&gt;
          &lt;property&gt;
                  &lt;name&gt;yarn.nodemanager.address&lt;/name&gt;
                  &lt;value&gt;FQDN-HOSTNAME:8050&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;yarn.nodemanager.aux-services&lt;/name&gt;
                  &lt;value&gt;mapreduce_shuffle&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                    &lt;name&gt;yarn.nodemanager.localizer.address&lt;/name&gt;
                    &lt;value&gt;FQDN-HOSTNAME:8040&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;yarn.nodemanager.aux-services.mapreduce.shuffle.class&lt;/name&gt;
                  &lt;value&gt;org.apache.hadoop.mapred.ShuffleHandler&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                    &lt;name&gt;yarn.resourcemanager.resource-tracker.address&lt;/name&gt;
                    &lt;value&gt;FQDN-HOSTNAME:8025&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                    &lt;name&gt;yarn.resourcemanager.scheduler.address&lt;/name&gt;
                    &lt;value&gt;FQDN-HOSTNAME:8030&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                    &lt;name&gt;yarn.resourcemanager.address&lt;/name&gt;
                    &lt;value&gt;FQDN-HOSTNAME:8032&lt;/value&gt;
          &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>hdfs-site.xml</p>
  
  <pre><code>    &lt;configuration&gt;
          &lt;property&gt;
                  &lt;name&gt;dfs.replication&lt;/name&gt;
                  &lt;value&gt;2&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                     &lt;name&gt;dfs.permissions &lt;/name&gt;
                     &lt;value&gt;false &lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;dfs.namenode.name.dir&lt;/name&gt;
                  &lt;value&gt;file:///var/data/hadoop/hdfs/nn&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;fs.checkpoint.dir&lt;/name&gt;
                  &lt;value&gt;file:///var/data/hadoop/hdfs/snn&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;fs.checkpoint.edits.dir&lt;/name&gt;
                  &lt;value&gt;file:///var/data/hadoop/hdfs/snn&lt;/value&gt;
                  &lt;name&gt;fs.checkpoint.edits.dir&lt;/name&gt;
                  &lt;value&gt;file:///var/data/hadoop/hdfs/snn&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;dfs.datanode.data.dir&lt;/name&gt;
                  &lt;value&gt;file:///var/data/hadoop/hdfs/dn&lt;/value&gt;
          &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>mapred-site.xml</p>
  
  <pre><code>&lt;configuration&gt;
          &lt;property&gt;
                  &lt;name&gt;mapreduce.framework.name&lt;/name&gt;
                  &lt;value&gt;yarn&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;mapreduce.cluster.temp.dir&lt;/name&gt;
                  &lt;value&gt;/mapred/tempDir&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;mapreduce.cluster.local.dir&lt;/name&gt;
                  &lt;value&gt;/mapred/localDir&lt;/value&gt;
          &lt;/property&gt;
          &lt;property&gt;
                  &lt;name&gt;mapreduce.jobhistory.address&lt;/name&gt;
                  &lt;value&gt;FQDN-HOSTNAME:10020&lt;/value&gt;
          &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>I hope somebody could help me. :)
  Thank you, 
  Norman</p>