title: glassfish 4.1.1 cluster ssh node error
body: <p>I`m trying to create a cluster with two nodes using glassfish 4.1.1 build 1.<br>
  One node is local, an the other one is ssh.The node is working as if I ping it it responds ok. ( Successfully made SSH connection to node node2 (gfNode2)) 
  I have setup ssh, create the node, create one instance (i2) on that node but when i want to start the instance i get:  </p>
  
  <blockquote>
    <p>i2: Could not start instance i2 on node node2 (gfNode2). Command failed on node node2 (gfNode2): Previous synchronization failed at Sep 10, 2016 12:25:27 PM Will perform full synchronization. Removing all cached state for instance i2. CLI802 Synchronization failed for directory config, caused by: remote failure: SynchronizeFiles: Exception reading request Command start-local-instance failed. To complete this operation run the following command locally on host gfNode2 from the GlassFish install location /opt/glassfish4: lib/nadmin start-local-instance --node node2 --sync normal i2 </p>
  </blockquote>
  
  <p>if i run this command on node 2 machine i get:   </p>
  
  <pre><code> ./nadmin  start-local-instance --node node2 --sync normal i2
  Previous synchronization failed at Sep 10, 2016 12:25:27 PM
  Will perform full synchronization.
  Removing all cached state for instance i2.
  Enter admin user name&gt;  admin
  Enter admin password for user "admin"&gt;
  CLI802 Synchronization failed for directory config, caused by:
  remote failure: SynchronizeFiles: Exception reading request
  Command start-local-instance failed.
  </code></pre>
  
  <p>any idea what to try next ?</p>
  
  <p>Update:<br>
  The DAS is reachabe, the ssh is working properly (ping-node-ssh works from das).<br>
  What I have noticed is that even after i have installed (install-node-ssh) and create with(create-node-ssh), node 2 has no files inside.<br>
  At /glassfish4/glassfish/nodes/node2/i2 there is only one file: .syncstate which is empty. The node2/i2 directories are there but nothing in i2. Maybe due to : Removing all cached state for instance i2.   </p>
  
  <p>That is what i got in DAS logs:  </p>
  
  <pre><code>    [2016-09-10T19:31:14.806+0000] [glassfish 4.1] [WARNING] []           [javax.enterprise.system.core] [tid: _ThreadID=106 _ThreadName=admin-   listener(5)] [timeMillis: 1473535874806] [levelValue: 900] [[
    Could not start instance i2 on node node2 (gfNode2).: Command ' /opt/glassfish4/glassfish/lib/nadmin --_auxinput - --interactive=false start-local-instance --node node2 --sync normal i2' failed on node node2 (gfNode2): Previous synchronization failed at Sep 10, 2016 12:25:27 PM
  Will perform full synchronization.
  Removing all cached state for instance i2.
  Command start-local-instance failed.
  CLI802 Synchronization failed for directory config, caused by:
    remote failure: SynchronizeFiles: Exception reading request: To complete this operation run the following command locally on host gfNode2 from the GlassFish install location /opt/glassfish4:
  
   lib/nadmin  start-local-instance --node node2 --sync normal i2]]
  
  [2016-09-10T19:31:14.818+0000] [glassfish 4.1] [SEVERE] [] [org.glassfish.admingui] [tid: _ThreadID=102 _ThreadName=admin-listener(1)] [timeMillis: 1473535874818] [levelValue: 1000] [[
    RestResponse.getResponse() gives FAILURE.  endpoint = 'https://localhost:4848/management/domain/servers/server/i2/start-instance'; attrs = '{}']]
  
  [2016-09-10T19:31:14.820+0000] [glassfish 4.1] [SEVERE] [] [org.glassfish.admingui] [tid: _ThreadID=102 _ThreadName=admin-listener(1)] [timeMillis: 1473535874820] [levelValue: 1000] [[
    Error in instanceAction ;
  endpoint=https://localhost:4848/management/domain/servers/server/i2/start-instance;attrsMap=null]]
  </code></pre>
  
  <p>If I try to run the command from node2 I got what is showed on first code block of the post...</p>