one node in cluster got crashed ,how to recover it?
Ok solved my issue..

My hard drive failed so mysql log got hosed, end of story..

I needed full state transfer and to remove everything except the mysql database with all those myisam tables full of permissions..

Stop the broken node completely..

root@my-galera-clustercontrol:~# s9s_galera --stop-node -i 1 -h10.0.1.111


Rsync out the mysql database folder from mysql data folder..

root@my-galera-percona1:/mnt/data/mysql# rsync -av mysql ../mysqlback/


Delete everything include bad logs from mysql data folder:

root@my-galera-percona1:/mnt/data/mysql# rm -rf *


Restore the mysql data folder:
    root@my-galera-percona1:/mnt/data/mysql# rsync -av ../mysqlback/mysql .

Start the node back with a in cluster control causing a full state transfer:

root@my-galera-clustercontrol:~# s9s_galera --start-node -i 1 -h 10.0.1.111 -d 10.0.1.112


From there you can watch crazy io with iftop until eventually the node came back online as synced..