They seceded from Virginia and formed their own state , West Virginia . After the war , the United States was brought back together , but West Virginia never rejoined Virginia . West , by God , Virginia ! '' .