Pilcher was born in Warrenton, Virginia on March 20, 1844.
On February 5, 1863, at the age of eighteen, Pilcher enlisted in the Confederate States Army, wishing to fight in the ongoing American Civil War.