 On September 5, 1862, Ellis became the first colonel of the newly raised 124th New York Infantry.The regiment had been recruited from mainly Orange County.After training and drilling, the 124th joined the Army of the Potomac in Northern Virginia.