New Columbia, Pennsylvania. New Columbia is a census-designated place located in White Deer Township, Union County in the state of Pennsylvania. The community is located in eastern Union County along U.S. Route 15, very near to the West Branch Susquehanna River. As of the 2010 census the population was 1,013 residents.