Columbus, New Jersey. Columbus is an unincorporated community located within Mansfield Township in Burlington County, New Jersey, United States. The area is served as United States Postal Service ZIP Code 08022. Most of Mansfield Township's governmental offices are located in and around Columbus.