The Appalachian Trail , which traverses the ridge of Kittatinny Mountain in New Jersey , and Blue Mountain in Pennsylvania , crosses the Delaware River at the Delaware Water Gap near Columbia , New Jersey .