The river itself officially begins in Henderson Lake in Ne … wcomb, New York. The river flows southward past the state capital at Albany and then eventually forms the boundary between New York City and the U.S. state of New Jersey at its mouth before emptying into Upper New York Bay. + 7 others found this useful.