It connects the Upper and Lower New York Bay and makes the channel where the Hudson River can empty into the Atlantic Ocean . It connects the Upper New York Bay and Lower New York Bay and forms the principal channel by which the Hudson River empties into the Atlantic Ocean .