Staten Island and Brooklyn used to be connected and the Hudson River emptied into the ocean through the Raritan River and taking course through present day northern New Jersey . Previously Staten Island and Brooklyn were connected and the Hudson River emptied into the ocean through the present course of the Raritan River , by taking a more westerly course through parts of present day northern New Jersey , along the eastern side of the Watchung Mountains to Bound Brook , New Jersey and then on into the Atlantic Ocean via Raritan Bay .