as soon as the passengers and livestock were hurriedly loaded , the ferrymen who had pulled the ferry across the river immediately cast off the gangplank and began pulling the ferry back across the river towards the west bank of the potomac , without waiting for alex and the longhunter .