Washington had thought of leaving the Fort and moving its military camp of 3,000 men to New Jersey , but had been convinced by General Nathaniel Greene to defend ( fight for ) it . General Washington had thought of abandoning the Fort and removing its garrison of 3,000 men to New Jersey , but had been convinced by General Nathaniel Greene to defend it .