In the 1620s , the first large European colony began in New Netherland , when the Dutch began trading fur on Governors Island . A permanent European presence in New Netherland began in 1624 with the founding of a Dutch fur trading settlement on Governors Island .