Gilboa, New York. Gilboa is a town in Schoharie County, New York, United States. The population was 1,215 at the 2000 census. The Town of Gilboa is in the south part of the county and is southwest of Albany.