Alexandria Bay is a village in Jefferson County, New York, United States. The population was 1,080 at the 2010 census. The Village of Alexandria Bay is in the Town of Alexandria. Keewaydin State Park is southeast of the village.