Horse Cave, KY. Horse Cave is a city in Hart County, Kentucky, United States. The population was 2,252 at the 2000 census. The city is best known for the large natural cave opening located on the south side of Main Street, from which the town's name is derived. As for the historical reason for the odd name, various legends are told.