The municipality (originally the parish) is named after the old farm "Hyllestad" (Old Norse Hyllistaðir), since that was where the first Hyllestad Church in the parish was built.
The Church of Norway has one parish (sokn) within the municipality of Hyllestad.