Xanthogranuloma is an uncommon tumor in the ocular adnexa. It usually presents as diffuse lid swelling with or without orbital involvement. Xanthogranulomas can be associated with systemic comorbidities. They are diagnosed by their characteristic pathological finding. They are further subclassified based on immunohistochemistry. We present two cases with lid swelling which were diagnosed to be xanthogranuloma. Our cases were special because of the unique presentation as localized monomorphic lesions.