How should I ventilate an air-tight concrete room?
A 4 inch diameter hole with a good fan might be sufficient to move air from the basement into this room under the use you describe. The space under the door might be sufficient to allow the air back into the basement.

Is the roof of this cistern room exposed on the surface, and, if so, is it shaded from the sun?