Can I paint the cement under the fireplace hearth?
Yes, you can paint it.

Personally, I always use oil-based paints because they last longer, but you can use whatever paint you want (water colors?)

Concrete is porous so you might want to use a grain filler or sealer of some kind before painting.

There are thick paints specifically designed for painting concrete, but they tend to look pretty industrial.