Best way to cover main water supply valve into house
I would use a plastic valve box (with lid) of the appropriate size. Cut a slot in one end to slip over the horizontal run of PVC that goes into the brick wall. This will protect the pipe from string trimmer, mower, and other damage of that type. These boxes are usually an unobtrusive color and will cover the white pipe.

Inside the box would put foam tubing insulation around the pipe and cram that into the hole in the brick wall surrounding the pipe. I would put flexible sheet insulation around the inside of the box above ground and also under the top, but maybe not along the wall next to the brick wall to allow heat to flow from the ground and from the brick wall.

EDIT
Plastic valve box