Gap (2") between PVC conduit and exposed foundation (exterior)
No, there's nothing wrong with that and it's a fairly common scenario considering that conduit often runs out the bottom of meter bases with a similar offset. 
If you're mounting the conduit to the foundation, simply install treated lumber or synthetic spacer blocks behind the clamps. 

It's also a good idea to use washed rock or other loose fill around the conduit where it enters the ground and for a couple feet horizontally. The most common failure of this situation is when ground settles and pulls the conduit along for the ride, cracking the pipe and/or ripping it loose from the structure. Loose fill will help prevent that.