Use a HDRI just for lighting and change the background color
A flexible way would be to use compositing, as shown here. That would let you change the background to anything you like, at later stages.

A more destructive way is to use a Light Path node in the World's node tree:



(Select 'World' in the Node Editor's header, as opposed to 'Object')

With HDRI background visible to camera:



Without: