Convert 4 gang to 3 gang switch box
Unless you are planning to do some patching and painting I am afraid you are stuck with a 4G box. If you want to remove the switch because its just irritating you can use a switch blank shown below:
 

These can be found in most big box hardware stores and online. They come in different colors and can be found in decora style also.

Good luck.