What is the boxy plastic housing around spade connectors called?
Most often they are called just 


  Hard plastic 6.3mm female blade terminal cover


and code for it  RS63004X, where X is a colour code, e.g  RS63004R for Red.

Check this link

Also, you can go through all range of terminal covers on RS website.