Solutions to covering exposed pin headers using a cap?
I would just shove it in a protective box like this one: 



It's inherently fragile. If you've got access to 3D parametric modelling software and a 3D printer or are willing to fiddle with castable polyurethane and modelling clay you could make a more professional looking cap, but that seems like a lot of effort unless you're planning on making lots of them.