How to delete graphics from PCB board view in Eagle?
One simple way is to copy the device into your own library and modify its package there. If you continue using Eagle sooner or later you'd have to make your own devices. This seems to be a good time to begin.

And while you at it I'd recommend adding pin names to the display package, it might be helpful later for connecting jumper wires.