Disable the quick links menu on blocks
They're provided by the core Contextual Links module. If you don't don't need them at all disabling that would be the easiest thing to do.

There's also the Hide Contextual Links module if you want finer-grained control.