Undo/redo drupal console generate:plugin:block?
I think I found the answer myself:

 drupal config:delete active block.block.my_block


(For my specific case)  Good luck finding the configuration name.  There's no listing from the console.  I had to export the whole damn thing to a directory and grep for it.