How to add delete link to recent comments block?
You can override the theme_comment_block(): You can find a good tutorial here: http://www.webomelette.com/theming-comment-block-drupal-7

I instead liked to just replicate the functionality in a Views block, and then styled the block to look the same way. I felt it gave me more control, and I try to avoid hacking up core blocks.