Delete activity of a contact
This appears to have been fixed for version 4.7. After deleting an activity you remain on the 'Activities' tab for the contact. I tested this on http://dmaster.demo.civicrm.org/