Should deleted Participant contributions appear in the report Event Income Report?
Not deleting financial information when a registration is deleted is by design so that organizations can pass audits. One wouldn't want an employee to delete some registrants and pocket the money if there is no checkin at the event, for example. 

If you would like to sponsor an extension to optionally change this behaviour it should be fairly simple to create, depending on how you want to approach things.