How can I print the name of every template being rendered in HTML comments, when in devMode?
So this sounded like a fun problem to solve... so I wrote the Template Comments plugin that does what you want:

This free plugin adds a HTML comment to demarcate {% block %}s and each Twig template that is included or extended.