Change pager href attribute
I think we've covered why this might not be a good idea in comments, but to change the output of the pager you just need to override theme_pager_link() in your site's theme.

You'll need to reproduce the original function almost exactly, except you'll probably want to ditch the use of pager_get_query_parameters(), and alter the url() on the penultimate line to use a fragment.