What files are safe to delete after upgrade?
That is simple: remove the old data directory, and the garbage should be gone.
You have to do that anyway, because the old data directory cannot be used any more once you have started the new server.
This will of course not remove bloat. To get rid of that, identify affected tables and indexes and use VACUUM (FULL) or REINDEX to rebuild them.