Easy way to clean up OS X system files
Macports and Fink are well behaved and put all their stuff in /opt and /sw respectively. Delete those folders and you're done.

Other packages like to use /usr/local, the unix standard for, well, local only installations.

If something is being messy and putting files in */bin, /System, /Library etc. your options are to manually remove things or reinstall the system