Does installing Xcode and it's mobile components slow down regular iTunes with iPhone syncing and performance?
I have been a developer for little over a year and had have not noticed any slowing down since and because of Xcode - the only thing is that sometimes making backups takes a long time, if you do not backup your iOS device everyday - but I don't see that being related to Xcode.