Use indepenent power sources for Arduino and for breadboard
Simply connect the breadboard/wallwart ground to the Arduino ground.  As long as you don't connect the wall-wart positive to the Arduino, there should be no problems.