I want to begin with arduino programming
You can purchase some great starter kits too:

They're easy to search for, here's a few that popped up right away:

http://www.arduino.cc/en/Main/ArduinoStarterKit

http://www.amazon.com/Kuman-Project-Complete-Starter-breadboard/dp/B016D5KUHS/

And here's one that I own, and I've recommended to other people:

http://www.microcenter.com/product/458578/Arduino_Compatible_Maker_Kit_with_LCD_Display

If you have a microcenter or radio shack or Fry's in your area, they all stock a variety of different starter kits.