Is electronics an expensive hobby?
Tools can get pretty pricey in this area, ranging from a simple $5 soldering iron, all they way up to more than I will probably ever make in my existence.

Getting all of that for $125 isn't too bad, and will be a one time cost until you decide to upgrade to better tools.  They should serve you well for your purposes for sometime until you can get real income.  I would say since you are 14 and have no sustainable income, you might want to be very careful when purchasing parts to make sure you get the right ones on the first order.

Electronics has a different purchasing structure than, say, a grocery store, where the more you buy, they just add up linearly. When you buy your components from a good distributor, like digi-key.com, you could get a single capacitor for say $0.60 OR you could get 100 capacitors for $5.00 because the price per component would go down as you buy more. 

Adafruit is a good website, although I wouldn't recommend them for basic components.  They have really nice breakout boards and are great for getting started on a project quickly.  For basic discrete components though, I would go somewhere like digi-key, mouser, farnell, etc..  These are really reputable distributors and have a wide selection of many components.