Boyle's Law of pressure and volume
Balloon is not an ideal system to study pressure-volume relationship. Because, on expansion, the elastic skin also expands and there needs to be an additional pressure build-up on the inner side to counter that force, very similar to the extra pressure in a spherical bubble. (where the surface tension acts exactly similar to the elastic balloon skin)  

But in your arguments, you are forgetting an important point. Blowing a balloon also involves increasing the amount of air in it. Boyle's law holds for only a fixed volume of gas. If you change the number of moles, Boyle's law no longer stays valid.