Why must all magnitude systems have a reference point?
Because you can't take the logarithm of something with dimensions only the log of a number.
Your magnitude would depend on what you measured f in. In other words, by choosing a set of units, you choose a zero point! Whether that unit is Jy, W/m$^2$ or the flux of some other object.