Isn't the amplification in amps always going towards infinity?
Your intuition about positive feedback is correct.

For negative feedback, as mentioned elsewhere, \$ μ\$ becomes negative. Then the output adjusts so that the difference between the two terms becomes zero. For instance, if \$ μ\$ is -1, zero input occurs when the output equals the negative of the input, and the overall gain is -1.