What is the price of increasing the QAM number?
What happens when you increase the amount of distinct states in QAM is you get a higher BER (bit error rate).



source

To achieve the higher data rate with the same BER, you need to use error correction coding. You see, the BER rises, but your ability to correct the errors increases at a greater pace, as Shannon discovered.