Is it crazy to leave an easy high paying job where you are unhappy, knowing that your next job will likely not pay as much, and be much harder work in a worse environment?
in this case, it's neither crazy to leave nor stay. there is justification for either choice. but to properly evaluate the equation, then you'll need some specific values for the 4 quantities you mentioned (happiness, difficulty, pay rate, workplace quality)