Should I leave this PhD and start another one? Would I be in trouble?
The comment of astronat is good. Most people would support you.
But there is more. If you are happier, then you will probably do better work. Being in something that you aren't happy with is not good place to be.
If there is any sort of retaliation it would be, I think, short lived and can be overcome. Other than lying, the person has no real way to say you are not suitable for academia.
Everything seems positive about the switch, both personally and professionally.
But, it would be worth the effort, unless you have contrary evidence, to have a conversation with your advisor giving two messages. First that you are happy with their guidance, but have both personal and professional reasons for a move. They may be disappointed, but that seldom results in harmful action. Clean up joint work before you go, of course.