XQuartz cannot generate any windows (even the built in terminal or xlogo)
Reinstalling macOS from the online recovery option (Command-Option-R at startup) fixed the issue. All my files, programs and settings remained as before. I've tried many things but seems like this was the way to go from the start.