is xquartz safe for mac?
then yes, it's safe at least as far as containing malware is concerned. I can't vouch for the stability of the software, though it's the project Apple points people to who need X11 for Mavericks.