Is it inappropriate for a student to attend their mentor's dissertation defense?
It's fine. As you say, these are open to the public, and it's common for family members, department members, and friends to attend. Since you perhaps are not "firmly" in any of these categories, asking whether it's okay to attend is probably a good idea -- but you've already done this and been given the green light. Enjoy.