Do I have to ask permission for a one day leave from graduate school?
In general, it is not a good idea to miss a meeting that you were expected to attend, without giving any notice. It looks unprofessional, and it is annoying and rude to people who made plans based on your attendance at the meeting.

Let your advisor know that you are planning to miss the meeting.