what does it mean when someone rubs your ear?
It might be that he is attracted to you especially if he only does it with you, he does it on more than one occasion and if he shows other signs of attraction around you. Other possibilities are that he is trying to reassure you, being dominant, teasing you or that he is mirroring your own behavior.