It could mean that he is attracted to you especially if he only gets nervous around you and he shows other signs of attraction around you. He might also think that you don't like him, have some social-anxiety, feel threatened by you or not want to tell you something.