Make my Professor a gift
The safest way to express your gratitude is to (hand)write a thank-you-card. In all likelihood that will be appreciated just as much as a gift, and is guaranteed not to cause any trouble.