Buying a gift for my PhD student after his graduation
I don't see any problem with this. Something from your own country would be appropriate, as would a book that is important in your field. Even a tourist souvenir from your country as something to remember you.
But not too expensive or elaborate.