How should I handle a change of address for a Student Pilot License in the USA?
You can change your address with the FAA online.  You do not need to get a new plastic certificate.

http://www.faa.gov/licenses_certificates/airmen_certification/airmen_services/