Arduino Uno Starter kit project 12
Did you accidentally connected the piezo element to pin 0 instead of pin A0? As I recall, pin 0 is used for the serial communication to the host PC, so I imagine you might hear some strange noises if you did that. Pin A0 is on the left side; pin 0 is on the bottom right.