Non dimmable switch where dimmer switch previously was?
First question would be, are the LED's dimmable? This would be listed on the box it came in. Second question would be, is the dimmer rated for LED's. 

Changing the dimmer out for a standard switch would stop the LED's from buzzing if the LED's were not damaged by the dimmer.

Hope this helps