installing led bulb in a 2 bulb setup
The issue is more than likely the dimmer switch itself. If you've changed from incandescent bulbs to LED bulbs then I'm 100% sure the dimmer is the issue. You'll need a dimmer that's LED compatible. Most LED compatible dimmers are also sufficient for use with CFL bulbs.

Note: Ensure your LED bulbs are dimmable as well.