Replacing a toggle dimmer switch with a regular light switch
As the others have said, you need a 3-way switch. 

The copper colored screw on your old dimmer is your "common" screw. The other two are your travelers. 

The new switch will have similarly color schemed screws. Typically black for the "com" and brass for the two travelers.