Why is my amplifier circuit amplifying more than I expect?
Change to the following to get a non-inverting amplifier with gain = \$1 + R_2/R_1\$





The difference is that \$R_2\$ is connected to the op amp's inverting input instead of ground.



Please see Scott Seidman's answer for an explanation of what the incorrect circuit was doing.