Is the inverse of a point on an elliptic curve over $\mathbb{Z}_p$ always in the group?
poncho has it right, I was calculating the inverse incorrectly. The inverse of a point $(x,y)$ is $(x, -y)$. It just so happens that $(x,y) + (x, y^{-1}) = 0$, but this was a red herring. Thanks!