Why do we add error in the definition of LWE?
In that case, how we would be able to obtain $s$ from $(a,b=(\langle a,s\rangle))$?

The operation $\langle a,s\rangle$ is a matrix multiplication, that is, completely linear, and hence Gaussian elimination allows us to recover $s$ efficiently.