Defining Local Search stopping criteria
The stopping criterion depends on the specific algorithm used; some common ones include after a fixed number of iterations, or after the total improvement over the past $t$ iterations is at most $u$ (for some parameters $t,u$).

No, it's not correct to stop after you make the first improvement.  Usually you will need many iterations of improvements.