How to know when dissolution is complete?
You've described the general tendency for any equilibrium process, including solubility. So, the short answer is yes, you will dissolve more until the reaction quotient is equal to the equilibrium constant.