When to stop putting out mouse traps?
Setting traps will kill what you have, but you still have the problem of the mice getting in. you need to figure out how they are getting into the house. Mice can get through incredibly tiny holes, so it might be a chore to find them all. But as you find holes, seal them up. Steel wool is useful for this as they don't like chewing through it.