Chinese expression for "go out early and return early"
早去早回 means exactly what you want as "go out early and return early" or "the sooner you leave, the sooner you can come back".
早出晚归 means "go out early and return late" which is always used to describe a person work hard and busy.