According to the Orange is the New Black canon, Bennett left his job and other responsibilities after being freaked out during a visit to Daya's family in season three. Bennett had intended to raise the child he had with Daya.