not being able to emotionally deal with this any longer , the captain set off for the middle plantation house , taking rose with him while leaving dee , the children and sarah behind at the clapboard .