But as we see, Tom refuses to go, because he knows that if the trader doesn't get him, he'll take other slaves of the Shelbys, including some of Tom's own children, to make up for his loss, and Tom doesn't want that to happen. 