tom did not realise until he was much older that this had nothing to do with him or sylvia but rather with the fact that his mother had managed to obtain sole custody of her children and his father was banished from their lives for good .