even now , as he tried to sit and listen to what his brothers were discussing , his gaze kept drifting across the hall where the women of the keep sat in front of the hearth sewing baby clothing for mairin 's child .