when james was still an infant , tatum allowed mary to stay with him , watching over him and trying not to look at the gawkers who would have asked her all kinds of questions if they could but catch her eye .