sometimes he believed he had a right to take whatever happiness he could , the happiness azucena offered him ; other times he prayed ginny would never know of his weakness for this woman so much younger than himself .