the worst part was , his son or daughter might have ended up working in his circles , because no griffin male born on either side of the blanket , in five generations , had ever strayed from the fields of banking or high finance .