joe watched his father uncertainly and with some disdain , and when he saw that the elderly banker was going along with everyone else , he threw up his hands in frustration and stomped from the office .