He was the son of Henry James Senior , a clergyman , and the brother of William and Alice James . He was the son of Henry James , Sr. , a clergyman , and the brother of philosopher and psychologist William James and diarist Alice James .