 Jules James was born in Danville, Virginia, where he studied at Virginia Military Institute preparatory to entering the U. S. Naval Academy.In 1928 he married Eleanor Standish Gamble, niece of U.S. Secretary of War Henry Stimson.Gamble was also the great-great granddaughter of American founding father Roger Sherman.