Patricia Roberts Harris ( May 31 , 1924 -- March 23 , 1985 ) served as United States Secretary of Housing and Urban Development , the last United States Secretary of Health , Education , and Welfare and the first United States Secretary of Health and Human Services in the administration of President Jimmy Carter . Patricia Roberts Harris ( May 31 , 1924 -- March 23 , 1985 ) served as United States Secretary of Housing and Urban Development , and United States Secretary of Health , Education , and Welfare ( which office later became United States Secretary of Health and Human Services ) in the administration of President Jimmy Carter .