 After taking his oath of office on the balcony of Federal Hall, he proceeded to the Senate chamber where he read a speech before members of Congress and other dignitaries.Every president since Washington has delivered an Inaugural address.While many of the early presidents read their addresses before taking the oath, current custom dictates that the chief justice administer the oath first, followed by the president's speech.