Following the Federation of Australia on 1 January 1901, Smith successfully contested the newly created federal Division of Parkes at the inaugural Australian federal election as a Free Trade Party representative.
In parliament, Smith often clashed with his Free Trade colleagues, particularly party leader George Reid, over his refusal to toe the party line.