During a four-year legislative hiatus corresponding with the administration of Earl Kemp Long, Smith could focus full-time on his legal duties.
On March 3, 1964, however, Smith was unseated in the general election.