Schmidt joined the Social Democratic Party of Germany (SPD) in 1946, and from 1947 to 1948 was the leader of the Socialist German Student League, the student organisation of the SPD.
He was elected to the Bundestag in 1953, and in 1957 he became a member of the SPD parliamentary party executive.