 In 1921, Brown was elected to the South Carolina House of Representatives and he became the speaker of the body in 1925.From 1922 to 1926, Brown was the chairman of the state Democratic Party.Brown resigned his speakership in 1926 to challenge Senator Ellison D. Smith in the Democratic primary election, but fell short by 5,000 votes in the runoff election.