Early counting of the ballots showed Carter trailing his opponent Homer Moore, but this was the result of fraudulent voting orchestrated by Joe Hurst, the chairman of the Democratic Party in Quitman County.[53] Carter challenged the election result, which was confirmed fraudulent in an investigation. Following this, another election was held, in which Carter won against Moore as the sole Democratic candidate, with a vote margin of 3,013 to 2,182.[54]
The civil rights movement was well underway when Carter took office. He and his family had become staunch John F. Kennedy supporters. Carter remained relatively quiet on the issue at first, even as it polarized much of the county, to avoid alienating his segregationist colleagues. He did speak up on a few divisive issues, giving speeches against literacy tests and against an amendment to the Georgia Constitution which, he felt, implied a compulsion to practice religion.[55] Carter entered the state Democratic Executive Committee two years into office, where he helped rewrite the state party's rules. He became the chairman of the West Central Georgia Planning and Development Commission, which oversaw the disbursement of federal and state grants for projects such as historic site restoration.