 Ballard was returned to the House of Burgesses from James City County, and the House chose him as Speaker for the session of 1680–82.After his service as Speaker, he remained in the House until 1686.He also commanded the county militia during this period.