Bay earned a wide reputation for his prosecution of Burr, who was convicted and executed for the murder of his wife.
Bay had a partnership with the Honorable Abiel Leonard in Jefferson City until 1846 or 1847.