In 1860, Fisk and his new family moved to Brown County and constructed a log house east of what is now Brownwood.
The original site of Brownwood (County seat for Brown County) was on the east of Pecan Bayou.