The county seat is Fort Worth , and the population of the city in 2006 was 653,320 making it the largest city in the county . Fort Worth is the most populous city in Tarrant County , seventeenth largest in the U.S. , with a population of 653,320 as of 2006 .