The 2016 Silsbee, Texas, population is 6,688. There are 871 people per square mile (population density). The median age is 38.6. The US median is 37.4. 49.75% of people in Silsbee, Texas, are married. 11.76% are divorced.