Weekends seems to be th ebest time to play but with BFV and Firestorm, server population will be down for a while. However, I`m sure when people get sick of that they will come back to BF4.
Other newer games are slowly eroding the BF4 playerbase. Happens to all games over time. BF4 will have a following for a long time but it will continue to shrink.