Where can I find the Caller ID settings on BQ version of Android N?
After hours of searching among the settings:
Phone -> More options (three dots) -> Settings -> Calling Accounts -> SIM -> Additional Settings and voila, there it is :).