To list apps reading/writing contacts? I would like to get the better overview of applications reading and writing my phonebook i.e. contacts. 
TrueCaller incidence shows that I do not have sufficient understanding and full control of the phone itself. 
Similarly, my recent OnePlus data collection incidence belongs to the same category. 

I think the very basic feature of listing all applications that can access (read and write) your phonebook can be a good start to eliminate unnecessary apps there.

OS: Android 7.1.1 and Oreo
Phone: Oneplus 3T
You might try the following app from play store that lets you view permissions in different ways

Permission Explorer