Why does the Terminal app need access to Contacts?
It doesn’t need access - say no to the request. 

Unless you want some program that runs inside terminal to look at your user data, just decline these requests. 

This is covered in the security part Data protections - https://www.apple.com/macos/catalina/features/ - you are seeing the ask to allow looking into that data store / folder.