How to properly use contextual filter on group content fields
Alright, I found the solution to my issue.

These are the steps I come up and followed.


Add taxonomy term relationship to the view.
On the Contextual filter, search "Name" with taxonomy as description
Under "WHEN THE FILTER VALUE IS IN THE URL OR A DEFAULT IS PROVIDED", tick "Specify validation criteria"
Choose the desired vocabulary.
Save and test in the Preview section.