Any process that stops, prevents or reduces the frequency, rate or extent of RNA polymerase II regulatory region sequence-specific DNA binding.
downregulation of RNA polymerase II regulatory region sequence-specific DNA binding