Is the conjugate base of every polyprotic acid amphoteric?
The conjugate base of sulfuric acid, bisulfate ion, shows little amphoteric character in water solution.  Unless you drop the pH to about 2 or below, it is only an acid, and a moderately strong one at that.