Benchmarking my research results with related work's results
If the paper was accepted, it means that the reviewers and the editor / chair considered it to have sufficient merit for publication. Comments in the reviews are suggestions to improve the paper, but being the author, it is finally up to your discretion as to what is appropriate.

In your case, assuming that you now need to send the final camera ready version for publication, you could update the paper with the reasons you think such a comparison would be invalid. This would also help future readers of your paper who may have the same question.