Customize touch bar button when using the browser?
Menu Bar → View → Customize Touch Bar

Drag the reload button on your Touch Bar into the trash can on the far left side of your Touch Bar (or just off the Touch Bar).



More info from Google.