How to display a 'delete button' on the touchbar?
I haven't tried this but in theory I think it could work.

You can try making the touchbar show function keys for that app so that you do not need to hold fn: https://support.apple.com/en-us/HT207240

Then download Karabiner-Elements (which is free) to change one of the function keys to a delete key.