Which android internet browser can download a specific file by clicking on a specific button?
It sounds like your problem may not be with the browsers, but that Android doesn't have any app willing to support the specific download.

You could try downloading an app which has an option to support all downloads, such as ES File Explorer. It should then offer to open the GPX file when you click on it to download.