arm64 CI takes too much time to complete .
Hi, I am trying to add support for arm64 in travis CI for Pandas. but unfortunately, all tests are taking more than 50min to complete and hence, travis shows up :
`The job exceeded the maximum time limit for jobs, and has been terminated.`

I have attached the logs here:
[travis-ci-test.txt](https://github.com/pandas-dev/pandas/files/3921219/travis-ci-test.txt)

Can anyone help me to identify the root cause for this ? 