Add arm64 builds to CI
#### Problem description

Travis now has support for arm64 CI[1] and it would be great to have a CI job in place to ensure that builds and tests are run on arm64 to ensure that it works OK.  This will also help ensure that in future undefined behaviour such as #28918 do not get silently introduced into pandas.

[1] https://blog.travis-ci.com/2019-10-07-multi-cpu-architecture-support