CI: benchmark build is taking a long time
xref https://github.com/pandas-dev/pandas/runs/4204157179?check_suite_focus=true

have seen this on multiple PRs. Maybe something recently added causes this to timeout.