DOC: Fix warnings in doc build
Split from https://github.com/pandas-dev/pandas/pull/22743

This has just the docs changes, not the doc build / CI changes, so I don't have to keep fixing merge conflicts.