CI: remove no-longer-available conda versions
closes #15214, remove bottleneck < 1.0.0
changes CI min of xlsxwriter to 0.5.2

removing our ``pandas`` channel as well (which held some really old versions of things).