<p dir="auto">Has anyone considered/tried generating documentation for Zeal/Dash? It would be great to have offline docs. I would be happy to give it a go, just want to make sure I am not duplicating efforts or trying something known to not work (though it looks like it should work using doc2dash).</p>
<p dir="auto">Following PR <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="424884231" data-permission-text="Title is private" data-url="https://github.com/scikit-learn/scikit-learn/issues/13511" data-hovercard-type="pull_request" data-hovercard-url="/scikit-learn/scikit-learn/pull/13511/hovercard" href="https://github.com/scikit-learn/scikit-learn/pull/13511">#13511</a> it appears that there is not reference benchmark for SVMs in scikit-learn or in any side-project (sklearn-contrib).</p>
<p dir="auto">This seems quite risky on the long run, maybe we should create one - especially to quantify the impact of changes to C code such as in PR <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="424884231" data-permission-text="Title is private" data-url="https://github.com/scikit-learn/scikit-learn/issues/13511" data-hovercard-type="pull_request" data-hovercard-url="/scikit-learn/scikit-learn/pull/13511/hovercard" href="https://github.com/scikit-learn/scikit-learn/pull/13511">#13511</a> .</p>
<p dir="auto">I have been working quite a bit on this topic of creating reference benchmarks in the past years, leading to the creation of tools in the pytest ecosystem: <a href="https://smarie.github.io/python-pytest-cases/" rel="nofollow"><code class="notranslate">pytest-cases</code></a> and <a href="https://smarie.github.io/python-pytest-harvest/" rel="nofollow"><code class="notranslate">pytest-harvest</code></a>, with a beginning of tutorial <a href="https://smarie.github.io/pytest-patterns/examples/data_science_benchmark/" rel="nofollow">here</a> (outdated I'm afraid). I can therefore certainly try to help with a benchmark framework structure if you find such an idea interesting.</p>
<p dir="auto">However I do not know a good set of reference datasets to start with (apart from creating challenging ones "by hand").</p>