OpenFactCheck Documentation
.. module:: openfactcheck
OpenFactCheck is an open source, Apache-licensed library designed to facilitate the evaluation and enhancement of factuality in responses generated by large language models (LLMs).
The design of {mod}openfactcheck
emphasizes two principles:
- Customizability and extensibility for both users and developers
- Compatibility with existing methods and datasets
It consists of three core modules:
:grid-columns: 1 1 2 3
- header: "{fas}`check-to-slot;pst-color-primary` Response Evaluator"
content: "Customizes an automatic fact-checker to verify free-form documents, providing detailed reports on the factuality of the responses."
- header: "{fas}`chart-line;pst-color-primary` LLM Evaluator"
content: "Applies factuality-specific benchmarks to assess the factual performance of large language models, providing detailed reports on the factuality of the responses."
- header: "{fas}`trophy;pst-color-primary` Fact Checker Evaluator"
content: "Evaluates fact-checking accuracy, featuring a leaderboard that ranks systems by precision, speed, and cost, driving innovation in automatic fact-checking."
Explore the documentation to learn more about the library, its features, how to use and contribute to it, and more.
.. grid:: 1 2 2 2
:gutter: 4
:padding: 2 2 0 0
:class-container: sd-text-center
.. grid-item-card:: Getting Started
:img-top: _static/index_getting_started.svg
:class-card: intro-card
:shadow: md
New to *OpenFactCheck*? Check out the getting started guides. They contain an
introduction to *OpenFactCheck*'s main concepts and links to additional tutorials.
+++
.. button-ref:: getting_started/index
:ref-type: doc
:color: secondary
:expand:
Begin Your Journey
.. grid-item-card:: User Guide
:img-top: _static/index_user_guide.svg
:class-card: intro-card
:shadow: md
The user guide provides in-depth information on the
key concepts of *OpenFactCheck* with useful background information and explanation.
+++
.. button-ref:: user_guide/index
:ref-type: doc
:color: secondary
:expand:
View User Guide
.. grid-item-card:: API Reference
:img-top: _static/index_api.svg
:class-card: intro-card
:shadow: md
The reference guide contains a detailed description of
the *OpenFactCheck* API. The reference describes how the methods work and which parameters can
be used. It assumes that you have an understanding of the key concepts.
+++
.. button-ref:: api/index
:ref-type: doc
:color: secondary
:expand:
View API Reference
.. grid-item-card:: Developer Guide
:img-top: _static/index_contribute.svg
:class-card: intro-card
:shadow: md
Want to improve existing functionalities? Saw a typo in the documentation?
Want to contribute to the project? The contributing guidelines will guide
you through the process of improving *OpenFactCheck*.
+++
.. button-ref:: development/index
:ref-type: doc
:color: secondary
:expand:
Contribute
Useful links: Binary Installers | Source Repository | Issues & Ideas |
:hidden: true
:maxdepth: 3
:titlesonly: true
getting_started/index
user_guide/index
api/index
development/index