Hasan Iqbal
Added doc homepage
a7431bb unverified
|
raw
history blame
4 kB

OpenFactCheck Documentation

.. module:: openfactcheck

OpenFactCheck is an open source, Apache-licensed library designed to facilitate the evaluation and enhancement of factuality in responses generated by large language models (LLMs).

The design of {mod}openfactcheck emphasizes two principles:

  • Customizability and extensibility for both users and developers
  • Compatibility with existing methods and datasets

It consists of three core modules:

:grid-columns: 1 1 2 3

- header: "{fas}`check-to-slot;pst-color-primary`  Response Evaluator"
  content: "Customizes an automatic fact-checker to verify free-form documents, providing detailed reports on the factuality of the responses."
- header: "{fas}`chart-line;pst-color-primary`  LLM Evaluator"
  content: "Applies factuality-specific benchmarks to assess the factual performance of large language models, providing detailed reports on the factuality of the responses."
- header: "{fas}`trophy;pst-color-primary`  Fact Checker Evaluator"
  content: "Evaluates fact-checking accuracy, featuring a leaderboard that ranks systems by precision, speed, and cost, driving innovation in automatic fact-checking."

Explore the documentation to learn more about the library, its features, how to use and contribute to it, and more.

.. grid:: 1 2 2 2
    :gutter: 4
    :padding: 2 2 0 0
    :class-container: sd-text-center

    .. grid-item-card:: Getting Started
        :img-top: _static/index_getting_started.svg
        :class-card: intro-card
        :shadow: md

        New to *OpenFactCheck*? Check out the getting started guides. They contain an
        introduction to *OpenFactCheck*'s main concepts and links to additional tutorials.

        +++
        
        .. button-ref:: getting_started/index
            :ref-type: doc
            :color: secondary
            :expand:

            Begin Your Journey

    .. grid-item-card::  User Guide
        :img-top: _static/index_user_guide.svg
        :class-card: intro-card
        :shadow: md

        The user guide provides in-depth information on the
        key concepts of *OpenFactCheck* with useful background information and explanation.

        +++

        .. button-ref:: user_guide/index
            :ref-type: doc
            :color: secondary
            :expand:

            View User Guide

    .. grid-item-card::  API Reference
        :img-top: _static/index_api.svg
        :class-card: intro-card
        :shadow: md

        The reference guide contains a detailed description of
        the *OpenFactCheck* API. The reference describes how the methods work and which parameters can
        be used. It assumes that you have an understanding of the key concepts.

        +++

        .. button-ref:: api/index
            :ref-type: doc
            :color: secondary
            :expand:

            View API Reference

    .. grid-item-card::  Developer Guide
        :img-top: _static/index_contribute.svg
        :class-card: intro-card
        :shadow: md

        Want to improve existing functionalities? Saw a typo in the documentation?
        Want to contribute to the project? The contributing guidelines will guide
        you through the process of improving *OpenFactCheck*.

        +++

        .. button-ref:: development/index
            :ref-type: doc
            :color: secondary
            :expand:

            Contribute

Useful links: Binary Installers | Source Repository | Issues & Ideas |

:hidden: true
:maxdepth: 3
:titlesonly: true

getting_started/index
user_guide/index
api/index
development/index