autogen/autogen/agentchat/contrib/agent_eval/README.md
Agents for running the [AgentEval](https://microsoft.github.io/autogen/blog/2023/11/20/AgentEval/) pipeline.  AgentEval is a process for evaluating a LLM-based system's performance on a given task.  When given a task to evaluate and a few example runs, the critic and subcritic agents create evaluation criteria for evaluating a system's solution. Once the criteria has been created, the quantifier agent can evaluate subsequent task solutions based on the generated criteria.  For more information see: [AgentEval Integration Roadmap](https://github.com/microsoft/autogen/issues/2162)  See our [blog post](https://microsoft.github.io/autogen/blog/2024/06/21/AgentEval) for usage examples and general explanations. 