extensible API so you can create your own or contribute improvements for everyone to use. The following sections have example notebooks for you to get started.String Evaluators: Evaluate the predicted string for a given input, usually against a reference stringTrajectory Evaluators: Evaluate the whole trajectory of agent actionsComparison Evaluators: Compare predictions from two runs on a common inputThis section also provides some additional examples of how you could use these evaluators for different scenarios or apply to different chain implementations in the LangChain library. Some examples include:Preference Scoring Chain Outputs: An example using a comparison evaluator on different models or prompts to select statistically significant differences in aggregate preference scoresReference Docsâ€‹For detailed information of the available evaluators, including how to instantiate, configure, and customize them. Check out the reference documentation directly.ğŸ—ƒï¸� String Evaluators5 itemsğŸ—ƒï¸� Comparison Evaluators3 itemsğŸ—ƒï¸� Trajectory Evaluators2 itemsğŸ—ƒï¸� Examples9 itemsPreviousGuidesNextString EvaluatorsReference DocsCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright Â© 2023 LangChain, Inc.