.rst
.pdf
Generic Functionality
Generic Functionality#
The examples here all address certain “how-to” guides for working with LLMs.
LLM Serialization: A walkthrough of how to serialize LLMs to and from disk.
LLM Caching: Covers different types of caches, and how to use a cache to save results of LLM calls.
Custom LLM: How to create and use a custom LLM class, in case you have an LLM not from one of the standard providers (including one that you host yourself).
Token Usage Tracking: How to track the token usage of various chains/agents/LLM calls.
Fake LLM: How to create and use a fake LLM for testing and debugging purposes.
previous
How-To Guides
next
Custom LLM
By Harrison Chase
    
      © Copyright 2023, Harrison Chase.
      
  Last updated on Mar 22, 2023.