|
# Caching on LiteLLM |
|
|
|
LiteLLM supports multiple caching mechanisms. This allows users to choose the most suitable caching solution for their use case. |
|
|
|
The following caching mechanisms are supported: |
|
|
|
1. **RedisCache** |
|
2. **RedisSemanticCache** |
|
3. **QdrantSemanticCache** |
|
4. **InMemoryCache** |
|
5. **DiskCache** |
|
6. **S3Cache** |
|
7. **DualCache** (updates both Redis and an in-memory cache simultaneously) |
|
|
|
## Folder Structure |
|
|
|
``` |
|
litellm/caching/ |
|
βββ base_cache.py |
|
βββ caching.py |
|
βββ caching_handler.py |
|
βββ disk_cache.py |
|
βββ dual_cache.py |
|
βββ in_memory_cache.py |
|
βββ qdrant_semantic_cache.py |
|
βββ redis_cache.py |
|
βββ redis_semantic_cache.py |
|
βββ s3_cache.py |
|
``` |
|
|
|
## Documentation |
|
- [Caching on LiteLLM Gateway](https://docs.litellm.ai/docs/proxy/caching) |
|
- [Caching on LiteLLM Python](https://docs.litellm.ai/docs/caching/all_caches) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|