Raju2024's picture
Upload 1072 files
e3278e4 verified
|
raw
history blame
894 Bytes
# Caching on LiteLLM
LiteLLM supports multiple caching mechanisms. This allows users to choose the most suitable caching solution for their use case.
The following caching mechanisms are supported:
1. **RedisCache**
2. **RedisSemanticCache**
3. **QdrantSemanticCache**
4. **InMemoryCache**
5. **DiskCache**
6. **S3Cache**
7. **DualCache** (updates both Redis and an in-memory cache simultaneously)
## Folder Structure
```
litellm/caching/
β”œβ”€β”€ base_cache.py
β”œβ”€β”€ caching.py
β”œβ”€β”€ caching_handler.py
β”œβ”€β”€ disk_cache.py
β”œβ”€β”€ dual_cache.py
β”œβ”€β”€ in_memory_cache.py
β”œβ”€β”€ qdrant_semantic_cache.py
β”œβ”€β”€ redis_cache.py
β”œβ”€β”€ redis_semantic_cache.py
β”œβ”€β”€ s3_cache.py
```
## Documentation
- [Caching on LiteLLM Gateway](https://docs.litellm.ai/docs/proxy/caching)
- [Caching on LiteLLM Python](https://docs.litellm.ai/docs/caching/all_caches)