|
--- |
|
title: README |
|
emoji: 🐢 |
|
colorFrom: purple |
|
colorTo: purple |
|
sdk: static |
|
pinned: false |
|
--- |
|
|
|
Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at [HuggingFace](https://huggingface.co) |
|
to power LLMs api-inference widgets. |
|
|
|
<img width="300px" src="architecture.jpg"> |
|
|
|
## Repos |
|
|
|
Check out the source code 👉 |
|
- the server backend: https://github.com/huggingface/text-generation-inference |
|
- the Chat UI: https://huggingface.co/spaces/text-generation-inference/chat-ui |
