File size: 605 Bytes
b9e46e6 e837a6e 6944f44 e837a6e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
---
title: README
emoji: 🐢
colorFrom: purple
colorTo: purple
sdk: static
pinned: false
---
Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at [HuggingFace](https://huggingface.co)
to power LLMs api-inference widgets.
<img width="300px" src="https://huggingface.co/spaces/text-generation-inference/README/resolve/main/architecture.jpg" />
## Repos
Check out the source code 👉
- the server backend: https://github.com/huggingface/text-generation-inference
- the Chat UI: https://huggingface.co/spaces/text-generation-inference/chat-ui |