---
title: README
emoji: 🐢
colorFrom: purple
colorTo: purple
sdk: static
pinned: false
---

Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at [HuggingFace](https://huggingface.co) 
to power LLMs api-inference widgets.

![architecture](architecture.jpg)

## Repos

Check out the source code 👉
- the server backend: https://github.com/huggingface/text-generation-inference
- the Chat UI: https://huggingface.co/spaces/text-generation-inference/chat-ui