metadata
title: README
emoji: 🐢
colorFrom: purple
colorTo: purple
sdk: static
pinned: false
Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power LLMs api-inference widgets.
Check out the source code 👉
- the server backend: https://github.com/huggingface/text-generation-inference
- the Chat UI: https://huggingface.co/spaces/text-generation-inference/chat-ui