darabos's picture
Update LynxScribe module with recent changes.
99ddf91
|
raw
history blame
757 Bytes

LynxScribe in LynxKite

LynxKite UI for building LynxScribe chat applications. Also runs the chat application!

To run a chat UI for LynxScribe workspaces:

WEBUI_AUTH=false OPENAI_API_BASE_URL=http://localhost:8000/api/service/lynxkite_lynxscribe uvx open-webui serve

Or use Lynx WebUI instead of Open WebUI.

Run tests with:

uv run pytest

The LLM agent flow examples use local models.

uv pip install infinity-emb[all]
infinity_emb v2 --model-id michaelfeil/bge-small-en-v1.5
uv pip install "sglang[all]>=0.4.2.post2" --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer/
python -m sglang.launch_server --model-path SultanR/SmolTulu-1.7b-Instruct --port 8080