unsloth
/

Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

How to run this version with vLLM

by alecauduro - opened 7 days ago

7 days ago

Anybody got ir running with vLLM?

Unsloth AI org 6 days ago

Anybody got ir running with vLLM?

Not supported at the moment but will soon :)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment