Hugging Face's logo

crusoeai
/
Llama-3-8B-Instruct-Gradient-1048k-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
3

See the model evaluation on intel's low-bit leaderboard, its not that good

#3
by xceptor - opened
Discussion
xceptor

Here is the link

3thn
 Crusoe AI org

Thanks for the heads up! I think the results make the case to add intel's autoround quants to our generation pipeline.

3thn changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment