Hugging Face's logo

SolidRusT Networks
company
Verified
https://solidrust.net
solidrust420
solidrust
Activity Feed

AI & ML interests

Self-hosting, Open Source and AI Unalignment

Recent Activity

SupariousΒ  new activity about 1 month ago
solidrust/dolphin-2.8-mistral-7b-v02-AWQ:Performed my own Quantization, now encounter an error while running inference with vllm.
SupariousΒ  updated a model 10 months ago
solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
SupariousΒ  updated a model 10 months ago
solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
View all activity

Organization Card
Community About org cards

Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.

Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq

Collections 8

7B AWQ
These models are selected for their compatibility with small 12GB memory GPUs.
7B AWQ
These models are selected for their compatibility with small 12GB memory GPUs.
View 8 collections

datasets 0

None public yet