Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
SambaNova
Replicate
fal
Together AI
HF Inference API
Misc
Reset Misc
arxiv:
2309.05516
4-bit precision
custom_code
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Misc with no match
Eval Results
Merge
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
99
Full-text search
Edit filters
Sort: Trending
Active filters:
2309.05516
Clear all
OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc
Updated
Dec 24, 2024
•
66
OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc
Updated
Jan 10
•
22
OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc
Updated
Jan 10
•
8
OPEA/Qwen2.5-3B-Instruct-int4-sym-inc
Updated
Jan 10
•
32
OPEA/QwQ-32B-Preview-int4-sym-mixed-inc
Updated
Dec 23, 2024
•
7
•
8
OPEA/glm-4-9b-chat-int4-sym-inc
Updated
Dec 23, 2024
•
12
OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc
Updated
Dec 23, 2024
•
10
•
1
OPEA/glm-4-9b-chat-int4-sym-lm-head-inc
Updated
Dec 23, 2024
•
6
OPEA/internlm2_5-7b-chat-int4-sym-inc
Updated
Dec 23, 2024
•
5
OPEA/internlm2_5-7b-chat-int4-sym-awq-inc
Updated
Dec 23, 2024
•
12
OPEA/Marco-o1-int4-sym-inc
Updated
Dec 23, 2024
•
10
OPEA/Marco-o1-int4-sym-awq-inc
Updated
Dec 23, 2024
•
7
OPEA/SmolVLM-Instruct-int4-sym-inc
Updated
about 1 month ago
•
16
•
1
OPEA/Phi-3.5-vision-instruct-qvision-int4-sym-inc
Updated
Dec 24, 2024
•
44
•
1
OPEA/Llama-3.2-11B-Vision-Instruct-qvision-int4-sym-inc
Updated
Dec 24, 2024
•
22
OPEA/cogvlm2-llama3-chat-19B-qvision-int4-sym-inc
Updated
about 1 month ago
•
19
•
1
OPEA/DeepSeek-V2-Lite-int4-sym-inc
Updated
Dec 23, 2024
•
10
OPEA/glm-4v-9b-int4-sym-inc
Updated
Dec 23, 2024
•
11
OPEA/OLMo-2-1124-13B-Instruct-int4-sym-inc
Updated
Dec 23, 2024
•
5
OPEA/OLMo-2-1124-7B-Instruct-int4-sym-inc
Updated
Dec 23, 2024
•
5
OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc
Updated
Dec 23, 2024
•
9
OPEA/Llama-3.2V-11B-cot-int4-sym-inc
Updated
about 1 month ago
•
128
OPEA/Llama-3.3-70B-Instruct-int4-sym-inc
Updated
Dec 23, 2024
•
59
OPEA/Qwen2-VL-72B-Instruct-int4-sym-inc
Updated
Dec 23, 2024
•
10
OPEA/Falcon3-3B-Base-int4-sym-inc
Updated
Dec 23, 2024
•
8
OPEA/Falcon3-7B-Base-int4-sym-inc
Updated
Dec 23, 2024
•
9
OPEA/Falcon3-10B-Base-int4-sym-inc
Updated
Dec 23, 2024
•
41
OPEA/Falcon3-10B-Base-int4-sym-awq-inc
Updated
Dec 23, 2024
•
5
OPEA/Falcon3-3B-Base-int4-sym-awq-inc
Updated
Dec 23, 2024
•
3
OPEA/Llama-3.3-70B-Instruct-int2-sym-inc
Updated
4 days ago
•
17
Previous
1
2
3
4
Next