Marc Sun's picture

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

updated a model about 23 hours ago
marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
published a model about 23 hours ago
marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
published a model 10 days ago
marcsun13/paligemma_vqav2
View all activity

Organizations

Hugging Face's profile picture Hugging Face Internal Testing Organization's profile picture HuggingFaceM4's profile picture Hugging Face OSS Metrics's profile picture accelerate's profile picture Hugging Face TB Research's profile picture Quanto library's profile picture LocalLLaMA's profile picture MLX Community's profile picture Hugging Face 1Bit LLMs's profile picture Paris AI Running Club's profile picture LLHF's profile picture SLLHF's profile picture Hugging Quants's profile picture Hugging Face Party @ PyTorch Conference's profile picture qrias's profile picture DDUF's profile picture

marcsun13's activity

published an article 4 months ago
view article
Article

Introducing SynthID Text

• 39
published an article 5 months ago
view article
Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

• 218
published an article 5 months ago
view article
Article

Accelerate 1.0.0

• 52
published an article 7 months ago
view article
Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

• 227
published an article 11 months ago
view article
Article

quanto: a pytorch quantization toolkit

• 33
published an article over 1 year ago
view article
Article

Overview of natively supported quantization schemes in 🤗 Transformers

• 11
published an article over 1 year ago
view article
Article

Making LLMs lighter with AutoGPTQ and transformers

• 40