Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
quantization
like
6
Follow
Red Hat AI
1.34k
kernel
License:
apache-2.0
Model card
Files
Files and versions
Community
1
2f56f34
quantization
Ctrl+K
Ctrl+K
2 contributors
History:
43 commits
danieldk
HF Staff
Export Marlin and quantization utilities
2f56f34
about 1 month ago
attention
Sync to vLLM 20250627
about 1 month ago
build
Build (AArch64)
about 1 month ago
compressed_tensors
Sync to vLLM 20250627
about 1 month ago
core
Sync to vLLM 20250627
about 1 month ago
cutlass_extensions
Sync to vLLM 20250627
about 1 month ago
cutlass_w8a8
Sync to vLLM 20250627
about 1 month ago
fp8
Sync to vLLM 20250627
about 1 month ago
gptq_marlin
Sync to vLLM 20250627
about 1 month ago
marlin
Sync to vLLM 20250627
about 1 month ago
tests
Sync to vLLM 20250627
about 1 month ago
torch-ext
Export Marlin and quantization utilities
about 1 month ago
.gitattributes
Safe
1.56 kB
Build
8 months ago
LICENSE
Safe
11.4 kB
Add cutlass_w8a8
8 months ago
README.md
Safe
195 Bytes
Update README.md (#1)
6 months ago
build.toml
Safe
5.92 kB
Set CUDA minimum versions for hopper/blackwell cutlass kernels
about 1 month ago
cuda_utils.h
Safe
1.41 kB
Sync on vLLM 20240402
4 months ago
dispatch_utils.h
Safe
3.9 kB
Sync to vLLM 20250627
about 1 month ago
flake.lock
4.5 kB
Set CUDA minimum versions for hopper/blackwell cutlass kernels
about 1 month ago
flake.nix
354 Bytes
Set CUDA minimum versions for hopper/blackwell cutlass kernels
about 1 month ago
utils.cuh
Safe
1.84 kB
Sync on vLLM 20240402
4 months ago
vectorization.cuh
Safe
878 Bytes
Sync to vLLM 20250627
about 1 month ago
vectorization_utils.cuh
Safe
2.61 kB
Sync to vLLM 20250627
about 1 month ago
