Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

kernels-community
/
quantization

kernel
Model card Files Files and versions Community
1
quantization / gptq_marlin
Ctrl+K
Ctrl+K
  • 3 contributors
History: 2 commits
danieldk's picture
danieldk HF Staff
Add GPTQ-Marlin
c31b5ce 5 months ago
  • awq_marlin_repack.cu
    8.79 kB
    Add GPTQ-Marlin 5 months ago
  • gptq_marlin.cu
    95.1 kB
    Add GPTQ-Marlin 5 months ago
  • gptq_marlin_repack.cu
    11.1 kB
    Add GPTQ-Marlin 5 months ago
  • marlin.cuh
    2.27 kB
    Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 6 months ago
  • marlin_dtypes.cuh
    1.99 kB
    Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 6 months ago