YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

MLX Format and Quantizations for Unslop Nemo 12b v4.1

Quantized to 8-bit precision and tested using the mlx_lm utility on a 64GiB URAM M1 Max.

See original model for further details.

Safetensors

Model size

3.44B params

Tensor type

FP16

U32

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.