YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Quantized https://huggingface.co/Nexusflow/Athene-70B
Untested
This quantization exists for the sole purpose of giving an option for GGUF users until one of the more prolific model quantizers has a chance to generate proper quants.
My internet is unreliable so I took the lazy way out and split the zip into 5GB parts to avoid upload errors. Just unzip it.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.