Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-base

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

17

Full-text search

Active filters: ibm-granite/granite-3.1-8b-base

DevQuasar/ibm-granite.granite-3.1-8b-base-GGUF

Text Generation • Updated 10 days ago • 68 • 1

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 12

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 717 • 7

mradermacher/granite-3.1-8b-base-GGUF

Updated Dec 20, 2024 • 20

mradermacher/granite-3.1-8b-base-i1-GGUF

Updated Dec 20, 2024 • 62

itlwas/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 9

tensorblock/granite-3.1-8b-base-GGUF

Updated Jan 1 • 32

Triangle104/granite-3.1-8b-base-Q4_K_S-GGUF

Updated about 1 month ago • 27

Triangle104/granite-3.1-8b-base-Q4_K_M-GGUF

Updated about 1 month ago • 24

Triangle104/granite-3.1-8b-base-Q5_K_S-GGUF

Updated about 1 month ago • 37

Triangle104/granite-3.1-8b-base-Q5_K_M-GGUF

Updated about 1 month ago • 27

Triangle104/granite-3.1-8b-base-Q6_K-GGUF

Updated about 1 month ago • 36

Triangle104/granite-3.1-8b-base-Q8_0-GGUF

Updated about 1 month ago • 92

neuralmagic/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated 12 days ago • 17

neuralmagic/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 12 days ago • 48

async0x42/granite-3.1-8b-instruct-exl2_4.65bpw

Text Generation • Updated 18 days ago • 5

TheMelonGod/granite-3.1-8b-base-exl2

Text Generation • Updated 14 days ago • 81