Overview
IBM Granite 3.0, the third generation of the Granite series of large language models (LLMs) and complementary tools. Reflecting our focus on the balance between powerful and practical, the new IBM Granite 3.0 models deliver state-of-the-art performance relative to model size while maximizing safety, speed and cost-efficiency for enterprise use cases.
Variants
| No | Variant | Cortex CLI command |
|---|---|---|
| 1 | gguf | cortex run granite-3.0:gguf |
| 2 | main/default | cortex run granite-3.0 |
Use it with Jan (UI)
- Install Jan using Quickstart
- Use in Jan model Hub:
cortexso/granite-3.0
Use it with Cortex (CLI)
- Install Cortex using Quickstart
- Run the model with command:
cortex run granite-3.0
Credits
- Author: IBM
- Converter: Homebrew
- Original License: License
- Papers: Granite 3.0 Blog
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support