Spaces:
Running
Running
metadata
title: README
emoji: 🚀
colorFrom: green
colorTo: blue
sdk: static
pinned: true
Orion Research - [https://orion.moe](https://orion.moe)
Training Details
Training Factors We used custom training libraries, Orion Research Mini Cluster for pretraining.
| Model | Capabilities | Size | Context Length | License |
| Aura 16x17B SparseMoE | Text | 17B | 8192 | Apache |
| AuraTiny | Text | 1.67B | 4096 | Apache |
| Aura-GI (General Intelligence) | Text, Vision (Image, Video), Audio, Speech, API Handler and Self Improvement | 40B | 262.144 (256K) | Private |
We Are Green
We emit ZER0 CO2: Orion Research has it's own Solar Usine based on Conceição do Coité - BA - Brazil
Contact
For additional questions about details in this model card, contact [email protected].