Model details

minimoe-4L-384H distilled from bert-large-uncased on Wikipedia.

repository: https://github.com/GeneZC/MiniMoE arXiv: https://arxiv.org/abs/2305.12129

Downloads last month
37
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Dataset used to train GeneZC/bert-large-minimoe-4L-384H