pytorch bert feature-extraction transformers license:mit
---
license: mit
---

## MiniLM: 3 Layer Version

This is a 3 layer version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased/) by keeping only the layer [3, 7, 11].