pytorch bloom feature-extraction eng transformers integration text-generation
---
language: 
  - eng
tags:
- integration
pipeline_tag: text-generation
---

# BigScience - testing model

This model aims to test the conversion between Megatron-LM and transformers. It is a small ```GPT-2```-like model that has been used to debug the script. Use it only for integration tests