File size: 555 Bytes
42e4847
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
license: mit
language:
- en
pipeline_tag: text-classification
tags:
- gpt2
- distributed-training
- megatron
- accelerate
---
# Megatron-GPT2-Classification

## Description

The `megatron-gpt2-classification` model is a language model trained using Megatron and Accelerate frameworks. It has been fine-tuned for classification tasks and benefits from distributed training across 4 GPUs (RTX 4070).

## Key Features

- Trained with **Megatron** and **Accelerate**.
- Distributed training on **4 GPUs (RTX 4070)**.
- Fine-tuned for classification tasks.