|
--- |
|
license: mit |
|
base_model: openai-community/gpt2 |
|
--- |
|
# Null-GPT2 |
|
|
|
## Description |
|
|
|
This is a GPT2 Model, but only with the architecture, no pre-trained weights, biases, attention, etc. |
|
|
|
This is useful for researchers who want to play with training the model (not tuning). |
|
|
|
Generated via the github repo [Model Architecture Generator](https://github.com/ivanhe123/Model-Architecture-Generator) |
|
|
|
## Use |
|
First go into the directory of the model, |
|
``` |
|
git clone https://github.com/ivanhe123/Model-Architecture-Generator |
|
``` |
|
|
|
``` |
|
python -m randomnize_params -in "./NullGPT2" -out path_model_out |
|
``` |
|
|
|
path_model_out is just the output path of the newly randomnized model. |
