# roberta-base-als-demo

**roberta-base-als-demo** is a model trained by Patrick von Platen to demonstrate how to train a roberta-base model from scratch on the Alemannic language.

This is part of the
[Flax/Jax Community Week](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104), organised by [HuggingFace](https://huggingface.co/) and TPU usage sponsored by Google.


## Useful links
- [Community Week timeline](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104#summary-timeline-calendar-6)
- [Community Week README](https://github.com/huggingface/transformers/blob/master/examples/research_projects/jax-projects/README.md)
- [Masked Language Modelling example scripts](https://github.com/huggingface/transformers/tree/master/examples/flax/language-modeling)
- [Model Repository](https://huggingface.co/flax-community/roberta-base-als-demo)

{}
transformers tensorboard gpt2 text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #tensorboard #gpt2 #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

# roberta-base-als-demo

roberta-base-als-demo is a model trained by Patrick von Platen to demonstrate how to train a roberta-base model from scratch on the Alemannic language.

This is part of the
Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.


## Useful links
- Community Week timeline
- Community Week README
- Masked Language Modelling example scripts
- Model Repository

# roberta-base-als-demo

roberta-base-als-demo is a model trained by Patrick von Platen to demonstrate how to train a roberta-base model from scratch on the Alemannic language.

This is part of the
Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google. ## Useful links
- Community Week timeline
- Community Week README
- Masked Language Modelling example scripts
- Model Repository
TAGS
#transformers #tensorboard #gpt2 #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
 # roberta-base-als-demo

roberta-base-als-demo is a model trained by Patrick von Platen to demonstrate how to train a roberta-base model from scratch on the Alemannic language.

This is part of the
Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google. ## Useful links
- Community Week timeline
- Community Week README
- Masked Language Modelling example scripts
- Model Repository
passage: TAGS
#transformers #tensorboard #gpt2 #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
# roberta-base-als-demo

roberta-base-als-demo is a model trained by Patrick von Platen to demonstrate how to train a roberta-base model from scratch on the Alemannic language.

This is part of the
Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.## Useful links
- Community Week timeline
- Community Week README
- Masked Language Modelling example scripts
- Model Repository