
## Quickstart

**Release 1.1** (February 13, 2021)

Please check also our newer model: [NorBERT 2](https://huggingface.co/ltgoslo/norbert2), trained on a much larger corpus.

Download the model here:

* Cased Norwegian BERT Base: [216.zip](http://vectors.nlpl.eu/repository/20/216.zip)

More about NorBERT training corpora and training procedure: http://norlm.nlpl.eu/

Associated code: https://github.com/ltgoslo/NorBERT

Check this paper for more details:

_Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen. [Large-Scale Contextualised Language Modelling for Norwegian](https://arxiv.org/abs/2104.06546), NoDaLiDa'21 (2021)_

NorBERT was trained as a part of NorLM, a joint initiative of the projects [EOSC-Nordic](https://www.eosc-nordic.eu/) (European Open Science Cloud) and [SANT](https://www.mn.uio.no/ifi/english/research/projects/sant/index.html) (Sentiment Analysis for Norwegian),
coordinated by the [Language Technology Group](https://www.mn.uio.no/ifi/english/research/groups/ltg/) (LTG) at the University of Oslo.

The computations were performed on resources provided by UNINETT Sigma2 - the National Infrastructure for High Performance Computing and Data Storage in Norway.

## NorBERT-3

In 2023, we released a new family of *NorBERT-3* language models for Norwegian. In general, we now recommend using these models:

- [NorBERT 3 xs](https://huggingface.co/ltg/norbert3-xs) (15M parameters)
- [NorBERT 3 small](https://huggingface.co/ltg/norbert3-small) (40M parameters)
- [NorBERT 3 base](https://huggingface.co/ltg/norbert3-base) (123M parameters)
- [NorBERT 3 large](https://huggingface.co/ltg/norbert3-large) (323M parameters)

NorBERT-3 is described in detail in this paper:
[NorBench – A Benchmark for Norwegian Language Models](https://aclanthology.org/2023.nodalida-1.61/) (Samuel et al., NoDaLiDa 2023)
{"language": false, "license": "cc-by-4.0", "tags": ["norwegian", "bert"], "pipeline_tag": "fill-mask", "thumbnail": "https://raw.githubusercontent.com/ltgoslo/NorBERT/main/Norbert.png"}
transformers pytorch tf jax safetensors bert fill-mask norwegian no arxiv:2104.06546 license:cc-by-4.0 autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #pytorch #tf #jax #safetensors #bert #fill-mask #norwegian #no #arxiv-2104.06546 #license-cc-by-4.0 #autotrain_compatible #endpoints_compatible #has_space #region-us 


## Quickstart

Release 1.1 (February 13, 2021)

Please check also our newer model: NorBERT 2, trained on a much larger corpus.

Download the model here:

* Cased Norwegian BERT Base: URL

More about NorBERT training corpora and training procedure: URL

Associated code: URL

Check this paper for more details:

_Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen. Large-Scale Contextualised Language Modelling for Norwegian, NoDaLiDa'21 (2021)_

NorBERT was trained as a part of NorLM, a joint initiative of the projects EOSC-Nordic (European Open Science Cloud) and SANT (Sentiment Analysis for Norwegian),
coordinated by the Language Technology Group (LTG) at the University of Oslo.

The computations were performed on resources provided by UNINETT Sigma2 - the National Infrastructure for High Performance Computing and Data Storage in Norway.

## NorBERT-3

In 2023, we released a new family of *NorBERT-3* language models for Norwegian. In general, we now recommend using these models:

- NorBERT 3 xs (15M parameters)
- NorBERT 3 small (40M parameters)
- NorBERT 3 base (123M parameters)
- NorBERT 3 large (323M parameters)

NorBERT-3 is described in detail in this paper:
NorBench – A Benchmark for Norwegian Language Models (Samuel et al., NoDaLiDa 2023)
## Quickstart

Release 1.1 (February 13, 2021)

Please check also our newer model: NorBERT 2, trained on a much larger corpus.

Download the model here:

* Cased Norwegian BERT Base: URL

More about NorBERT training corpora and training procedure: URL

Associated code: URL

Check this paper for more details:

_Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen. Large-Scale Contextualised Language Modelling for Norwegian, NoDaLiDa'21 (2021)_

NorBERT was trained as a part of NorLM, a joint initiative of the projects EOSC-Nordic (European Open Science Cloud) and SANT (Sentiment Analysis for Norwegian),
coordinated by the Language Technology Group (LTG) at the University of Oslo.

The computations were performed on resources provided by UNINETT Sigma2 - the National Infrastructure for High Performance Computing and Data Storage in Norway. ## NorBERT-3

In 2023, we released a new family of *NorBERT-3* language models for Norwegian. In general, we now recommend using these models:

- NorBERT 3 xs (15M parameters)
- NorBERT 3 small (40M parameters)
- NorBERT 3 base (123M parameters)
- NorBERT 3 large (323M parameters)

NorBERT-3 is described in detail in this paper:
NorBench – A Benchmark for Norwegian Language Models (Samuel et al., NoDaLiDa 2023)
TAGS
#transformers #pytorch #tf #jax #safetensors #bert #fill-mask #norwegian #no #arxiv-2104.06546 #license-cc-by-4.0 #autotrain_compatible #endpoints_compatible #has_space #region-us 
 ## Quickstart

Release 1.1 (February 13, 2021)

Please check also our newer model: NorBERT 2, trained on a much larger corpus.

Download the model here:

* Cased Norwegian BERT Base: URL

More about NorBERT training corpora and training procedure: URL

Associated code: URL

Check this paper for more details:

_Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen. Large-Scale Contextualised Language Modelling for Norwegian, NoDaLiDa'21 (2021)_

NorBERT was trained as a part of NorLM, a joint initiative of the projects EOSC-Nordic (European Open Science Cloud) and SANT (Sentiment Analysis for Norwegian),
coordinated by the Language Technology Group (LTG) at the University of Oslo.

The computations were performed on resources provided by UNINETT Sigma2 - the National Infrastructure for High Performance Computing and Data Storage in Norway. ## NorBERT-3

In 2023, we released a new family of *NorBERT-3* language models for Norwegian. In general, we now recommend using these models:

- NorBERT 3 xs (15M parameters)
- NorBERT 3 small (40M parameters)
- NorBERT 3 base (123M parameters)
- NorBERT 3 large (323M parameters)

NorBERT-3 is described in detail in this paper:
NorBench – A Benchmark for Norwegian Language Models (Samuel et al., NoDaLiDa 2023)
passage: TAGS
#transformers #pytorch #tf #jax #safetensors #bert #fill-mask #norwegian #no #arxiv-2104.06546 #license-cc-by-4.0 #autotrain_compatible #endpoints_compatible #has_space #region-us 
## Quickstart

Release 1.1 (February 13, 2021)

Please check also our newer model: NorBERT 2, trained on a much larger corpus.

Download the model here:

* Cased Norwegian BERT Base: URL

More about NorBERT training corpora and training procedure: URL

Associated code: URL

Check this paper for more details:

_Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen. Large-Scale Contextualised Language Modelling for Norwegian, NoDaLiDa'21 (2021)_

NorBERT was trained as a part of NorLM, a joint initiative of the projects EOSC-Nordic (European Open Science Cloud) and SANT (Sentiment Analysis for Norwegian),
coordinated by the Language Technology Group (LTG) at the University of Oslo.

The computations were performed on resources provided by UNINETT Sigma2 - the National Infrastructure for High Performance Computing and Data Storage in Norway.## NorBERT-3

In 2023, we released a new family of *NorBERT-3* language models for Norwegian. In general, we now recommend using these models:

- NorBERT 3 xs (15M parameters)
- NorBERT 3 small (40M parameters)
- NorBERT 3 base (123M parameters)
- NorBERT 3 large (323M parameters)

NorBERT-3 is described in detail in this paper:
NorBench – A Benchmark for Norwegian Language Models (Samuel et al., NoDaLiDa 2023)