

## jobBERT-de

This is a domain-adapted transformer-based language model for German-speaking job advertisements.

Is is based on [bert-base-german-cased](https://huggingface.co/bert-base-german-cased) and adapted to the domain of job advertisements trough continued in-domain pretraining on 4 million German-speaking job ads from Switzerland 1990-2020 (5.9 GB data). Empty spots in the vocabulary of the base model were filled with most frequent domain-specific words, subtokens and abbreviations.

### Overview

**Architecture:** BERT base <br>
**Language:** German <br>
**Domain:** Job advertisements <br>
**See also:** [agne/jobGBERT](https://huggingface.co/agne/jobGBERT)

### License

Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (cc-by-nc-sa-4.0)

Please use the following citation when using our model:

```bibtex
@inproceedings{
    title = "Evaluation of Transfer Learning and Domain Adaptation for Analyzing German-Speaking Job Advertisements",
    author = "Gnehm, Ann-Sophie and
      Bühlmann, Eva and
      Clematide, Simon",
    booktitle = "Proceedings of the 13th Language Resources and Evaluation Conference",
    month = june,
    year = "2022",
    address = "Marseille, France",
    publisher = "European Language Resources Association",
}
```
### Intended usage and limitations

You can use the model for masked language modeling, but it's intended to be fine-tuned on a downstream task.

The model is trained on German-Speaking job ads from Switzerland. It inherits potential bias of its base model, and may contain biases and stereotypes common in job advertisements.

### About us

Ann-Sophie Gnehm: `gnehm [at] soziologie.uzh.ch` <br>
Eva Bühlmann: `bühlmann [at] soziologie.uzh.ch` <br>
Simon Clematide: `simon.clematide [at] cl.uzh.ch` <br>

The  [Swiss Job Market Monitor](https://www.stellenmarktmonitor.uzh.ch/en.html) aims at systematically expanding scientific knowledge about the job market and improving labour market transparency by informing the general public about current developments on the job market.

**Get in touch:** [Mail](mailto:gnehm@soziologie.uzh.ch)  [Website](https://www.stellenmarktmonitor.uzh.ch/en.html) [Zenodo](https://doi.org/10.5281/zenodo.6497853) [SWISSUbase](https://www.swissubase.ch/de/catalogue/studies/11998/18157/overview)

{"language": "de", "license": "cc-by-nc-sa-4.0"}
transformers pytorch bert fill-mask de license:cc-by-nc-sa-4.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #bert #fill-mask #de #license-cc-by-nc-sa-4.0 #autotrain_compatible #endpoints_compatible #region-us 



## jobBERT-de

This is a domain-adapted transformer-based language model for German-speaking job advertisements.

Is is based on bert-base-german-cased and adapted to the domain of job advertisements trough continued in-domain pretraining on 4 million German-speaking job ads from Switzerland 1990-2020 (5.9 GB data). Empty spots in the vocabulary of the base model were filled with most frequent domain-specific words, subtokens and abbreviations.

### Overview

Architecture: BERT base <br>
Language: German <br>
Domain: Job advertisements <br>
See also: agne/jobGBERT

### License

Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (cc-by-nc-sa-4.0)

Please use the following citation when using our model:


### Intended usage and limitations

You can use the model for masked language modeling, but it's intended to be fine-tuned on a downstream task.

The model is trained on German-Speaking job ads from Switzerland. It inherits potential bias of its base model, and may contain biases and stereotypes common in job advertisements.

### About us

Ann-Sophie Gnehm: 'gnehm [at] URL' <br>
Eva Bühlmann: 'bühlmann [at] URL' <br>
Simon Clematide: 'simon.clematide [at] URL' <br>

The  Swiss Job Market Monitor aims at systematically expanding scientific knowledge about the job market and improving labour market transparency by informing the general public about current developments on the job market.

Get in touch: Mail  Website Zenodo SWISSUbase

## jobBERT-de

This is a domain-adapted transformer-based language model for German-speaking job advertisements.

Is is based on bert-base-german-cased and adapted to the domain of job advertisements trough continued in-domain pretraining on 4 million German-speaking job ads from Switzerland 1990-2020 (5.9 GB data). Empty spots in the vocabulary of the base model were filled with most frequent domain-specific words, subtokens and abbreviations. ### Overview

Architecture: BERT base <br>
Language: German <br>
Domain: Job advertisements <br>
See also: agne/jobGBERT ### License

Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (cc-by-nc-sa-4.0)

Please use the following citation when using our model: ### Intended usage and limitations

You can use the model for masked language modeling, but it's intended to be fine-tuned on a downstream task.

The model is trained on German-Speaking job ads from Switzerland. It inherits potential bias of its base model, and may contain biases and stereotypes common in job advertisements. ### About us

Ann-Sophie Gnehm: 'gnehm [at] URL' <br>
Eva Bühlmann: 'bühlmann [at] URL' <br>
Simon Clematide: 'simon.clematide [at] URL' <br>

The  Swiss Job Market Monitor aims at systematically expanding scientific knowledge about the job market and improving labour market transparency by informing the general public about current developments on the job market.

Get in touch: Mail  Website Zenodo SWISSUbase
TAGS
#transformers #pytorch #bert #fill-mask #de #license-cc-by-nc-sa-4.0 #autotrain_compatible #endpoints_compatible #region-us 
 ## jobBERT-de

This is a domain-adapted transformer-based language model for German-speaking job advertisements.

Is is based on bert-base-german-cased and adapted to the domain of job advertisements trough continued in-domain pretraining on 4 million German-speaking job ads from Switzerland 1990-2020 (5.9 GB data). Empty spots in the vocabulary of the base model were filled with most frequent domain-specific words, subtokens and abbreviations. ### Overview

Architecture: BERT base <br>
Language: German <br>
Domain: Job advertisements <br>
See also: agne/jobGBERT ### License

Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (cc-by-nc-sa-4.0)

Please use the following citation when using our model: ### Intended usage and limitations

You can use the model for masked language modeling, but it's intended to be fine-tuned on a downstream task.

The model is trained on German-Speaking job ads from Switzerland. It inherits potential bias of its base model, and may contain biases and stereotypes common in job advertisements. ### About us

Ann-Sophie Gnehm: 'gnehm [at] URL' <br>
Eva Bühlmann: 'bühlmann [at] URL' <br>
Simon Clematide: 'simon.clematide [at] URL' <br>

The  Swiss Job Market Monitor aims at systematically expanding scientific knowledge about the job market and improving labour market transparency by informing the general public about current developments on the job market.

Get in touch: Mail  Website Zenodo SWISSUbase
passage: TAGS
#transformers #pytorch #bert #fill-mask #de #license-cc-by-nc-sa-4.0 #autotrain_compatible #endpoints_compatible #region-us 
## jobBERT-de

This is a domain-adapted transformer-based language model for German-speaking job advertisements.

Is is based on bert-base-german-cased and adapted to the domain of job advertisements trough continued in-domain pretraining on 4 million German-speaking job ads from Switzerland 1990-2020 (5.9 GB data). Empty spots in the vocabulary of the base model were filled with most frequent domain-specific words, subtokens and abbreviations.### Overview

Architecture: BERT base <br>
Language: German <br>
Domain: Job advertisements <br>
See also: agne/jobGBERT### License

Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (cc-by-nc-sa-4.0)

Please use the following citation when using our model:### Intended usage and limitations

You can use the model for masked language modeling, but it's intended to be fine-tuned on a downstream task.

The model is trained on German-Speaking job ads from Switzerland. It inherits potential bias of its base model, and may contain biases and stereotypes common in job advertisements.### About us

Ann-Sophie Gnehm: 'gnehm [at] URL' <br>
Eva Bühlmann: 'bühlmann [at] URL' <br>
Simon Clematide: 'simon.clematide [at] URL' <br>

The  Swiss Job Market Monitor aims at systematically expanding scientific knowledge about the job market and improving labour market transparency by informing the general public about current developments on the job market.

Get in touch: Mail  Website Zenodo SWISSUbase