pytorch bert fill-mask en dataset:wikipedia dataset:bookscorpus dataset:pubmed dataset:radreports transformers biobert radbert language-model uncased radiology biomedical license:mit autotrain_compatible
---
widget:
- text: "low lung volumes, [MASK] pulmonary vascularity."
tags:
- fill-mask
- pytorch
- transformers
- bert
- biobert 
- radbert 
- language-model
- uncased
- radiology
- biomedical
datasets:
- wikipedia
- bookscorpus
- pubmed
- radreports
language:
  - en
license: mit
---

RadBERT was continuously pre-trained on radiology reports from a BioBERT initialization. Manuscript in proceedings.