added usage code
Browse files
README.md
CHANGED
@@ -13,6 +13,17 @@ tags:
|
|
13 |
Indus-NER-DEAL (nasa-smd-ibm-v0.1_NER_DEAL) is a RoBERTa-based, Encoder-only transformer model, domain-adapted for NASA Science Mission Directorate (SMD) applications. It's fine-tuned on scientific journals and articles relevant to NASA SMD, aiming to enhance natural language technologies like information retrieval and intelligent search.
|
14 |
This specific fork was finetuned on SciX Digital Library (https://scixplorer.org/, formerly NASA-ADS) proprietary data to label text with DEAL labels (https://ui.adsabs.harvard.edu/WIESP/2022/LabelDefinitions)
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
## Model Details
|
17 |
- **Base Model**: RoBERTa
|
18 |
- **Tokenizer**: Custom
|
|
|
13 |
Indus-NER-DEAL (nasa-smd-ibm-v0.1_NER_DEAL) is a RoBERTa-based, Encoder-only transformer model, domain-adapted for NASA Science Mission Directorate (SMD) applications. It's fine-tuned on scientific journals and articles relevant to NASA SMD, aiming to enhance natural language technologies like information retrieval and intelligent search.
|
14 |
This specific fork was finetuned on SciX Digital Library (https://scixplorer.org/, formerly NASA-ADS) proprietary data to label text with DEAL labels (https://ui.adsabs.harvard.edu/WIESP/2022/LabelDefinitions)
|
15 |
|
16 |
+
## Usage
|
17 |
+
```python
|
18 |
+
from transformers import AutoModelForTokenClassification, AutoTokenizer
|
19 |
+
INDUS_NER_DEAL = AutoModelForTokenClassification.from_pretrained(pretrained_model_name_or_path='nasa-smd-ibm-v0.1_NER_DEAL',
|
20 |
+
revision=None,
|
21 |
+
)
|
22 |
+
|
23 |
+
INDUS__tokenizer = AutoTokenizer.from_pretrained(pretrained_model_name_or_path='nasa-smd-ibm-v0.1_NER_DEAL',
|
24 |
+
do_lower_case=False,
|
25 |
+
)
|
26 |
+
```
|
27 |
## Model Details
|
28 |
- **Base Model**: RoBERTa
|
29 |
- **Tokenizer**: Custom
|