
## Dataset
[NEWS2018 DATASET_04, Task ID: M-EnHi](http://workshop.colips.org/news2018/dataset.html)

## Notebooks
- `xmltodict.ipynb` contains the code to convert the `xml` files to `json` for training
- `training_script.ipynb` contains the code for training and inference. It is a modified version of https://github.com/AI4Bharat/IndianNLP-Transliteration/blob/master/NoteBooks/Xlit_TrainingSetup_condensed.ipynb


## Predictions
`pred_test.json` contains top-10 predictions on the validation set of the dataset

## Evaluation Scores on validation set

TOP 10 SCORES FOR 1000 SAMPLES

|Metrics   |    Score   |
|-----------|-----------|
|ACC      |    0.703000|
|Mean F-score| 0.949289|
|MRR         | 0.486549|
|MAP_ref     | 0.381000|


TOP 5 SCORES FOR 1000 SAMPLES:

|Metrics   |    Score   |
|-----------|-----------|
|ACC          |0.621000|
|Mean F-score |0.937985|
|MRR          |0.475033|
|MAP_ref      |0.381000|

TOP 3 SCORES FOR 1000 SAMPLES:

|Metrics   |    Score   |
|-----------|-----------|
|ACC          |0.560000|
|Mean F-score |0.927025|
|MRR          |0.461333|
|MAP_ref      |0.381000|

TOP 2 SCORES FOR 1000 SAMPLES:

|Metrics   |    Score   |
|-----------|-----------|
|ACC      |    0.502000|
|Mean F-score | 0.913697|
|MRR         | 0.442000|
|MAP_ref     | 0.381000|

TOP 1 SCORES FOR 1000 SAMPLES:

|Metrics   |    Score   |
|-----------|-----------|
|ACC         | 0.382000|
|Mean F-score | 0.881272|
|MRR          | 0.382000|
|MAP_ref      | 0.380500|
{"license": "apache-2.0"}
license:apache-2.0 has_space region:us
TAGS
#license-apache-2.0 #has_space #region-us 

Dataset
-------


NEWS2018 DATASET\_04, Task ID: M-EnHi


Notebooks
---------


* 'URL' contains the code to convert the 'xml' files to 'json' for training
* 'training\_script.ipynb' contains the code for training and inference. It is a modified version of URL


Predictions
-----------


'pred\_test.json' contains top-10 predictions on the validation set of the dataset


Evaluation Scores on validation set
-----------------------------------


TOP 10 SCORES FOR 1000 SAMPLES



TOP 5 SCORES FOR 1000 SAMPLES:



TOP 3 SCORES FOR 1000 SAMPLES:



TOP 2 SCORES FOR 1000 SAMPLES:



TOP 1 SCORES FOR 1000 SAMPLES:




TAGS
#license-apache-2.0 #has_space #region-us 

passage: TAGS
#license-apache-2.0 #has_space #region-us 
