
### ine-eng

* source group: Indo-European languages 
* target group: English 
*  OPUS readme: [ine-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/ine-eng/README.md)

*  model: transformer
* source language(s): afr aln ang_Latn arg asm ast awa bel bel_Latn ben bho bos_Latn bre bul bul_Latn cat ces cor cos csb_Latn cym dan deu dsb egl ell enm_Latn ext fao fra frm_Latn frr fry gcf_Latn gla gle glg glv gom gos got_Goth grc_Grek gsw guj hat hif_Latn hin hrv hsb hye ind isl ita jdt_Cyrl ksh kur_Arab kur_Latn lad lad_Latn lat_Latn lav lij lit lld_Latn lmo ltg ltz mai mar max_Latn mfe min mkd mwl nds nld nno nob nob_Hebr non_Latn npi oci ori orv_Cyrl oss pan_Guru pap pdc pes pes_Latn pes_Thaa pms pnb pol por prg_Latn pus roh rom ron rue rus san_Deva scn sco sgs sin slv snd_Arab spa sqi srp_Cyrl srp_Latn stq swe swg tgk_Cyrl tly_Latn tmw_Latn ukr urd vec wln yid zlm_Latn zsm_Latn zza
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/ine-eng/opus2m-2020-08-01.zip)
* test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/ine-eng/opus2m-2020-08-01.test.txt)
* test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/ine-eng/opus2m-2020-08-01.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2014-hineng.hin.eng 	| 11.2 	| 0.375 |
| newsdev2016-enro-roneng.ron.eng 	| 35.5 	| 0.614 |
| newsdev2017-enlv-laveng.lav.eng 	| 25.1 	| 0.542 |
| newsdev2019-engu-gujeng.guj.eng 	| 16.0 	| 0.420 |
| newsdev2019-enlt-liteng.lit.eng 	| 24.0 	| 0.522 |
| newsdiscussdev2015-enfr-fraeng.fra.eng 	| 30.1 	| 0.550 |
| newsdiscusstest2015-enfr-fraeng.fra.eng 	| 33.4 	| 0.572 |
| newssyscomb2009-ceseng.ces.eng 	| 24.0 	| 0.520 |
| newssyscomb2009-deueng.deu.eng 	| 25.7 	| 0.526 |
| newssyscomb2009-fraeng.fra.eng 	| 27.9 	| 0.550 |
| newssyscomb2009-itaeng.ita.eng 	| 31.4 	| 0.574 |
| newssyscomb2009-spaeng.spa.eng 	| 28.3 	| 0.555 |
| news-test2008-deueng.deu.eng 	| 24.0 	| 0.515 |
| news-test2008-fraeng.fra.eng 	| 24.5 	| 0.524 |
| news-test2008-spaeng.spa.eng 	| 25.5 	| 0.533 |
| newstest2009-ceseng.ces.eng 	| 23.3 	| 0.516 |
| newstest2009-deueng.deu.eng 	| 23.2 	| 0.512 |
| newstest2009-fraeng.fra.eng 	| 27.3 	| 0.545 |
| newstest2009-itaeng.ita.eng 	| 30.3 	| 0.567 |
| newstest2009-spaeng.spa.eng 	| 27.9 	| 0.549 |
| newstest2010-ceseng.ces.eng 	| 23.8 	| 0.523 |
| newstest2010-deueng.deu.eng 	| 26.2 	| 0.545 |
| newstest2010-fraeng.fra.eng 	| 28.6 	| 0.562 |
| newstest2010-spaeng.spa.eng 	| 31.4 	| 0.581 |
| newstest2011-ceseng.ces.eng 	| 24.2 	| 0.521 |
| newstest2011-deueng.deu.eng 	| 23.9 	| 0.522 |
| newstest2011-fraeng.fra.eng 	| 29.5 	| 0.570 |
| newstest2011-spaeng.spa.eng 	| 30.3 	| 0.570 |
| newstest2012-ceseng.ces.eng 	| 23.5 	| 0.516 |
| newstest2012-deueng.deu.eng 	| 24.9 	| 0.529 |
| newstest2012-fraeng.fra.eng 	| 30.0 	| 0.568 |
| newstest2012-ruseng.rus.eng 	| 29.9 	| 0.565 |
| newstest2012-spaeng.spa.eng 	| 33.3 	| 0.593 |
| newstest2013-ceseng.ces.eng 	| 25.6 	| 0.531 |
| newstest2013-deueng.deu.eng 	| 27.7 	| 0.545 |
| newstest2013-fraeng.fra.eng 	| 30.0 	| 0.561 |
| newstest2013-ruseng.rus.eng 	| 24.4 	| 0.514 |
| newstest2013-spaeng.spa.eng 	| 30.8 	| 0.577 |
| newstest2014-csen-ceseng.ces.eng 	| 27.7 	| 0.558 |
| newstest2014-deen-deueng.deu.eng 	| 27.7 	| 0.545 |
| newstest2014-fren-fraeng.fra.eng 	| 32.2 	| 0.592 |
| newstest2014-hien-hineng.hin.eng 	| 16.7 	| 0.450 |
| newstest2014-ruen-ruseng.rus.eng 	| 27.2 	| 0.552 |
| newstest2015-encs-ceseng.ces.eng 	| 25.4 	| 0.518 |
| newstest2015-ende-deueng.deu.eng 	| 28.8 	| 0.552 |
| newstest2015-enru-ruseng.rus.eng 	| 25.6 	| 0.527 |
| newstest2016-encs-ceseng.ces.eng 	| 27.0 	| 0.540 |
| newstest2016-ende-deueng.deu.eng 	| 33.5 	| 0.592 |
| newstest2016-enro-roneng.ron.eng 	| 32.8 	| 0.591 |
| newstest2016-enru-ruseng.rus.eng 	| 24.8 	| 0.523 |
| newstest2017-encs-ceseng.ces.eng 	| 23.7 	| 0.510 |
| newstest2017-ende-deueng.deu.eng 	| 29.3 	| 0.556 |
| newstest2017-enlv-laveng.lav.eng 	| 18.9 	| 0.486 |
| newstest2017-enru-ruseng.rus.eng 	| 28.0 	| 0.546 |
| newstest2018-encs-ceseng.ces.eng 	| 24.9 	| 0.521 |
| newstest2018-ende-deueng.deu.eng 	| 36.0 	| 0.604 |
| newstest2018-enru-ruseng.rus.eng 	| 23.8 	| 0.517 |
| newstest2019-deen-deueng.deu.eng 	| 31.5 	| 0.570 |
| newstest2019-guen-gujeng.guj.eng 	| 12.1 	| 0.377 |
| newstest2019-lten-liteng.lit.eng 	| 26.6 	| 0.555 |
| newstest2019-ruen-ruseng.rus.eng 	| 27.5 	| 0.541 |
| Tatoeba-test.afr-eng.afr.eng 	| 59.0 	| 0.724 |
| Tatoeba-test.ang-eng.ang.eng 	| 9.9 	| 0.254 |
| Tatoeba-test.arg-eng.arg.eng 	| 41.6 	| 0.487 |
| Tatoeba-test.asm-eng.asm.eng 	| 22.8 	| 0.392 |
| Tatoeba-test.ast-eng.ast.eng 	| 36.1 	| 0.521 |
| Tatoeba-test.awa-eng.awa.eng 	| 11.6 	| 0.280 |
| Tatoeba-test.bel-eng.bel.eng 	| 42.2 	| 0.597 |
| Tatoeba-test.ben-eng.ben.eng 	| 45.8 	| 0.598 |
| Tatoeba-test.bho-eng.bho.eng 	| 34.4 	| 0.518 |
| Tatoeba-test.bre-eng.bre.eng 	| 24.4 	| 0.405 |
| Tatoeba-test.bul-eng.bul.eng 	| 50.8 	| 0.660 |
| Tatoeba-test.cat-eng.cat.eng 	| 51.2 	| 0.677 |
| Tatoeba-test.ces-eng.ces.eng 	| 47.6 	| 0.641 |
| Tatoeba-test.cor-eng.cor.eng 	| 5.4 	| 0.214 |
| Tatoeba-test.cos-eng.cos.eng 	| 61.0 	| 0.675 |
| Tatoeba-test.csb-eng.csb.eng 	| 22.5 	| 0.394 |
| Tatoeba-test.cym-eng.cym.eng 	| 34.7 	| 0.522 |
| Tatoeba-test.dan-eng.dan.eng 	| 56.2 	| 0.708 |
| Tatoeba-test.deu-eng.deu.eng 	| 44.9 	| 0.625 |
| Tatoeba-test.dsb-eng.dsb.eng 	| 21.0 	| 0.383 |
| Tatoeba-test.egl-eng.egl.eng 	| 6.9 	| 0.221 |
| Tatoeba-test.ell-eng.ell.eng 	| 62.1 	| 0.741 |
| Tatoeba-test.enm-eng.enm.eng 	| 22.6 	| 0.466 |
| Tatoeba-test.ext-eng.ext.eng 	| 33.2 	| 0.496 |
| Tatoeba-test.fao-eng.fao.eng 	| 28.1 	| 0.460 |
| Tatoeba-test.fas-eng.fas.eng 	| 9.6 	| 0.306 |
| Tatoeba-test.fra-eng.fra.eng 	| 50.3 	| 0.661 |
| Tatoeba-test.frm-eng.frm.eng 	| 30.0 	| 0.457 |
| Tatoeba-test.frr-eng.frr.eng 	| 15.2 	| 0.301 |
| Tatoeba-test.fry-eng.fry.eng 	| 34.4 	| 0.525 |
| Tatoeba-test.gcf-eng.gcf.eng 	| 18.4 	| 0.317 |
| Tatoeba-test.gla-eng.gla.eng 	| 24.1 	| 0.400 |
| Tatoeba-test.gle-eng.gle.eng 	| 52.2 	| 0.671 |
| Tatoeba-test.glg-eng.glg.eng 	| 50.5 	| 0.669 |
| Tatoeba-test.glv-eng.glv.eng 	| 5.7 	| 0.189 |
| Tatoeba-test.gos-eng.gos.eng 	| 19.2 	| 0.378 |
| Tatoeba-test.got-eng.got.eng 	| 0.1 	| 0.022 |
| Tatoeba-test.grc-eng.grc.eng 	| 0.9 	| 0.095 |
| Tatoeba-test.gsw-eng.gsw.eng 	| 23.9 	| 0.390 |
| Tatoeba-test.guj-eng.guj.eng 	| 28.0 	| 0.428 |
| Tatoeba-test.hat-eng.hat.eng 	| 44.2 	| 0.567 |
| Tatoeba-test.hbs-eng.hbs.eng 	| 51.6 	| 0.666 |
| Tatoeba-test.hif-eng.hif.eng 	| 22.3 	| 0.451 |
| Tatoeba-test.hin-eng.hin.eng 	| 41.7 	| 0.585 |
| Tatoeba-test.hsb-eng.hsb.eng 	| 46.4 	| 0.590 |
| Tatoeba-test.hye-eng.hye.eng 	| 40.4 	| 0.564 |
| Tatoeba-test.isl-eng.isl.eng 	| 43.8 	| 0.605 |
| Tatoeba-test.ita-eng.ita.eng 	| 60.7 	| 0.735 |
| Tatoeba-test.jdt-eng.jdt.eng 	| 5.5 	| 0.091 |
| Tatoeba-test.kok-eng.kok.eng 	| 7.8 	| 0.205 |
| Tatoeba-test.ksh-eng.ksh.eng 	| 15.8 	| 0.284 |
| Tatoeba-test.kur-eng.kur.eng 	| 11.6 	| 0.232 |
| Tatoeba-test.lad-eng.lad.eng 	| 30.7 	| 0.484 |
| Tatoeba-test.lah-eng.lah.eng 	| 11.0 	| 0.286 |
| Tatoeba-test.lat-eng.lat.eng 	| 24.4 	| 0.432 |
| Tatoeba-test.lav-eng.lav.eng 	| 47.2 	| 0.646 |
| Tatoeba-test.lij-eng.lij.eng 	| 9.0 	| 0.287 |
| Tatoeba-test.lit-eng.lit.eng 	| 51.7 	| 0.670 |
| Tatoeba-test.lld-eng.lld.eng 	| 22.4 	| 0.369 |
| Tatoeba-test.lmo-eng.lmo.eng 	| 26.1 	| 0.381 |
| Tatoeba-test.ltz-eng.ltz.eng 	| 39.8 	| 0.536 |
| Tatoeba-test.mai-eng.mai.eng 	| 72.3 	| 0.758 |
| Tatoeba-test.mar-eng.mar.eng 	| 32.0 	| 0.554 |
| Tatoeba-test.mfe-eng.mfe.eng 	| 63.1 	| 0.822 |
| Tatoeba-test.mkd-eng.mkd.eng 	| 49.5 	| 0.638 |
| Tatoeba-test.msa-eng.msa.eng 	| 38.6 	| 0.566 |
| Tatoeba-test.multi.eng 	| 45.6 	| 0.615 |
| Tatoeba-test.mwl-eng.mwl.eng 	| 40.4 	| 0.767 |
| Tatoeba-test.nds-eng.nds.eng 	| 35.5 	| 0.538 |
| Tatoeba-test.nep-eng.nep.eng 	| 4.9 	| 0.209 |
| Tatoeba-test.nld-eng.nld.eng 	| 54.2 	| 0.694 |
| Tatoeba-test.non-eng.non.eng 	| 39.3 	| 0.573 |
| Tatoeba-test.nor-eng.nor.eng 	| 50.9 	| 0.663 |
| Tatoeba-test.oci-eng.oci.eng 	| 19.6 	| 0.386 |
| Tatoeba-test.ori-eng.ori.eng 	| 16.2 	| 0.364 |
| Tatoeba-test.orv-eng.orv.eng 	| 13.6 	| 0.288 |
| Tatoeba-test.oss-eng.oss.eng 	| 9.4 	| 0.301 |
| Tatoeba-test.pan-eng.pan.eng 	| 17.1 	| 0.389 |
| Tatoeba-test.pap-eng.pap.eng 	| 57.0 	| 0.680 |
| Tatoeba-test.pdc-eng.pdc.eng 	| 41.6 	| 0.526 |
| Tatoeba-test.pms-eng.pms.eng 	| 13.7 	| 0.333 |
| Tatoeba-test.pol-eng.pol.eng 	| 46.5 	| 0.632 |
| Tatoeba-test.por-eng.por.eng 	| 56.4 	| 0.710 |
| Tatoeba-test.prg-eng.prg.eng 	| 2.3 	| 0.193 |
| Tatoeba-test.pus-eng.pus.eng 	| 3.2 	| 0.194 |
| Tatoeba-test.roh-eng.roh.eng 	| 17.5 	| 0.420 |
| Tatoeba-test.rom-eng.rom.eng 	| 5.0 	| 0.237 |
| Tatoeba-test.ron-eng.ron.eng 	| 51.4 	| 0.670 |
| Tatoeba-test.rue-eng.rue.eng 	| 26.0 	| 0.447 |
| Tatoeba-test.rus-eng.rus.eng 	| 47.8 	| 0.634 |
| Tatoeba-test.san-eng.san.eng 	| 4.0 	| 0.195 |
| Tatoeba-test.scn-eng.scn.eng 	| 45.1 	| 0.440 |
| Tatoeba-test.sco-eng.sco.eng 	| 41.9 	| 0.582 |
| Tatoeba-test.sgs-eng.sgs.eng 	| 38.7 	| 0.498 |
| Tatoeba-test.sin-eng.sin.eng 	| 29.7 	| 0.499 |
| Tatoeba-test.slv-eng.slv.eng 	| 38.2 	| 0.564 |
| Tatoeba-test.snd-eng.snd.eng 	| 12.7 	| 0.342 |
| Tatoeba-test.spa-eng.spa.eng 	| 53.2 	| 0.687 |
| Tatoeba-test.sqi-eng.sqi.eng 	| 51.9 	| 0.679 |
| Tatoeba-test.stq-eng.stq.eng 	| 9.0 	| 0.391 |
| Tatoeba-test.swe-eng.swe.eng 	| 57.4 	| 0.705 |
| Tatoeba-test.swg-eng.swg.eng 	| 18.0 	| 0.338 |
| Tatoeba-test.tgk-eng.tgk.eng 	| 24.3 	| 0.413 |
| Tatoeba-test.tly-eng.tly.eng 	| 1.1 	| 0.094 |
| Tatoeba-test.ukr-eng.ukr.eng 	| 48.0 	| 0.639 |
| Tatoeba-test.urd-eng.urd.eng 	| 27.2 	| 0.471 |
| Tatoeba-test.vec-eng.vec.eng 	| 28.0 	| 0.398 |
| Tatoeba-test.wln-eng.wln.eng 	| 17.5 	| 0.320 |
| Tatoeba-test.yid-eng.yid.eng 	| 26.9 	| 0.457 |
| Tatoeba-test.zza-eng.zza.eng 	| 1.7 	| 0.131 |


### System Info: 
- hf_name: ine-eng

- source_languages: ine

- target_languages: eng

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/ine-eng/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['ca', 'es', 'os', 'ro', 'fy', 'cy', 'sc', 'is', 'yi', 'lb', 'an', 'sq', 'fr', 'ht', 'rm', 'ps', 'af', 'uk', 'sl', 'lt', 'bg', 'be', 'gd', 'si', 'en', 'br', 'mk', 'or', 'mr', 'ru', 'fo', 'co', 'oc', 'pl', 'gl', 'nb', 'bn', 'id', 'hy', 'da', 'gv', 'nl', 'pt', 'hi', 'as', 'kw', 'ga', 'sv', 'gu', 'wa', 'lv', 'el', 'it', 'hr', 'ur', 'nn', 'de', 'cs', 'ine']

- src_constituents: {'cat', 'spa', 'pap', 'mwl', 'lij', 'bos_Latn', 'lad_Latn', 'lat_Latn', 'pcd', 'oss', 'ron', 'fry', 'cym', 'awa', 'swg', 'zsm_Latn', 'srd', 'gcf_Latn', 'isl', 'yid', 'bho', 'ltz', 'kur_Latn', 'arg', 'pes_Thaa', 'sqi', 'csb_Latn', 'fra', 'hat', 'non_Latn', 'sco', 'pnb', 'roh', 'bul_Latn', 'pus', 'afr', 'ukr', 'slv', 'lit', 'tmw_Latn', 'hsb', 'tly_Latn', 'bul', 'bel', 'got_Goth', 'lat_Grek', 'ext', 'gla', 'mai', 'sin', 'hif_Latn', 'eng', 'bre', 'nob_Hebr', 'prg_Latn', 'ang_Latn', 'aln', 'mkd', 'ori', 'mar', 'afr_Arab', 'san_Deva', 'gos', 'rus', 'fao', 'orv_Cyrl', 'bel_Latn', 'cos', 'zza', 'grc_Grek', 'oci', 'mfe', 'gom', 'bjn', 'sgs', 'tgk_Cyrl', 'hye_Latn', 'pdc', 'srp_Cyrl', 'pol', 'ast', 'glg', 'pms', 'nob', 'ben', 'min', 'srp_Latn', 'zlm_Latn', 'ind', 'rom', 'hye', 'scn', 'enm_Latn', 'lmo', 'npi', 'pes', 'dan', 'rus_Latn', 'jdt_Cyrl', 'gsw', 'glv', 'nld', 'snd_Arab', 'kur_Arab', 'por', 'hin', 'dsb', 'asm', 'lad', 'frm_Latn', 'ksh', 'pan_Guru', 'cor', 'gle', 'swe', 'guj', 'wln', 'lav', 'ell', 'frr', 'rue', 'ita', 'hrv', 'urd', 'stq', 'nno', 'deu', 'lld_Latn', 'ces', 'egl', 'vec', 'max_Latn', 'pes_Latn', 'ltg', 'nds'}

- tgt_constituents: {'eng'}

- src_multilingual: True

- tgt_multilingual: False

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/ine-eng/opus2m-2020-08-01.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/ine-eng/opus2m-2020-08-01.test.txt

- src_alpha3: ine

- tgt_alpha3: eng

- short_pair: ine-en

- chrF2_score: 0.615

- bleu: 45.6

- brevity_penalty: 0.997

- ref_len: 71872.0

- src_name: Indo-European languages

- tgt_name: English

- train_date: 2020-08-01

- src_alpha2: ine

- tgt_alpha2: en

- prefer_old: False

- long_pair: ine-eng

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41
{"language": ["ca", "es", "os", "ro", "fy", "cy", "sc", "is", "yi", "lb", "an", "sq", "fr", "ht", "rm", "ps", "af", "uk", "sl", "lt", "bg", "be", "gd", "si", "en", "br", "mk", "or", "mr", "ru", "fo", "co", "oc", "pl", "gl", "nb", "bn", "id", "hy", "da", "gv", "nl", "pt", "hi", "as", "kw", "ga", "sv", "gu", "wa", "lv", "el", "it", "hr", "ur", "nn", "de", "cs", "ine"], "license": "apache-2.0", "tags": ["translation"]}
transformers pytorch tf marian text2text-generation translation ca es os ro fy cy sc is yi lb an sq fr ht rm ps af uk sl lt bg be gd si en br mk or mr ru fo co oc pl gl nb bn id hy da gv nl pt hi as kw ga sv gu wa lv el it hr ur nn de cs ine license:apache-2.0 autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #pytorch #tf #marian #text2text-generation #translation #ca #es #os #ro #fy #cy #sc #is #yi #lb #an #sq #fr #ht #rm #ps #af #uk #sl #lt #bg #be #gd #si #en #br #mk #or #mr #ru #fo #co #oc #pl #gl #nb #bn #id #hy #da #gv #nl #pt #hi #as #kw #ga #sv #gu #wa #lv #el #it #hr #ur #nn #de #cs #ine #license-apache-2.0 #autotrain_compatible #endpoints_compatible #has_space #region-us 

### ine-eng


* source group: Indo-European languages
* target group: English
* OPUS readme: ine-eng
* model: transformer
* source language(s): afr aln ang\_Latn arg asm ast awa bel bel\_Latn ben bho bos\_Latn bre bul bul\_Latn cat ces cor cos csb\_Latn cym dan deu dsb egl ell enm\_Latn ext fao fra frm\_Latn frr fry gcf\_Latn gla gle glg glv gom gos got\_Goth grc\_Grek gsw guj hat hif\_Latn hin hrv hsb hye ind isl ita jdt\_Cyrl ksh kur\_Arab kur\_Latn lad lad\_Latn lat\_Latn lav lij lit lld\_Latn lmo ltg ltz mai mar max\_Latn mfe min mkd mwl nds nld nno nob nob\_Hebr non\_Latn npi oci ori orv\_Cyrl oss pan\_Guru pap pdc pes pes\_Latn pes\_Thaa pms pnb pol por prg\_Latn pus roh rom ron rue rus san\_Deva scn sco sgs sin slv snd\_Arab spa sqi srp\_Cyrl srp\_Latn stq swe swg tgk\_Cyrl tly\_Latn tmw\_Latn ukr urd vec wln yid zlm\_Latn zsm\_Latn zza
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: URL
* test set translations: URL
* test set scores: URL


Benchmarks
----------


testset: URL, BLEU: 11.2, chr-F: 0.375
testset: URL, BLEU: 35.5, chr-F: 0.614
testset: URL, BLEU: 25.1, chr-F: 0.542
testset: URL, BLEU: 16.0, chr-F: 0.420
testset: URL, BLEU: 24.0, chr-F: 0.522
testset: URL, BLEU: 30.1, chr-F: 0.550
testset: URL, BLEU: 33.4, chr-F: 0.572
testset: URL, BLEU: 24.0, chr-F: 0.520
testset: URL, BLEU: 25.7, chr-F: 0.526
testset: URL, BLEU: 27.9, chr-F: 0.550
testset: URL, BLEU: 31.4, chr-F: 0.574
testset: URL, BLEU: 28.3, chr-F: 0.555
testset: URL, BLEU: 24.0, chr-F: 0.515
testset: URL, BLEU: 24.5, chr-F: 0.524
testset: URL, BLEU: 25.5, chr-F: 0.533
testset: URL, BLEU: 23.3, chr-F: 0.516
testset: URL, BLEU: 23.2, chr-F: 0.512
testset: URL, BLEU: 27.3, chr-F: 0.545
testset: URL, BLEU: 30.3, chr-F: 0.567
testset: URL, BLEU: 27.9, chr-F: 0.549
testset: URL, BLEU: 23.8, chr-F: 0.523
testset: URL, BLEU: 26.2, chr-F: 0.545
testset: URL, BLEU: 28.6, chr-F: 0.562
testset: URL, BLEU: 31.4, chr-F: 0.581
testset: URL, BLEU: 24.2, chr-F: 0.521
testset: URL, BLEU: 23.9, chr-F: 0.522
testset: URL, BLEU: 29.5, chr-F: 0.570
testset: URL, BLEU: 30.3, chr-F: 0.570
testset: URL, BLEU: 23.5, chr-F: 0.516
testset: URL, BLEU: 24.9, chr-F: 0.529
testset: URL, BLEU: 30.0, chr-F: 0.568
testset: URL, BLEU: 29.9, chr-F: 0.565
testset: URL, BLEU: 33.3, chr-F: 0.593
testset: URL, BLEU: 25.6, chr-F: 0.531
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 30.0, chr-F: 0.561
testset: URL, BLEU: 24.4, chr-F: 0.514
testset: URL, BLEU: 30.8, chr-F: 0.577
testset: URL, BLEU: 27.7, chr-F: 0.558
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 32.2, chr-F: 0.592
testset: URL, BLEU: 16.7, chr-F: 0.450
testset: URL, BLEU: 27.2, chr-F: 0.552
testset: URL, BLEU: 25.4, chr-F: 0.518
testset: URL, BLEU: 28.8, chr-F: 0.552
testset: URL, BLEU: 25.6, chr-F: 0.527
testset: URL, BLEU: 27.0, chr-F: 0.540
testset: URL, BLEU: 33.5, chr-F: 0.592
testset: URL, BLEU: 32.8, chr-F: 0.591
testset: URL, BLEU: 24.8, chr-F: 0.523
testset: URL, BLEU: 23.7, chr-F: 0.510
testset: URL, BLEU: 29.3, chr-F: 0.556
testset: URL, BLEU: 18.9, chr-F: 0.486
testset: URL, BLEU: 28.0, chr-F: 0.546
testset: URL, BLEU: 24.9, chr-F: 0.521
testset: URL, BLEU: 36.0, chr-F: 0.604
testset: URL, BLEU: 23.8, chr-F: 0.517
testset: URL, BLEU: 31.5, chr-F: 0.570
testset: URL, BLEU: 12.1, chr-F: 0.377
testset: URL, BLEU: 26.6, chr-F: 0.555
testset: URL, BLEU: 27.5, chr-F: 0.541
testset: URL, BLEU: 59.0, chr-F: 0.724
testset: URL, BLEU: 9.9, chr-F: 0.254
testset: URL, BLEU: 41.6, chr-F: 0.487
testset: URL, BLEU: 22.8, chr-F: 0.392
testset: URL, BLEU: 36.1, chr-F: 0.521
testset: URL, BLEU: 11.6, chr-F: 0.280
testset: URL, BLEU: 42.2, chr-F: 0.597
testset: URL, BLEU: 45.8, chr-F: 0.598
testset: URL, BLEU: 34.4, chr-F: 0.518
testset: URL, BLEU: 24.4, chr-F: 0.405
testset: URL, BLEU: 50.8, chr-F: 0.660
testset: URL, BLEU: 51.2, chr-F: 0.677
testset: URL, BLEU: 47.6, chr-F: 0.641
testset: URL, BLEU: 5.4, chr-F: 0.214
testset: URL, BLEU: 61.0, chr-F: 0.675
testset: URL, BLEU: 22.5, chr-F: 0.394
testset: URL, BLEU: 34.7, chr-F: 0.522
testset: URL, BLEU: 56.2, chr-F: 0.708
testset: URL, BLEU: 44.9, chr-F: 0.625
testset: URL, BLEU: 21.0, chr-F: 0.383
testset: URL, BLEU: 6.9, chr-F: 0.221
testset: URL, BLEU: 62.1, chr-F: 0.741
testset: URL, BLEU: 22.6, chr-F: 0.466
testset: URL, BLEU: 33.2, chr-F: 0.496
testset: URL, BLEU: 28.1, chr-F: 0.460
testset: URL, BLEU: 9.6, chr-F: 0.306
testset: URL, BLEU: 50.3, chr-F: 0.661
testset: URL, BLEU: 30.0, chr-F: 0.457
testset: URL, BLEU: 15.2, chr-F: 0.301
testset: URL, BLEU: 34.4, chr-F: 0.525
testset: URL, BLEU: 18.4, chr-F: 0.317
testset: URL, BLEU: 24.1, chr-F: 0.400
testset: URL, BLEU: 52.2, chr-F: 0.671
testset: URL, BLEU: 50.5, chr-F: 0.669
testset: URL, BLEU: 5.7, chr-F: 0.189
testset: URL, BLEU: 19.2, chr-F: 0.378
testset: URL, BLEU: 0.1, chr-F: 0.022
testset: URL, BLEU: 0.9, chr-F: 0.095
testset: URL, BLEU: 23.9, chr-F: 0.390
testset: URL, BLEU: 28.0, chr-F: 0.428
testset: URL, BLEU: 44.2, chr-F: 0.567
testset: URL, BLEU: 51.6, chr-F: 0.666
testset: URL, BLEU: 22.3, chr-F: 0.451
testset: URL, BLEU: 41.7, chr-F: 0.585
testset: URL, BLEU: 46.4, chr-F: 0.590
testset: URL, BLEU: 40.4, chr-F: 0.564
testset: URL, BLEU: 43.8, chr-F: 0.605
testset: URL, BLEU: 60.7, chr-F: 0.735
testset: URL, BLEU: 5.5, chr-F: 0.091
testset: URL, BLEU: 7.8, chr-F: 0.205
testset: URL, BLEU: 15.8, chr-F: 0.284
testset: URL, BLEU: 11.6, chr-F: 0.232
testset: URL, BLEU: 30.7, chr-F: 0.484
testset: URL, BLEU: 11.0, chr-F: 0.286
testset: URL, BLEU: 24.4, chr-F: 0.432
testset: URL, BLEU: 47.2, chr-F: 0.646
testset: URL, BLEU: 9.0, chr-F: 0.287
testset: URL, BLEU: 51.7, chr-F: 0.670
testset: URL, BLEU: 22.4, chr-F: 0.369
testset: URL, BLEU: 26.1, chr-F: 0.381
testset: URL, BLEU: 39.8, chr-F: 0.536
testset: URL, BLEU: 72.3, chr-F: 0.758
testset: URL, BLEU: 32.0, chr-F: 0.554
testset: URL, BLEU: 63.1, chr-F: 0.822
testset: URL, BLEU: 49.5, chr-F: 0.638
testset: URL, BLEU: 38.6, chr-F: 0.566
testset: URL, BLEU: 45.6, chr-F: 0.615
testset: URL, BLEU: 40.4, chr-F: 0.767
testset: URL, BLEU: 35.5, chr-F: 0.538
testset: URL, BLEU: 4.9, chr-F: 0.209
testset: URL, BLEU: 54.2, chr-F: 0.694
testset: URL, BLEU: 39.3, chr-F: 0.573
testset: URL, BLEU: 50.9, chr-F: 0.663
testset: URL, BLEU: 19.6, chr-F: 0.386
testset: URL, BLEU: 16.2, chr-F: 0.364
testset: URL, BLEU: 13.6, chr-F: 0.288
testset: URL, BLEU: 9.4, chr-F: 0.301
testset: URL, BLEU: 17.1, chr-F: 0.389
testset: URL, BLEU: 57.0, chr-F: 0.680
testset: URL, BLEU: 41.6, chr-F: 0.526
testset: URL, BLEU: 13.7, chr-F: 0.333
testset: URL, BLEU: 46.5, chr-F: 0.632
testset: URL, BLEU: 56.4, chr-F: 0.710
testset: URL, BLEU: 2.3, chr-F: 0.193
testset: URL, BLEU: 3.2, chr-F: 0.194
testset: URL, BLEU: 17.5, chr-F: 0.420
testset: URL, BLEU: 5.0, chr-F: 0.237
testset: URL, BLEU: 51.4, chr-F: 0.670
testset: URL, BLEU: 26.0, chr-F: 0.447
testset: URL, BLEU: 47.8, chr-F: 0.634
testset: URL, BLEU: 4.0, chr-F: 0.195
testset: URL, BLEU: 45.1, chr-F: 0.440
testset: URL, BLEU: 41.9, chr-F: 0.582
testset: URL, BLEU: 38.7, chr-F: 0.498
testset: URL, BLEU: 29.7, chr-F: 0.499
testset: URL, BLEU: 38.2, chr-F: 0.564
testset: URL, BLEU: 12.7, chr-F: 0.342
testset: URL, BLEU: 53.2, chr-F: 0.687
testset: URL, BLEU: 51.9, chr-F: 0.679
testset: URL, BLEU: 9.0, chr-F: 0.391
testset: URL, BLEU: 57.4, chr-F: 0.705
testset: URL, BLEU: 18.0, chr-F: 0.338
testset: URL, BLEU: 24.3, chr-F: 0.413
testset: URL, BLEU: 1.1, chr-F: 0.094
testset: URL, BLEU: 48.0, chr-F: 0.639
testset: URL, BLEU: 27.2, chr-F: 0.471
testset: URL, BLEU: 28.0, chr-F: 0.398
testset: URL, BLEU: 17.5, chr-F: 0.320
testset: URL, BLEU: 26.9, chr-F: 0.457
testset: URL, BLEU: 1.7, chr-F: 0.131


### System Info:


* hf\_name: ine-eng
* source\_languages: ine
* target\_languages: eng
* opus\_readme\_url: URL
* original\_repo: Tatoeba-Challenge
* tags: ['translation']
* languages: ['ca', 'es', 'os', 'ro', 'fy', 'cy', 'sc', 'is', 'yi', 'lb', 'an', 'sq', 'fr', 'ht', 'rm', 'ps', 'af', 'uk', 'sl', 'lt', 'bg', 'be', 'gd', 'si', 'en', 'br', 'mk', 'or', 'mr', 'ru', 'fo', 'co', 'oc', 'pl', 'gl', 'nb', 'bn', 'id', 'hy', 'da', 'gv', 'nl', 'pt', 'hi', 'as', 'kw', 'ga', 'sv', 'gu', 'wa', 'lv', 'el', 'it', 'hr', 'ur', 'nn', 'de', 'cs', 'ine']
* src\_constituents: {'cat', 'spa', 'pap', 'mwl', 'lij', 'bos\_Latn', 'lad\_Latn', 'lat\_Latn', 'pcd', 'oss', 'ron', 'fry', 'cym', 'awa', 'swg', 'zsm\_Latn', 'srd', 'gcf\_Latn', 'isl', 'yid', 'bho', 'ltz', 'kur\_Latn', 'arg', 'pes\_Thaa', 'sqi', 'csb\_Latn', 'fra', 'hat', 'non\_Latn', 'sco', 'pnb', 'roh', 'bul\_Latn', 'pus', 'afr', 'ukr', 'slv', 'lit', 'tmw\_Latn', 'hsb', 'tly\_Latn', 'bul', 'bel', 'got\_Goth', 'lat\_Grek', 'ext', 'gla', 'mai', 'sin', 'hif\_Latn', 'eng', 'bre', 'nob\_Hebr', 'prg\_Latn', 'ang\_Latn', 'aln', 'mkd', 'ori', 'mar', 'afr\_Arab', 'san\_Deva', 'gos', 'rus', 'fao', 'orv\_Cyrl', 'bel\_Latn', 'cos', 'zza', 'grc\_Grek', 'oci', 'mfe', 'gom', 'bjn', 'sgs', 'tgk\_Cyrl', 'hye\_Latn', 'pdc', 'srp\_Cyrl', 'pol', 'ast', 'glg', 'pms', 'nob', 'ben', 'min', 'srp\_Latn', 'zlm\_Latn', 'ind', 'rom', 'hye', 'scn', 'enm\_Latn', 'lmo', 'npi', 'pes', 'dan', 'rus\_Latn', 'jdt\_Cyrl', 'gsw', 'glv', 'nld', 'snd\_Arab', 'kur\_Arab', 'por', 'hin', 'dsb', 'asm', 'lad', 'frm\_Latn', 'ksh', 'pan\_Guru', 'cor', 'gle', 'swe', 'guj', 'wln', 'lav', 'ell', 'frr', 'rue', 'ita', 'hrv', 'urd', 'stq', 'nno', 'deu', 'lld\_Latn', 'ces', 'egl', 'vec', 'max\_Latn', 'pes\_Latn', 'ltg', 'nds'}
* tgt\_constituents: {'eng'}
* src\_multilingual: True
* tgt\_multilingual: False
* prepro: normalization + SentencePiece (spm32k,spm32k)
* url\_model: URL
* url\_test\_set: URL
* src\_alpha3: ine
* tgt\_alpha3: eng
* short\_pair: ine-en
* chrF2\_score: 0.615
* bleu: 45.6
* brevity\_penalty: 0.997
* ref\_len: 71872.0
* src\_name: Indo-European languages
* tgt\_name: English
* train\_date: 2020-08-01
* src\_alpha2: ine
* tgt\_alpha2: en
* prefer\_old: False
* long\_pair: ine-eng
* helsinki\_git\_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
* transformers\_git\_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
* port\_machine: brutasse
* port\_time: 2020-08-21-14:41



### ine-eng


* source group: Indo-European languages
* target group: English
* OPUS readme: ine-eng
* model: transformer
* source language(s): afr aln ang\_Latn arg asm ast awa bel bel\_Latn ben bho bos\_Latn bre bul bul\_Latn cat ces cor cos csb\_Latn cym dan deu dsb egl ell enm\_Latn ext fao fra frm\_Latn frr fry gcf\_Latn gla gle glg glv gom gos got\_Goth grc\_Grek gsw guj hat hif\_Latn hin hrv hsb hye ind isl ita jdt\_Cyrl ksh kur\_Arab kur\_Latn lad lad\_Latn lat\_Latn lav lij lit lld\_Latn lmo ltg ltz mai mar max\_Latn mfe min mkd mwl nds nld nno nob nob\_Hebr non\_Latn npi oci ori orv\_Cyrl oss pan\_Guru pap pdc pes pes\_Latn pes\_Thaa pms pnb pol por prg\_Latn pus roh rom ron rue rus san\_Deva scn sco sgs sin slv snd\_Arab spa sqi srp\_Cyrl srp\_Latn stq swe swg tgk\_Cyrl tly\_Latn tmw\_Latn ukr urd vec wln yid zlm\_Latn zsm\_Latn zza
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: URL
* test set translations: URL
* test set scores: URL


Benchmarks
----------


testset: URL, BLEU: 11.2, chr-F: 0.375
testset: URL, BLEU: 35.5, chr-F: 0.614
testset: URL, BLEU: 25.1, chr-F: 0.542
testset: URL, BLEU: 16.0, chr-F: 0.420
testset: URL, BLEU: 24.0, chr-F: 0.522
testset: URL, BLEU: 30.1, chr-F: 0.550
testset: URL, BLEU: 33.4, chr-F: 0.572
testset: URL, BLEU: 24.0, chr-F: 0.520
testset: URL, BLEU: 25.7, chr-F: 0.526
testset: URL, BLEU: 27.9, chr-F: 0.550
testset: URL, BLEU: 31.4, chr-F: 0.574
testset: URL, BLEU: 28.3, chr-F: 0.555
testset: URL, BLEU: 24.0, chr-F: 0.515
testset: URL, BLEU: 24.5, chr-F: 0.524
testset: URL, BLEU: 25.5, chr-F: 0.533
testset: URL, BLEU: 23.3, chr-F: 0.516
testset: URL, BLEU: 23.2, chr-F: 0.512
testset: URL, BLEU: 27.3, chr-F: 0.545
testset: URL, BLEU: 30.3, chr-F: 0.567
testset: URL, BLEU: 27.9, chr-F: 0.549
testset: URL, BLEU: 23.8, chr-F: 0.523
testset: URL, BLEU: 26.2, chr-F: 0.545
testset: URL, BLEU: 28.6, chr-F: 0.562
testset: URL, BLEU: 31.4, chr-F: 0.581
testset: URL, BLEU: 24.2, chr-F: 0.521
testset: URL, BLEU: 23.9, chr-F: 0.522
testset: URL, BLEU: 29.5, chr-F: 0.570
testset: URL, BLEU: 30.3, chr-F: 0.570
testset: URL, BLEU: 23.5, chr-F: 0.516
testset: URL, BLEU: 24.9, chr-F: 0.529
testset: URL, BLEU: 30.0, chr-F: 0.568
testset: URL, BLEU: 29.9, chr-F: 0.565
testset: URL, BLEU: 33.3, chr-F: 0.593
testset: URL, BLEU: 25.6, chr-F: 0.531
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 30.0, chr-F: 0.561
testset: URL, BLEU: 24.4, chr-F: 0.514
testset: URL, BLEU: 30.8, chr-F: 0.577
testset: URL, BLEU: 27.7, chr-F: 0.558
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 32.2, chr-F: 0.592
testset: URL, BLEU: 16.7, chr-F: 0.450
testset: URL, BLEU: 27.2, chr-F: 0.552
testset: URL, BLEU: 25.4, chr-F: 0.518
testset: URL, BLEU: 28.8, chr-F: 0.552
testset: URL, BLEU: 25.6, chr-F: 0.527
testset: URL, BLEU: 27.0, chr-F: 0.540
testset: URL, BLEU: 33.5, chr-F: 0.592
testset: URL, BLEU: 32.8, chr-F: 0.591
testset: URL, BLEU: 24.8, chr-F: 0.523
testset: URL, BLEU: 23.7, chr-F: 0.510
testset: URL, BLEU: 29.3, chr-F: 0.556
testset: URL, BLEU: 18.9, chr-F: 0.486
testset: URL, BLEU: 28.0, chr-F: 0.546
testset: URL, BLEU: 24.9, chr-F: 0.521
testset: URL, BLEU: 36.0, chr-F: 0.604
testset: URL, BLEU: 23.8, chr-F: 0.517
testset: URL, BLEU: 31.5, chr-F: 0.570
testset: URL, BLEU: 12.1, chr-F: 0.377
testset: URL, BLEU: 26.6, chr-F: 0.555
testset: URL, BLEU: 27.5, chr-F: 0.541
testset: URL, BLEU: 59.0, chr-F: 0.724
testset: URL, BLEU: 9.9, chr-F: 0.254
testset: URL, BLEU: 41.6, chr-F: 0.487
testset: URL, BLEU: 22.8, chr-F: 0.392
testset: URL, BLEU: 36.1, chr-F: 0.521
testset: URL, BLEU: 11.6, chr-F: 0.280
testset: URL, BLEU: 42.2, chr-F: 0.597
testset: URL, BLEU: 45.8, chr-F: 0.598
testset: URL, BLEU: 34.4, chr-F: 0.518
testset: URL, BLEU: 24.4, chr-F: 0.405
testset: URL, BLEU: 50.8, chr-F: 0.660
testset: URL, BLEU: 51.2, chr-F: 0.677
testset: URL, BLEU: 47.6, chr-F: 0.641
testset: URL, BLEU: 5.4, chr-F: 0.214
testset: URL, BLEU: 61.0, chr-F: 0.675
testset: URL, BLEU: 22.5, chr-F: 0.394
testset: URL, BLEU: 34.7, chr-F: 0.522
testset: URL, BLEU: 56.2, chr-F: 0.708
testset: URL, BLEU: 44.9, chr-F: 0.625
testset: URL, BLEU: 21.0, chr-F: 0.383
testset: URL, BLEU: 6.9, chr-F: 0.221
testset: URL, BLEU: 62.1, chr-F: 0.741
testset: URL, BLEU: 22.6, chr-F: 0.466
testset: URL, BLEU: 33.2, chr-F: 0.496
testset: URL, BLEU: 28.1, chr-F: 0.460
testset: URL, BLEU: 9.6, chr-F: 0.306
testset: URL, BLEU: 50.3, chr-F: 0.661
testset: URL, BLEU: 30.0, chr-F: 0.457
testset: URL, BLEU: 15.2, chr-F: 0.301
testset: URL, BLEU: 34.4, chr-F: 0.525
testset: URL, BLEU: 18.4, chr-F: 0.317
testset: URL, BLEU: 24.1, chr-F: 0.400
testset: URL, BLEU: 52.2, chr-F: 0.671
testset: URL, BLEU: 50.5, chr-F: 0.669
testset: URL, BLEU: 5.7, chr-F: 0.189
testset: URL, BLEU: 19.2, chr-F: 0.378
testset: URL, BLEU: 0.1, chr-F: 0.022
testset: URL, BLEU: 0.9, chr-F: 0.095
testset: URL, BLEU: 23.9, chr-F: 0.390
testset: URL, BLEU: 28.0, chr-F: 0.428
testset: URL, BLEU: 44.2, chr-F: 0.567
testset: URL, BLEU: 51.6, chr-F: 0.666
testset: URL, BLEU: 22.3, chr-F: 0.451
testset: URL, BLEU: 41.7, chr-F: 0.585
testset: URL, BLEU: 46.4, chr-F: 0.590
testset: URL, BLEU: 40.4, chr-F: 0.564
testset: URL, BLEU: 43.8, chr-F: 0.605
testset: URL, BLEU: 60.7, chr-F: 0.735
testset: URL, BLEU: 5.5, chr-F: 0.091
testset: URL, BLEU: 7.8, chr-F: 0.205
testset: URL, BLEU: 15.8, chr-F: 0.284
testset: URL, BLEU: 11.6, chr-F: 0.232
testset: URL, BLEU: 30.7, chr-F: 0.484
testset: URL, BLEU: 11.0, chr-F: 0.286
testset: URL, BLEU: 24.4, chr-F: 0.432
testset: URL, BLEU: 47.2, chr-F: 0.646
testset: URL, BLEU: 9.0, chr-F: 0.287
testset: URL, BLEU: 51.7, chr-F: 0.670
testset: URL, BLEU: 22.4, chr-F: 0.369
testset: URL, BLEU: 26.1, chr-F: 0.381
testset: URL, BLEU: 39.8, chr-F: 0.536
testset: URL, BLEU: 72.3, chr-F: 0.758
testset: URL, BLEU: 32.0, chr-F: 0.554
testset: URL, BLEU: 63.1, chr-F: 0.822
testset: URL, BLEU: 49.5, chr-F: 0.638
testset: URL, BLEU: 38.6, chr-F: 0.566
testset: URL, BLEU: 45.6, chr-F: 0.615
testset: URL, BLEU: 40.4, chr-F: 0.767
testset: URL, BLEU: 35.5, chr-F: 0.538
testset: URL, BLEU: 4.9, chr-F: 0.209
testset: URL, BLEU: 54.2, chr-F: 0.694
testset: URL, BLEU: 39.3, chr-F: 0.573
testset: URL, BLEU: 50.9, chr-F: 0.663
testset: URL, BLEU: 19.6, chr-F: 0.386
testset: URL, BLEU: 16.2, chr-F: 0.364
testset: URL, BLEU: 13.6, chr-F: 0.288
testset: URL, BLEU: 9.4, chr-F: 0.301
testset: URL, BLEU: 17.1, chr-F: 0.389
testset: URL, BLEU: 57.0, chr-F: 0.680
testset: URL, BLEU: 41.6, chr-F: 0.526
testset: URL, BLEU: 13.7, chr-F: 0.333
testset: URL, BLEU: 46.5, chr-F: 0.632
testset: URL, BLEU: 56.4, chr-F: 0.710
testset: URL, BLEU: 2.3, chr-F: 0.193
testset: URL, BLEU: 3.2, chr-F: 0.194
testset: URL, BLEU: 17.5, chr-F: 0.420
testset: URL, BLEU: 5.0, chr-F: 0.237
testset: URL, BLEU: 51.4, chr-F: 0.670
testset: URL, BLEU: 26.0, chr-F: 0.447
testset: URL, BLEU: 47.8, chr-F: 0.634
testset: URL, BLEU: 4.0, chr-F: 0.195
testset: URL, BLEU: 45.1, chr-F: 0.440
testset: URL, BLEU: 41.9, chr-F: 0.582
testset: URL, BLEU: 38.7, chr-F: 0.498
testset: URL, BLEU: 29.7, chr-F: 0.499
testset: URL, BLEU: 38.2, chr-F: 0.564
testset: URL, BLEU: 12.7, chr-F: 0.342
testset: URL, BLEU: 53.2, chr-F: 0.687
testset: URL, BLEU: 51.9, chr-F: 0.679
testset: URL, BLEU: 9.0, chr-F: 0.391
testset: URL, BLEU: 57.4, chr-F: 0.705
testset: URL, BLEU: 18.0, chr-F: 0.338
testset: URL, BLEU: 24.3, chr-F: 0.413
testset: URL, BLEU: 1.1, chr-F: 0.094
testset: URL, BLEU: 48.0, chr-F: 0.639
testset: URL, BLEU: 27.2, chr-F: 0.471
testset: URL, BLEU: 28.0, chr-F: 0.398
testset: URL, BLEU: 17.5, chr-F: 0.320
testset: URL, BLEU: 26.9, chr-F: 0.457
testset: URL, BLEU: 1.7, chr-F: 0.131 ### System Info:


* hf\_name: ine-eng
* source\_languages: ine
* target\_languages: eng
* opus\_readme\_url: URL
* original\_repo: Tatoeba-Challenge
* tags: ['translation']
* languages: ['ca', 'es', 'os', 'ro', 'fy', 'cy', 'sc', 'is', 'yi', 'lb', 'an', 'sq', 'fr', 'ht', 'rm', 'ps', 'af', 'uk', 'sl', 'lt', 'bg', 'be', 'gd', 'si', 'en', 'br', 'mk', 'or', 'mr', 'ru', 'fo', 'co', 'oc', 'pl', 'gl', 'nb', 'bn', 'id', 'hy', 'da', 'gv', 'nl', 'pt', 'hi', 'as', 'kw', 'ga', 'sv', 'gu', 'wa', 'lv', 'el', 'it', 'hr', 'ur', 'nn', 'de', 'cs', 'ine']
* src\_constituents: {'cat', 'spa', 'pap', 'mwl', 'lij', 'bos\_Latn', 'lad\_Latn', 'lat\_Latn', 'pcd', 'oss', 'ron', 'fry', 'cym', 'awa', 'swg', 'zsm\_Latn', 'srd', 'gcf\_Latn', 'isl', 'yid', 'bho', 'ltz', 'kur\_Latn', 'arg', 'pes\_Thaa', 'sqi', 'csb\_Latn', 'fra', 'hat', 'non\_Latn', 'sco', 'pnb', 'roh', 'bul\_Latn', 'pus', 'afr', 'ukr', 'slv', 'lit', 'tmw\_Latn', 'hsb', 'tly\_Latn', 'bul', 'bel', 'got\_Goth', 'lat\_Grek', 'ext', 'gla', 'mai', 'sin', 'hif\_Latn', 'eng', 'bre', 'nob\_Hebr', 'prg\_Latn', 'ang\_Latn', 'aln', 'mkd', 'ori', 'mar', 'afr\_Arab', 'san\_Deva', 'gos', 'rus', 'fao', 'orv\_Cyrl', 'bel\_Latn', 'cos', 'zza', 'grc\_Grek', 'oci', 'mfe', 'gom', 'bjn', 'sgs', 'tgk\_Cyrl', 'hye\_Latn', 'pdc', 'srp\_Cyrl', 'pol', 'ast', 'glg', 'pms', 'nob', 'ben', 'min', 'srp\_Latn', 'zlm\_Latn', 'ind', 'rom', 'hye', 'scn', 'enm\_Latn', 'lmo', 'npi', 'pes', 'dan', 'rus\_Latn', 'jdt\_Cyrl', 'gsw', 'glv', 'nld', 'snd\_Arab', 'kur\_Arab', 'por', 'hin', 'dsb', 'asm', 'lad', 'frm\_Latn', 'ksh', 'pan\_Guru', 'cor', 'gle', 'swe', 'guj', 'wln', 'lav', 'ell', 'frr', 'rue', 'ita', 'hrv', 'urd', 'stq', 'nno', 'deu', 'lld\_Latn', 'ces', 'egl', 'vec', 'max\_Latn', 'pes\_Latn', 'ltg', 'nds'}
* tgt\_constituents: {'eng'}
* src\_multilingual: True
* tgt\_multilingual: False
* prepro: normalization + SentencePiece (spm32k,spm32k)
* url\_model: URL
* url\_test\_set: URL
* src\_alpha3: ine
* tgt\_alpha3: eng
* short\_pair: ine-en
* chrF2\_score: 0.615
* bleu: 45.6
* brevity\_penalty: 0.997
* ref\_len: 71872.0
* src\_name: Indo-European languages
* tgt\_name: English
* train\_date: 2020-08-01
* src\_alpha2: ine
* tgt\_alpha2: en
* prefer\_old: False
* long\_pair: ine-eng
* helsinki\_git\_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
* transformers\_git\_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
* port\_machine: brutasse
* port\_time: 2020-08-21-14:41
TAGS
#transformers #pytorch #tf #marian #text2text-generation #translation #ca #es #os #ro #fy #cy #sc #is #yi #lb #an #sq #fr #ht #rm #ps #af #uk #sl #lt #bg #be #gd #si #en #br #mk #or #mr #ru #fo #co #oc #pl #gl #nb #bn #id #hy #da #gv #nl #pt #hi #as #kw #ga #sv #gu #wa #lv #el #it #hr #ur #nn #de #cs #ine #license-apache-2.0 #autotrain_compatible #endpoints_compatible #has_space #region-us 
 ### ine-eng


* source group: Indo-European languages
* target group: English
* OPUS readme: ine-eng
* model: transformer
* source language(s): afr aln ang\_Latn arg asm ast awa bel bel\_Latn ben bho bos\_Latn bre bul bul\_Latn cat ces cor cos csb\_Latn cym dan deu dsb egl ell enm\_Latn ext fao fra frm\_Latn frr fry gcf\_Latn gla gle glg glv gom gos got\_Goth grc\_Grek gsw guj hat hif\_Latn hin hrv hsb hye ind isl ita jdt\_Cyrl ksh kur\_Arab kur\_Latn lad lad\_Latn lat\_Latn lav lij lit lld\_Latn lmo ltg ltz mai mar max\_Latn mfe min mkd mwl nds nld nno nob nob\_Hebr non\_Latn npi oci ori orv\_Cyrl oss pan\_Guru pap pdc pes pes\_Latn pes\_Thaa pms pnb pol por prg\_Latn pus roh rom ron rue rus san\_Deva scn sco sgs sin slv snd\_Arab spa sqi srp\_Cyrl srp\_Latn stq swe swg tgk\_Cyrl tly\_Latn tmw\_Latn ukr urd vec wln yid zlm\_Latn zsm\_Latn zza
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: URL
* test set translations: URL
* test set scores: URL


Benchmarks
----------


testset: URL, BLEU: 11.2, chr-F: 0.375
testset: URL, BLEU: 35.5, chr-F: 0.614
testset: URL, BLEU: 25.1, chr-F: 0.542
testset: URL, BLEU: 16.0, chr-F: 0.420
testset: URL, BLEU: 24.0, chr-F: 0.522
testset: URL, BLEU: 30.1, chr-F: 0.550
testset: URL, BLEU: 33.4, chr-F: 0.572
testset: URL, BLEU: 24.0, chr-F: 0.520
testset: URL, BLEU: 25.7, chr-F: 0.526
testset: URL, BLEU: 27.9, chr-F: 0.550
testset: URL, BLEU: 31.4, chr-F: 0.574
testset: URL, BLEU: 28.3, chr-F: 0.555
testset: URL, BLEU: 24.0, chr-F: 0.515
testset: URL, BLEU: 24.5, chr-F: 0.524
testset: URL, BLEU: 25.5, chr-F: 0.533
testset: URL, BLEU: 23.3, chr-F: 0.516
testset: URL, BLEU: 23.2, chr-F: 0.512
testset: URL, BLEU: 27.3, chr-F: 0.545
testset: URL, BLEU: 30.3, chr-F: 0.567
testset: URL, BLEU: 27.9, chr-F: 0.549
testset: URL, BLEU: 23.8, chr-F: 0.523
testset: URL, BLEU: 26.2, chr-F: 0.545
testset: URL, BLEU: 28.6, chr-F: 0.562
testset: URL, BLEU: 31.4, chr-F: 0.581
testset: URL, BLEU: 24.2, chr-F: 0.521
testset: URL, BLEU: 23.9, chr-F: 0.522
testset: URL, BLEU: 29.5, chr-F: 0.570
testset: URL, BLEU: 30.3, chr-F: 0.570
testset: URL, BLEU: 23.5, chr-F: 0.516
testset: URL, BLEU: 24.9, chr-F: 0.529
testset: URL, BLEU: 30.0, chr-F: 0.568
testset: URL, BLEU: 29.9, chr-F: 0.565
testset: URL, BLEU: 33.3, chr-F: 0.593
testset: URL, BLEU: 25.6, chr-F: 0.531
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 30.0, chr-F: 0.561
testset: URL, BLEU: 24.4, chr-F: 0.514
testset: URL, BLEU: 30.8, chr-F: 0.577
testset: URL, BLEU: 27.7, chr-F: 0.558
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 32.2, chr-F: 0.592
testset: URL, BLEU: 16.7, chr-F: 0.450
testset: URL, BLEU: 27.2, chr-F: 0.552
testset: URL, BLEU: 25.4, chr-F: 0.518
testset: URL, BLEU: 28.8, chr-F: 0.552
testset: URL, BLEU: 25.6, chr-F: 0.527
testset: URL, BLEU: 27.0, chr-F: 0.540
testset: URL, BLEU: 33.5, chr-F: 0.592
testset: URL, BLEU: 32.8, chr-F: 0.591
testset: URL, BLEU: 24.8, chr-F: 0.523
testset: URL, BLEU: 23.7, chr-F: 0.510
testset: URL, BLEU: 29.3, chr-F: 0.556
testset: URL, BLEU: 18.9, chr-F: 0.486
testset: URL, BLEU: 28.0, chr-F: 0.546
testset: URL, BLEU: 24.9, chr-F: 0.521
testset: URL, BLEU: 36.0, chr-F: 0.604
testset: URL, BLEU: 23.8, chr-F: 0.517
testset: URL, BLEU: 31.5, chr-F: 0.570
testset: URL, BLEU: 12.1, chr-F: 0.377
testset: URL, BLEU: 26.6, chr-F: 0.555
testset: URL, BLEU: 27.5, chr-F: 0.541
testset: URL, BLEU: 59.0, chr-F: 0.724
testset: URL, BLEU: 9.9, chr-F: 0.254
testset: URL, BLEU: 41.6, chr-F: 0.487
testset: URL, BLEU: 22.8, chr-F: 0.392
testset: URL, BLEU: 36.1, chr-F: 0.521
testset: URL, BLEU: 11.6, chr-F: 0.280
testset: URL, BLEU: 42.2, chr-F: 0.597
testset: URL, BLEU: 45.8, chr-F: 0.598
testset: URL, BLEU: 34.4, chr-F: 0.518
testset: URL, BLEU: 24.4, chr-F: 0.405
testset: URL, BLEU: 50.8, chr-F: 0.660
testset: URL, BLEU: 51.2, chr-F: 0.677
testset: URL, BLEU: 47.6, chr-F: 0.641
testset: URL, BLEU: 5.4, chr-F: 0.214
testset: URL, BLEU: 61.0, chr-F: 0.675
testset: URL, BLEU: 22.5, chr-F: 0.394
testset: URL, BLEU: 34.7, chr-F: 0.522
testset: URL, BLEU: 56.2, chr-F: 0.708
testset: URL, BLEU: 44.9, chr-F: 0.625
testset: URL, BLEU: 21.0, chr-F: 0.383
testset: URL, BLEU: 6.9, chr-F: 0.221
testset: URL, BLEU: 62.1, chr-F: 0.741
testset: URL, BLEU: 22.6, chr-F: 0.466
testset: URL, BLEU: 33.2, chr-F: 0.496
testset: URL, BLEU: 28.1, chr-F: 0.460
testset: URL, BLEU: 9.6, chr-F: 0.306
testset: URL, BLEU: 50.3, chr-F: 0.661
testset: URL, BLEU: 30.0, chr-F: 0.457
testset: URL, BLEU: 15.2, chr-F: 0.301
testset: URL, BLEU: 34.4, chr-F: 0.525
testset: URL, BLEU: 18.4, chr-F: 0.317
testset: URL, BLEU: 24.1, chr-F: 0.400
testset: URL, BLEU: 52.2, chr-F: 0.671
testset: URL, BLEU: 50.5, chr-F: 0.669
testset: URL, BLEU: 5.7, chr-F: 0.189
testset: URL, BLEU: 19.2, chr-F: 0.378
testset: URL, BLEU: 0.1, chr-F: 0.022
testset: URL, BLEU: 0.9, chr-F: 0.095
testset: URL, BLEU: 23.9, chr-F: 0.390
testset: URL, BLEU: 28.0, chr-F: 0.428
testset: URL, BLEU: 44.2, chr-F: 0.567
testset: URL, BLEU: 51.6, chr-F: 0.666
testset: URL, BLEU: 22.3, chr-F: 0.451
testset: URL, BLEU: 41.7, chr-F: 0.585
testset: URL, BLEU: 46.4, chr-F: 0.590
testset: URL, BLEU: 40.4, chr-F: 0.564
testset: URL, BLEU: 43.8, chr-F: 0.605
testset: URL, BLEU: 60.7, chr-F: 0.735
testset: URL, BLEU: 5.5, chr-F: 0.091
testset: URL, BLEU: 7.8, chr-F: 0.205
testset: URL, BLEU: 15.8, chr-F: 0.284
testset: URL, BLEU: 11.6, chr-F: 0.232
testset: URL, BLEU: 30.7, chr-F: 0.484
testset: URL, BLEU: 11.0, chr-F: 0.286
testset: URL, BLEU: 24.4, chr-F: 0.432
testset: URL, BLEU: 47.2, chr-F: 0.646
testset: URL, BLEU: 9.0, chr-F: 0.287
testset: URL, BLEU: 51.7, chr-F: 0.670
testset: URL, BLEU: 22.4, chr-F: 0.369
testset: URL, BLEU: 26.1, chr-F: 0.381
testset: URL, BLEU: 39.8, chr-F: 0.536
testset: URL, BLEU: 72.3, chr-F: 0.758
testset: URL, BLEU: 32.0, chr-F: 0.554
testset: URL, BLEU: 63.1, chr-F: 0.822
testset: URL, BLEU: 49.5, chr-F: 0.638
testset: URL, BLEU: 38.6, chr-F: 0.566
testset: URL, BLEU: 45.6, chr-F: 0.615
testset: URL, BLEU: 40.4, chr-F: 0.767
testset: URL, BLEU: 35.5, chr-F: 0.538
testset: URL, BLEU: 4.9, chr-F: 0.209
testset: URL, BLEU: 54.2, chr-F: 0.694
testset: URL, BLEU: 39.3, chr-F: 0.573
testset: URL, BLEU: 50.9, chr-F: 0.663
testset: URL, BLEU: 19.6, chr-F: 0.386
testset: URL, BLEU: 16.2, chr-F: 0.364
testset: URL, BLEU: 13.6, chr-F: 0.288
testset: URL, BLEU: 9.4, chr-F: 0.301
testset: URL, BLEU: 17.1, chr-F: 0.389
testset: URL, BLEU: 57.0, chr-F: 0.680
testset: URL, BLEU: 41.6, chr-F: 0.526
testset: URL, BLEU: 13.7, chr-F: 0.333
testset: URL, BLEU: 46.5, chr-F: 0.632
testset: URL, BLEU: 56.4, chr-F: 0.710
testset: URL, BLEU: 2.3, chr-F: 0.193
testset: URL, BLEU: 3.2, chr-F: 0.194
testset: URL, BLEU: 17.5, chr-F: 0.420
testset: URL, BLEU: 5.0, chr-F: 0.237
testset: URL, BLEU: 51.4, chr-F: 0.670
testset: URL, BLEU: 26.0, chr-F: 0.447
testset: URL, BLEU: 47.8, chr-F: 0.634
testset: URL, BLEU: 4.0, chr-F: 0.195
testset: URL, BLEU: 45.1, chr-F: 0.440
testset: URL, BLEU: 41.9, chr-F: 0.582
testset: URL, BLEU: 38.7, chr-F: 0.498
testset: URL, BLEU: 29.7, chr-F: 0.499
testset: URL, BLEU: 38.2, chr-F: 0.564
testset: URL, BLEU: 12.7, chr-F: 0.342
testset: URL, BLEU: 53.2, chr-F: 0.687
testset: URL, BLEU: 51.9, chr-F: 0.679
testset: URL, BLEU: 9.0, chr-F: 0.391
testset: URL, BLEU: 57.4, chr-F: 0.705
testset: URL, BLEU: 18.0, chr-F: 0.338
testset: URL, BLEU: 24.3, chr-F: 0.413
testset: URL, BLEU: 1.1, chr-F: 0.094
testset: URL, BLEU: 48.0, chr-F: 0.639
testset: URL, BLEU: 27.2, chr-F: 0.471
testset: URL, BLEU: 28.0, chr-F: 0.398
testset: URL, BLEU: 17.5, chr-F: 0.320
testset: URL, BLEU: 26.9, chr-F: 0.457
testset: URL, BLEU: 1.7, chr-F: 0.131 ### System Info:


* hf\_name: ine-eng
* source\_languages: ine
* target\_languages: eng
* opus\_readme\_url: URL
* original\_repo: Tatoeba-Challenge
* tags: ['translation']
* languages: ['ca', 'es', 'os', 'ro', 'fy', 'cy', 'sc', 'is', 'yi', 'lb', 'an', 'sq', 'fr', 'ht', 'rm', 'ps', 'af', 'uk', 'sl', 'lt', 'bg', 'be', 'gd', 'si', 'en', 'br', 'mk', 'or', 'mr', 'ru', 'fo', 'co', 'oc', 'pl', 'gl', 'nb', 'bn', 'id', 'hy', 'da', 'gv', 'nl', 'pt', 'hi', 'as', 'kw', 'ga', 'sv', 'gu', 'wa', 'lv', 'el', 'it', 'hr', 'ur', 'nn', 'de', 'cs', 'ine']
* src\_constituents: {'cat', 'spa', 'pap', 'mwl', 'lij', 'bos\_Latn', 'lad\_Latn', 'lat\_Latn', 'pcd', 'oss', 'ron', 'fry', 'cym', 'awa', 'swg', 'zsm\_Latn', 'srd', 'gcf\_Latn', 'isl', 'yid', 'bho', 'ltz', 'kur\_Latn', 'arg', 'pes\_Thaa', 'sqi', 'csb\_Latn', 'fra', 'hat', 'non\_Latn', 'sco', 'pnb', 'roh', 'bul\_Latn', 'pus', 'afr', 'ukr', 'slv', 'lit', 'tmw\_Latn', 'hsb', 'tly\_Latn', 'bul', 'bel', 'got\_Goth', 'lat\_Grek', 'ext', 'gla', 'mai', 'sin', 'hif\_Latn', 'eng', 'bre', 'nob\_Hebr', 'prg\_Latn', 'ang\_Latn', 'aln', 'mkd', 'ori', 'mar', 'afr\_Arab', 'san\_Deva', 'gos', 'rus', 'fao', 'orv\_Cyrl', 'bel\_Latn', 'cos', 'zza', 'grc\_Grek', 'oci', 'mfe', 'gom', 'bjn', 'sgs', 'tgk\_Cyrl', 'hye\_Latn', 'pdc', 'srp\_Cyrl', 'pol', 'ast', 'glg', 'pms', 'nob', 'ben', 'min', 'srp\_Latn', 'zlm\_Latn', 'ind', 'rom', 'hye', 'scn', 'enm\_Latn', 'lmo', 'npi', 'pes', 'dan', 'rus\_Latn', 'jdt\_Cyrl', 'gsw', 'glv', 'nld', 'snd\_Arab', 'kur\_Arab', 'por', 'hin', 'dsb', 'asm', 'lad', 'frm\_Latn', 'ksh', 'pan\_Guru', 'cor', 'gle', 'swe', 'guj', 'wln', 'lav', 'ell', 'frr', 'rue', 'ita', 'hrv', 'urd', 'stq', 'nno', 'deu', 'lld\_Latn', 'ces', 'egl', 'vec', 'max\_Latn', 'pes\_Latn', 'ltg', 'nds'}
* tgt\_constituents: {'eng'}
* src\_multilingual: True
* tgt\_multilingual: False
* prepro: normalization + SentencePiece (spm32k,spm32k)
* url\_model: URL
* url\_test\_set: URL
* src\_alpha3: ine
* tgt\_alpha3: eng
* short\_pair: ine-en
* chrF2\_score: 0.615
* bleu: 45.6
* brevity\_penalty: 0.997
* ref\_len: 71872.0
* src\_name: Indo-European languages
* tgt\_name: English
* train\_date: 2020-08-01
* src\_alpha2: ine
* tgt\_alpha2: en
* prefer\_old: False
* long\_pair: ine-eng
* helsinki\_git\_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
* transformers\_git\_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
* port\_machine: brutasse
* port\_time: 2020-08-21-14:41
passage: TAGS
#transformers #pytorch #tf #marian #text2text-generation #translation #ca #es #os #ro #fy #cy #sc #is #yi #lb #an #sq #fr #ht #rm #ps #af #uk #sl #lt #bg #be #gd #si #en #br #mk #or #mr #ru #fo #co #oc #pl #gl #nb #bn #id #hy #da #gv #nl #pt #hi #as #kw #ga #sv #gu #wa #lv #el #it #hr #ur #nn #de #cs #ine #license-apache-2.0 #autotrain_compatible #endpoints_compatible #has_space #region-us 
 passage: ### ine-eng


* source group: Indo-European languages
* target group: English
* OPUS readme: ine-eng
* model: transformer
* source language(s): afr aln ang\_Latn arg asm ast awa bel bel\_Latn ben bho bos\_Latn bre bul bul\_Latn cat ces cor cos csb\_Latn cym dan deu dsb egl ell enm\_Latn ext fao fra frm\_Latn frr fry gcf\_Latn gla gle glg glv gom gos got\_Goth grc\_Grek gsw guj hat hif\_Latn hin hrv hsb hye ind isl ita jdt\_Cyrl ksh kur\_Arab kur\_Latn lad lad\_Latn lat\_Latn lav lij lit lld\_Latn lmo ltg ltz mai mar max\_Latn mfe min mkd mwl nds nld nno nob nob\_Hebr non\_Latn npi oci ori orv\_Cyrl oss pan\_Guru pap pdc pes pes\_Latn pes\_Thaa pms pnb pol por prg\_Latn pus roh rom ron rue rus san\_Deva scn sco sgs sin slv snd\_Arab spa sqi srp\_Cyrl srp\_Latn stq swe swg tgk\_Cyrl tly\_Latn tmw\_Latn ukr urd vec wln yid zlm\_Latn zsm\_Latn zza
* target language(s): eng
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* download original weights: URL
* test set translations: URL
* test set scores: URL


Benchmarks
----------


testset: URL, BLEU: 11.2, chr-F: 0.375
testset: URL, BLEU: 35.5, chr-F: 0.614
testset: URL, BLEU: 25.1, chr-F: 0.542
testset: URL, BLEU: 16.0, chr-F: 0.420
testset: URL, BLEU: 24.0, chr-F: 0.522
testset: URL, BLEU: 30.1, chr-F: 0.550
testset: URL, BLEU: 33.4, chr-F: 0.572
testset: URL, BLEU: 24.0, chr-F: 0.520
testset: URL, BLEU: 25.7, chr-F: 0.526
testset: URL, BLEU: 27.9, chr-F: 0.550
testset: URL, BLEU: 31.4, chr-F: 0.574
testset: URL, BLEU: 28.3, chr-F: 0.555
testset: URL, BLEU: 24.0, chr-F: 0.515
testset: URL, BLEU: 24.5, chr-F: 0.524
testset: URL, BLEU: 25.5, chr-F: 0.533
testset: URL, BLEU: 23.3, chr-F: 0.516
testset: URL, BLEU: 23.2, chr-F: 0.512
testset: URL, BLEU: 27.3, chr-F: 0.545
testset: URL, BLEU: 30.3, chr-F: 0.567
testset: URL, BLEU: 27.9, chr-F: 0.549
testset: URL, BLEU: 23.8, chr-F: 0.523
testset: URL, BLEU: 26.2, chr-F: 0.545
testset: URL, BLEU: 28.6, chr-F: 0.562
testset: URL, BLEU: 31.4, chr-F: 0.581
testset: URL, BLEU: 24.2, chr-F: 0.521
testset: URL, BLEU: 23.9, chr-F: 0.522
testset: URL, BLEU: 29.5, chr-F: 0.570
testset: URL, BLEU: 30.3, chr-F: 0.570
testset: URL, BLEU: 23.5, chr-F: 0.516
testset: URL, BLEU: 24.9, chr-F: 0.529
testset: URL, BLEU: 30.0, chr-F: 0.568
testset: URL, BLEU: 29.9, chr-F: 0.565
testset: URL, BLEU: 33.3, chr-F: 0.593
testset: URL, BLEU: 25.6, chr-F: 0.531
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 30.0, chr-F: 0.561
testset: URL, BLEU: 24.4, chr-F: 0.514
testset: URL, BLEU: 30.8, chr-F: 0.577
testset: URL, BLEU: 27.7, chr-F: 0.558
testset: URL, BLEU: 27.7, chr-F: 0.545
testset: URL, BLEU: 32.2, chr-F: 0.592
testset: URL, BLEU: 16.7, chr-F: 0.450
testset: URL, BLEU: 27.2, chr-F: 0.552
testset: URL, BLEU: 25.4, chr-F: 0.518
testset: URL, BLEU: 28.8, chr-F: 0.552
testset: URL, BLEU: 25.6, chr-F: 0.527
testset: URL, BLEU: 27.0, chr-F: 0.540
testset: URL, BLEU: 33.5, chr-F: 0.592
testset: URL, BLEU: 32.8, chr-F: 0.591
testset: URL, BLEU: 24.8, chr-F: 0.523
testset: URL, BLEU: 23.7, chr-F: 0.510
testset: URL, BLEU: 29.3, chr-F: 0.556
testset: URL, BLEU: 18.9, chr-F: 0.486
testset: URL, BLEU: 28.0, chr-F: 0.546
testset: URL, BLEU: 24.9, chr-F: 0.521
testset: URL, BLEU: 36.0, chr-F: 0.604
testset: URL, BLEU: 23.8, chr-F: 0.517
testset: URL, BLEU: 31.5, chr-F: 0.570
testset: URL, BLEU: 12.1, chr-F: 0.377
testset: URL, BLEU: 26.6, chr-F: 0.555
testset: URL, BLEU: 27.5, chr-F: 0.541
testset: URL, BLEU: 59.0, chr-F: 0.724
testset: URL, BLEU: 9.9, chr-F: 0.254
testset: URL, BLEU: 41.6, chr-F: 0.487
testset: URL, BLEU: 22.8, chr-F: 0.392
testset: URL, BLEU: 36.1, chr-F: 0.521
testset: URL, BLEU: 11.6, chr-F: 0.280
testset: URL, BLEU: 42.2, chr-F: 0.597
testset: URL, BLEU: 45.8, chr-F: 0.598
testset: URL, BLEU: 34.4, chr-F: 0.518
testset: URL, BLEU: 24.4, chr-F: 0.405
testset: URL, BLEU: 50.8, chr-F: 0.660
testset: URL, BLEU: 51.2, chr-F: 0.677
testset: URL, BLEU: 47.6, chr-F: 0.641
testset: URL, BLEU: 5.4, chr-F: 0.214
testset: URL, BLEU: 61.0, chr-F: 0.675
testset: URL, BLEU: 22.5, chr-F: 0.394
testset: URL, BLEU: 34.7, chr-F: 0.522
testset: URL, BLEU: 56.2, chr-F: 0.708
testset: URL, BLEU: 44.9, chr-F: 0.625
testset: URL, BLEU: 21.0, chr-F: 0.383
testset: URL, BLEU: 6.9, chr-F: 0.221
testset: URL, BLEU: 62.1, chr-F: 0.741
testset: URL, BLEU: 22.6, chr-F: 0.466
testset: URL, BLEU: 33.2, chr-F: 0.496
testset: URL, BLEU: 28.1, chr-F: 0.460
testset: URL, BLEU: 9.6, chr-F: 0.306
testset: URL, BLEU: 50.3, chr-F: 0.661
testset: URL, BLEU: 30.0, chr-F: 0.457
testset: URL, BLEU: 15.2, chr-F: 0.301
testset: URL, BLEU: 34.4, chr-F: 0.525
testset: URL, BLEU: 18.4, chr-F: 0.317
testset: URL, BLEU: 24.1, chr-F: 0.400
testset: URL, BLEU: 52.2, chr-F: 0.671
testset: URL, BLEU: 50.5, chr-F: 0.669
testset: URL, BLEU: 5.7, chr-F: 0.189
testset: URL, BLEU: 19.2, chr-F: 0.378
testset: URL, BLEU: 0.1, chr-F: 0.022
testset: URL, BLEU: 0.9, chr-F: 0.095
testset: URL, BLEU: 23.9, chr-F: 0.390
testset: URL, BLEU: 28.0, chr-F: 0.428
testset: URL, BLEU: 44.2, chr-F: 0.567
testset: URL, BLEU: 51.6, chr-F: 0.666
testset: URL, BLEU: 22.3, chr-F: 0.451
testset: URL, BLEU: 41.7, chr-F: 0.585
testset: URL, BLEU: 46.4, chr-F: 0.590
testset: URL, BLEU: 40.4, chr-F: 0.564
testset: URL, BLEU: 43.8, chr-F: 0.605
testset: URL, BLEU: 60.7, chr-F: 0.735
testset: URL, BLEU: 5.5, chr-F: 0.091
testset: URL, BLEU: 7.8, chr-F: 0.205
testset: URL, BLEU: 15.8, chr-F: 0.284
testset: URL, BLEU: 11.6, chr-F: 0.232
testset: URL, BLEU: 30.7, chr-F: 0.484
testset: URL, BLEU: 11.0, chr-F: 0.286
testset: URL, BLEU: 24.4, chr-F: 0.432
testset: URL, BLEU: 47.2, chr-F: 0.646
testset: URL, BLEU: 9.0, chr-F: 0.287
testset: URL, BLEU: 51.7, chr-F: 0.670
testset: URL, BLEU: 22.4, chr-F: 0.369
testset: URL, BLEU: 26.1, chr-F: 0.381
testset: URL, BLEU: 39.8, chr-F: 0.536
testset: URL, BLEU: 72.3, chr-F: 0.758
testset: URL, BLEU: 32.0, chr-F: 0.554
testset: URL, BLEU: 63.1, chr-F: 0.822
testset: URL, BLEU: 49.5, chr-F: 0.638
testset: URL, BLEU: 38.6, chr-F: 0.566
testset: URL, BLEU: 45.6, chr-F: 0.615
testset: URL, BLEU: 40.4, chr-F: 0.767
testset: URL, BLEU: 35.5, chr-F: 0.538
testset: URL, BLEU: 4.9, chr-F: 0.209
testset: URL, BLEU: 54.2, chr-F: 0.694
testset: URL, BLEU: 39.3, chr-F: 0.573
testset: URL, BLEU: 50.9, chr-F: 0.663
testset: URL, BLEU: 19.6, chr-F: 0.386
testset: URL, BLEU: 16.2, chr-F: 0.364
testset: URL, BLEU: 13.6, chr-F: 0.288
testset: URL, BLEU: 9.4, chr-F: 0.301
testset: URL, BLEU: 17.1, chr-F: 0.389
testset: URL, BLEU: 57.0, chr-F: 0.680
testset: URL, BLEU: 41.6, chr-F: 0.526
testset: URL, BLEU: 13.7, chr-F: 0.333
testset: URL, BLEU: 46.5, chr-F: 0.632
testset: URL, BLEU: 56.4, chr-F: 0.710
testset: URL, BLEU: 2.3, chr-F: 0.193
testset: URL, BLEU: 3.2, chr-F: 0.194
testset: URL, BLEU: 17.5, chr-F: 0.420
testset: URL, BLEU: 5.0, chr-F: 0.237
testset: URL, BLEU: 51.4, chr-F: 0.670
testset: URL, BLEU: 26.0, chr-F: 0.447
testset: URL, BLEU: 47.8, chr-F: 0.634
testset: URL, BLEU: 4.0, chr-F: 0.195
testset: URL, BLEU: 45.1, chr-F: 0.440
testset: URL, BLEU: 41.9, chr-F: 0.582
testset: URL, BLEU: 38.7, chr-F: 0.498
testset: URL, BLEU: 29.7, chr-F: 0.499
testset: URL, BLEU: 38.2, chr-F: 0.564
testset: URL, BLEU: 12.7, chr-F: 0.342
testset: URL, BLEU: 53.2, chr-F: 0.687
testset: URL, BLEU: 51.9, chr-F: 0.679
testset: URL, BLEU: 9.0, chr-F: 0.391
testset: URL, BLEU: 57.4, chr-F: 0.705
testset: URL, BLEU: 18.0, chr-F: 0.338
testset: URL, BLEU: 24.3, chr-F: 0.413
testset: URL, BLEU: 1.1, chr-F: 0.094
testset: URL, BLEU: 48.0, chr-F: 0.639
testset: URL, BLEU: 27.2, chr-F: 0.471
testset: URL, BLEU: 28.0, chr-F: 0.398
testset: URL, BLEU: 17.5, chr-F: 0.320
testset: URL, BLEU: 26.9, chr-F: 0.457
testset: URL, BLEU: 1.7, chr-F: 0.131