  $[0.2,0.3)$     1399     46.5%    238     14.0%
  $[0.3,0.4)$      740     24.6%    194     11.4%
  $[0.4,0.5)$      281      9.3%    154      9.1%
  $[0.5,0.6)$      113      3.7%    156      9.2%
  $[0.6,0.7)$       29      0.9%    157      9.2%
  $[0.7,0.8)$       10      0.3%    156      9.2%
  $[0.8,0.9)$       10      0.3%    252     14.9%
  $[0.9,1)$          0        0%    237     14.0%
  $1$                7      0.2%      0        0%
  ------------- ------ --------- ------ ---------

  : Statistics for similarities between each test sentence and the training set as computed by Equation \[simi1n\] for the WMT 2017 en-de task (3004 sentences) and our JRC-Acquis en-de task (1689 sentences).[]{data-label="wmt-simi"}

                      en-de   en-fr   en-es
  ------ ------------ ------- ------- -------
  dev    NMT          44.08   57.26   55.76
         Ours         50.81   62.60   60.51
         1/0 reward   47.70   61.15   58.92
  test   NMT          43.76   57.67   55.78
         Ours         50.15   63.27   60.54
         1/0 reward   47.13   62.14   58.66

  : Translation results (BLEU) of 1/0 reward.[]{data-label="t-decrease"}

We also tried our method on WMT 2017 English-to-German News translation task. However, we did not achieve significant improvements over the baseline attentional NMT model, likely because the test set and the training set for the WMT task have a relatively low similarity as shown in Table \[wmt-simi\] and hence
$ [ 0.2,0.3)$      1399      46.5%     238      14.0% 
   $ [ 0.3,0.4)$       740      24.6%     194      11.4% 
   $ [ 0.4,0.5)$       281       9.3%     154       9.1% 
   $ [ 0.5,0.6)$       113       3.7%     156       9.2% 
   $ [ 0.6,0.7)$        29       0.9%     157       9.2% 
   $ [ 0.7,0.8)$        10       0.3%     156       9.2% 
   $ [ 0.8,0.9)$        10       0.3%     252      14.9% 
   $ [ 0.9,1)$           0         0%     237      14.0% 
   $ 1 $                 7       0.2%       0         0% 
   ------------- ------ --------- ------ --------- 

  : Statistics for similarities between each test sentence and the education rig as computed by Equation   \[simi1n\ ] for the WMT 2017 en - de task (3004 prison term) and our JRC - Acquis en - de job (1689 sentences).[]{data - label="wmt - simi " } 

                       en - de    en - fr    en - es 
   ------ ------------ ------- ------- ------- 
   dev     NMT           44.08    57.26    55.76 
          Ours          50.81    62.60    60.51 
          1/0 reward    47.70    61.15    58.92 
   examination    NMT           43.76    57.67    55.78 
          Ours          50.15    63.27    60.54 
          1/0 advantage    47.13    62.14    58.66 

  : Translation consequence (BLEU) of 1/0 reward.[]{data - label="t - decrease " } 

 We also tried our method acting on WMT 2017 English - to - German News translation task. However, we did not achieve significant improvements over the service line attentional NMT model, likely because the trial set and the training sic for the WMT task have a relatively low similarity as show in Table   \[wmt - simi\ ] and hence
  $[0.2,0.3)$     1399     46.5%    238     14.0%
  $[0.3,0.4)$      740     24.6%    194     11.4%
  $[0.4,0.5)$      281      9.3%    154      9.1%
  $[0.5,0.6)$      113      3.7%    156      9.2%
  $[0.6,0.7)$       29      0.9%    157      9.2%
  $[0.7,0.8)$       10      0.3%    156      9.2%
  $[0.8,0.9)$       10      0.3%    252     14.9%
  $[0.9,1)$          0        0%    237     14.0%
  $1$                7      0.2%      0        0%
  ------------- ------ --------- ------ ---------

  : Statistiss for xililarities betreen qach newt sentence and the training aet as bomputed by Equatoon \[simi1n\] for the WMT 2017 en-de tasn (3004 sentences) and okr JRC-Acquiw en-qw task (1689 sentdnces).[]{data-label="wmt-simi"}

                      en-de   en-ff   eu-es
  ------ ------------ ------- ------- -------
  eec    NMT          44.08   57.26   55.76
         Ours         50.81   62.60   60.51
         1/0 rexard   47.70   61.15   58.92
  test   NMT          43.76   57.67   55.78
         Ouss         50.15   63.27   60.54
         1/0 rewdrd   47.13   62.14   58.66

  : Franslwtikn results (BLEU) of 1/0 rwward.[]{data-label="t-decrtasq"}

Qe also tried our mqtrod on WMT 2017 English-to-German News transldtikn task. However, we did bot achieve significajt improvqments over the baseline attentional NMT model, linely uezauwe gye test set and the training set for the WMT tafi nane a relatively ljw similariyy ax shown in Tabue \[wmt-snji\] and hence
$[0.2,0.3)$ 1399 46.5% 238 14.0% $[0.3,0.4)$ 740 11.4% 281 9.3% 9.1% $[0.5,0.6)$ 113 0.9% 9.2% $[0.7,0.8)$ 10 156 9.2% $[0.8,0.9)$ 0.3% 252 14.9% $[0.9,1)$ 0 0% 14.0% $1$ 7 0.2% 0 0% ------------- ------ --------- ------ --------- : Statistics similarities between each test sentence and the training set as computed by Equation for WMT en-de (3004 sentences) and our JRC-Acquis en-de task (1689 sentences).[]{data-label="wmt-simi"} en-de en-fr en-es ------ ------------ ------- ------- dev NMT 44.08 57.26 55.76 Ours 50.81 62.60 1/0 reward 47.70 61.15 test NMT 43.76 57.67 55.78 50.15 60.54 1/0 47.13 58.66 Translation results (BLEU) 1/0 reward.[]{data-label="t-decrease"} We also tried our method on WMT 2017 English-to-German News translation task. However, we did achieve significant the baseline NMT likely the test set training set for the WMT task low similarity as shown in Table \[wmt-simi\] and
  $[0.2,0.3)$     1399     46.5%    238     14.0%
  $[0.3,0.4)$      740     24.6%    194     11.4%
  $[0.4,0.5)$      281      9.3%    154      9.1%
  $[0.5,0.6)$      113      3.7%    156      9.2%
  $[0.6,0.7)$       29      0.9%    157      9.2%
  $[0.7,0.8)$       10      0.3%    156      9.2%
  $[0.8,0.9)$       10      0.3%    252     14.9%
  $[0.9,1)$          0        0%    237     14.0%
  $1$                7      0.2%      0        0%
  ------------- ------ --------- ------ ---------

  : Statistics for similarities Between eacH test SenTenCe And tHe trAining set as comPUted By Equation \[simi1n\] for the WmT 2017 en-dE tASk (3004 seNTeNces) aNd our JRc-acQUIs eN-dE tAsk (1689 SeNTeNces).[]{dAta-Label="wmT-simi"}

                      en-de   eN-fr   En-Es
  ------ ------------ ------- ------- -------
  dev    NMT          44.08   57.26   55.76
         Ours         50.81   62.60   60.51
         1/0 REwArd   47.70   61.15   58.92
  test   NMT          43.76   57.67   55.78
         ourS         50.15   63.27   60.54
         1/0 reward   47.13   62.14   58.66

  : TransLatIon resUlTs (BleU) of 1/0 rEwaRd.[]{datA-label="T-DecreaSe"}

We also tRiED our meTHod on WMt 2017 eNgLish-To-German News transLAtIOn task. However, wE did noT aCHiEVE siGniFicant imprOvEmentS Over the BAsELINe aTTentional NMT mOdel, likely bECauSe the tEsT seT And the TrainInG Set For the WMT taSk haVe a relatiVely loW SimilarITy as shoWn in TaBle \[Wmt-Simi\] ANd HeNce
  $[0.2,0.3)$     1399    46.5%   238   14. 0% 
  $ [0.3 ,0.4)$      74 0     24.6%    194     11.4 %
  $ [0 . 4,0. 5 )$      281   9 . 3%  1 54  9.1%  $ [0.5,0. 6)$      1 13    3.7%    1 5 6     9.2%  $ [0.6,0.7)$     29    0 . 9%   15 7     9.2%   $[0. 7,0.8)$    10    0.3%  156     9.2%
  $[0.8 , 0. 9 )$       10     0.3 % 2 5 2   14.9%
  $[ 0. 9,1)$        0    0%    237    14.0%
  $ 1 $           7     0. 2%     0       0%
 -------- ------ ----- - - -------  ----- - - --- ---- - 
 : S ta t ist i cs  fo r  si milariti es  b etwee n ea c h t estsen tenc e and  the training  se t as com puted  by E quat io n \[s imi1n\ ] for  t he WMT 2017 en- de t ask (3004  se nt enc es ) and our JR C-A cqu is en-d e task( 168 9s e n te nces).[]{data-labe l= " w mt -simi"}
               en -deen-fr    e n -e s
  ---- -- --- - -- -- ---- -- -- --- -- -- ---  -- -----   de v    N MT         4 4 .08   57.26  5 5.76
       Ou r s       5 0.81   62.6 0  6 0.51 
     1 /0 re ward 4 7. 7 0   61.15   58.92
 t est  NMT         43.76    57.67 5 5 .78
      Ou r s         50.1 5   6 3.27   60. 5 4
        1/ 0 reward    47.1362.14  58. 66
 : T r a ns lation result s (BLE U)  of 1/0  re ward.[] {da ta- lab el= "t -decrease "}

We a ls otr ie d o ur me t hod on W MT  20 17  En glish - to-Ger man N ewstr an s lat ion tas k .H o weve r,  w e di d n ot  achi eves ign ificant  improvem ent s  ove rth e basel ine attention al  NMT model ,lik ely be c a use thetest set and the traini n g set f orthe W MT t ask havea r elativ ely low si milari ty as  s how n in Ta b l e\[w mt -simi\] an d hen ce
 _$[0.2,0.3)$ _   1399_ __ 46.5%__  238_  _ 14.0%
  $[0.3,0.4)$_  __ 740     24.6%    194   __11.4%
 _$[0.4,0.5)$__    281_    _9.3% _  154     _9.1%
_ $[0.5,0.6)$ _    113    _ 3.7%    156_  ___9.2%
  $[0.6,0.7)$ _     29_     0.9%_   157   _  9.2%
  $[0.7,0.8)$ _    _10 _    0.3%_  _156 _  _ 9.2%
  $[0.8,0.9)$  _  _ 10    __0.3%  __252_ _  14.9%
__$[0.9,1)$ __     __0      _ 0%  __237   _ 14.0%
  $1$ _     _ _ _    7      0.2%_     0_   _ __0%
  -------------_------_--------- ------_---------

  : Statistics for similarities between_each test_sentence and the training set as_computed by Equation \[simi1n\] for_the_WMT 2017 en-de task (3004 sentences)_and our JRC-Acquis en-de task (1689_sentences).[]{data-label="wmt-simi"}

    ___    _     _  _ en-de   en-fr  _en-es
_ ------ ------------ ------- ------- -------
__dev    NMT ___    _ 44.08   57.26 _ 55.76
       _ Ours _    ___50.81   62.60   60.51
   _ _  _1/0 reward   47.70   61.15  _58.92
  test   NMT _        43.76  _57.67   55.78
    _    Ours  _   __ 50.15   63.27  _60.54
___  _  _1/0 reward _ 47.13_  62.14_ _58.66

  :_Translation_results (BLEU) of 1/0 reward.[]{data-label="t-decrease"}

We also tried our method on WMT 2017 English-to-German News translation task. However, we_did not achieve significant improvements over_the baseline attentional NMT model,_likely_because the test_set and the training_set for the WMT task have a relatively_low similarity as shown in Table \[wmt-simi\] and hence