ARG=i
ARG=d
ARG=v
ARG=o
ARG=p
INITIAL PASS 
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
.................................................. [750000]
.................................................. [800000]
.................................................. [850000]
.................................................. [900000]
.................................................. [950000]
.................................................. [1000000]
.................................................. [1050000]
.................................................. [1100000]
.................................................. [1150000]
.................................................. [1200000]
.................................................. [1250000]
.................................................. [1300000]
.................................................. [1350000]
.................................................. [1400000]
.................................................. [1450000]
.................................................. [1500000]
.................................................. [1550000]
.................................................. [1600000]
.................................................. [1650000]
.................................................. [1700000]
.................................................. [1750000]
.................................................. [1800000]
.................................................. [1850000]
.................................................. [1900000]
.................................................. [1950000]
.................................................. [2000000]
.................................................. [2050000]
.................................................. [2100000]
.................................................. [2150000]
.................................................. [2200000]
.................................................. [2250000]
.................................................. [2300000]
.................................................. [2350000]
.................................................. [2400000]
.................................................. [2450000]
.................................................. [2500000]
.................................................. [2550000]
.................................................. [2600000]
.................................................. [2650000]
.................................................. [2700000]
.................................................. [2750000]
.................................................. [2800000]
.................................................. [2850000]
.................................................. [2900000]
.................................................. [2950000]
.................................................. [3000000]
.................................................. [3050000]
.................................................. [3100000]
.................................................. [3150000]
.................................................. [3200000]
.................................................. [3250000]
.................................................. [3300000]
.................................................. [3350000]
.................................................. [3400000]
.................................................. [3450000]
.................................................. [3500000]
.................................................. [3550000]
.................................................. [3600000]
.................................................. [3650000]
.................................................. [3700000]
.................................................. [3750000]
.................................................. [3800000]
.................................................. [3850000]
.................................................. [3900000]
.................................................. [3950000]
.................................................. [4000000]
.................................................. [4050000]
.................................................. [4100000]
.................................................. [4150000]
.................................................. [4200000]
.................................................. [4250000]
.................................................. [4300000]
.................................................. [4350000]
.................................................. [4400000]
.................................................. [4450000]
.................................................. [4500000]
.................................................. [4550000]
.................................................. [4600000]
.................................................. [4650000]
.................................................. [4700000]
.................................................. [4750000]
.................................................. [4800000]
.................................................. [4850000]
.................................................. [4900000]
.................................................. [4950000]
.................................................. [5000000]
.................................................. [5050000]
.................................................. [5100000]
.................................................. [5150000]
.................................................. [5200000]
.................................................. [5250000]
.................................................. [5300000]
.................................................. [5350000]
.................................................. [5400000]
.................................................. [5450000]
.................................................. [5500000]
.................................................. [5550000]
.................................................. [5600000]
.................................................. [5650000]
.................................................. [5700000]
.................................................. [5750000]
.................................................. [5800000]
.................................................. [5850000]
.................................................. [5900000]
.................................................. [5950000]
.................................................. [6000000]
.................................................. [6050000]
.................................................. [6100000]
.................................................. [6150000]
.................................................. [6200000]
.................................................. [6250000]
.................................................. [6300000]
.................................................. [6350000]
.................................................. [6400000]
.................................................. [6450000]
.................................................. [6500000]
.................................................. [6550000]
.................................................. [6600000]
.................................................. [6650000]
.................................................. [6700000]
.................................................. [6750000]
.................................................. [6800000]
.................................
expected target length = source length * 1
ITERATION 1
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
.................................................. [750000]
.................................................. [800000]
.................................................. [850000]
.................................................. [900000]
.................................................. [950000]
.................................................. [1000000]
.................................................. [1050000]
.................................................. [1100000]
.................................................. [1150000]
.................................................. [1200000]
.................................................. [1250000]
.................................................. [1300000]
.................................................. [1350000]
.................................................. [1400000]
.................................................. [1450000]
.................................................. [1500000]
.................................................. [1550000]
.................................................. [1600000]
.................................................. [1650000]
.................................................. [1700000]
.................................................. [1750000]
.................................................. [1800000]
.................................................. [1850000]
.................................................. [1900000]
.................................................. [1950000]
.................................................. [2000000]
.................................................. [2050000]
.................................................. [2100000]
.................................................. [2150000]
.................................................. [2200000]
.................................................. [2250000]
.................................................. [2300000]
.................................................. [2350000]
.................................................. [2400000]
.................................................. [2450000]
.................................................. [2500000]
.................................................. [2550000]
.................................................. [2600000]
.................................................. [2650000]
.................................................. [2700000]
.................................................. [2750000]
.................................................. [2800000]
.................................................. [2850000]
.................................................. [2900000]
.................................................. [2950000]
.................................................. [3000000]
.................................................. [3050000]
.................................................. [3100000]
.................................................. [3150000]
.................................................. [3200000]
.................................................. [3250000]
.................................................. [3300000]
.................................................. [3350000]
.................................................. [3400000]
.................................................. [3450000]
.................................................. [3500000]
.................................................. [3550000]
.................................................. [3600000]
.................................................. [3650000]
.................................................. [3700000]
.................................................. [3750000]
.................................................. [3800000]
.................................................. [3850000]
.................................................. [3900000]
.................................................. [3950000]
.................................................. [4000000]
.................................................. [4050000]
.................................................. [4100000]
.................................................. [4150000]
.................................................. [4200000]
.................................................. [4250000]
.................................................. [4300000]
.................................................. [4350000]
.................................................. [4400000]
.................................................. [4450000]
.................................................. [4500000]
.................................................. [4550000]
.................................................. [4600000]
.................................................. [4650000]
.................................................. [4700000]
.................................................. [4750000]
.................................................. [4800000]
.................................................. [4850000]
.................................................. [4900000]
.................................................. [4950000]
.................................................. [5000000]
.................................................. [5050000]
.................................................. [5100000]
.................................................. [5150000]
.................................................. [5200000]
.................................................. [5250000]
.................................................. [5300000]
.................................................. [5350000]
.................................................. [5400000]
.................................................. [5450000]
.................................................. [5500000]
.................................................. [5550000]
.................................................. [5600000]
.................................................. [5650000]
.................................................. [5700000]
.................................................. [5750000]
.................................................. [5800000]
.................................................. [5850000]
.................................................. [5900000]
.................................................. [5950000]
.................................................. [6000000]
.................................................. [6050000]
.................................................. [6100000]
.................................................. [6150000]
.................................................. [6200000]
.................................................. [6250000]
.................................................. [6300000]
.................................................. [6350000]
.................................................. [6400000]
.................................................. [6450000]
.................................................. [6500000]
.................................................. [6550000]
.................................................. [6600000]
.................................................. [6650000]
.................................................. [6700000]
.................................................. [6750000]
.................................................. [6800000]
.................................
  log_e likelihood: -2.77772e+09
  log_2 likelihood: -4.00741e+09
     cross entropy: 29.8974
        perplexity: 1e+09
      posterior p0: 0.08
 posterior al-feat: -0.168439
       size counts: 164
ITERATION 2
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
.................................................. [750000]
.................................................. [800000]
.................................................. [850000]
.................................................. [900000]
.................................................. [950000]
.................................................. [1000000]
.................................................. [1050000]
.................................................. [1100000]
.................................................. [1150000]
.................................................. [1200000]
.................................................. [1250000]
.................................................. [1300000]
.................................................. [1350000]
.................................................. [1400000]
.................................................. [1450000]
.................................................. [1500000]
.................................................. [1550000]
.................................................. [1600000]
.................................................. [1650000]
.................................................. [1700000]
.................................................. [1750000]
.................................................. [1800000]
.................................................. [1850000]
.................................................. [1900000]
.................................................. [1950000]
.................................................. [2000000]
.................................................. [2050000]
.................................................. [2100000]
.................................................. [2150000]
.................................................. [2200000]
.................................................. [2250000]
.................................................. [2300000]
.................................................. [2350000]
.................................................. [2400000]
.................................................. [2450000]
.................................................. [2500000]
.................................................. [2550000]
.................................................. [2600000]
.................................................. [2650000]
.................................................. [2700000]
.................................................. [2750000]
.................................................. [2800000]
.................................................. [2850000]
.................................................. [2900000]
.................................................. [2950000]
.................................................. [3000000]
.................................................. [3050000]
.................................................. [3100000]
.................................................. [3150000]
.................................................. [3200000]
.................................................. [3250000]
.................................................. [3300000]
.................................................. [3350000]
.................................................. [3400000]
.................................................. [3450000]
.................................................. [3500000]
.................................................. [3550000]
.................................................. [3600000]
.................................................. [3650000]
.................................................. [3700000]
.................................................. [3750000]
.................................................. [3800000]
.................................................. [3850000]
.................................................. [3900000]
.................................................. [3950000]
.................................................. [4000000]
.................................................. [4050000]
.................................................. [4100000]
.................................................. [4150000]
.................................................. [4200000]
.................................................. [4250000]
.................................................. [4300000]
.................................................. [4350000]
.................................................. [4400000]
.................................................. [4450000]
.................................................. [4500000]
.................................................. [4550000]
.................................................. [4600000]
.................................................. [4650000]
.................................................. [4700000]
.................................................. [4750000]
.................................................. [4800000]
.................................................. [4850000]
.................................................. [4900000]
.................................................. [4950000]
.................................................. [5000000]
.................................................. [5050000]
.................................................. [5100000]
.................................................. [5150000]
.................................................. [5200000]
.................................................. [5250000]
.................................................. [5300000]
.................................................. [5350000]
.................................................. [5400000]
.................................................. [5450000]
.................................................. [5500000]
.................................................. [5550000]
.................................................. [5600000]
.................................................. [5650000]
.................................................. [5700000]
.................................................. [5750000]
.................................................. [5800000]
.................................................. [5850000]
.................................................. [5900000]
.................................................. [5950000]
.................................................. [6000000]
.................................................. [6050000]
.................................................. [6100000]
.................................................. [6150000]
.................................................. [6200000]
.................................................. [6250000]
.................................................. [6300000]
.................................................. [6350000]
.................................................. [6400000]
.................................................. [6450000]
.................................................. [6500000]
.................................................. [6550000]
.................................................. [6600000]
.................................................. [6650000]
.................................................. [6700000]
.................................................. [6750000]
.................................................. [6800000]
.................................
  log_e likelihood: -5.19049e+08
  log_2 likelihood: -7.48829e+08
     cross entropy: 5.58665
        perplexity: 48.0563
      posterior p0: 0.0166768
 posterior al-feat: -0.0796844
       size counts: 164
  1  model al-feat: -0.173108 (tension=4)
  2  model al-feat: -0.13209 (tension=5.86847)
  3  model al-feat: -0.115472 (tension=6.91658)
  4  model al-feat: -0.106032 (tension=7.63233)
  5  model al-feat: -0.0998854 (tension=8.15927)
  6  model al-feat: -0.0955715 (tension=8.56329)
  7  model al-feat: -0.0923966 (tension=8.88103)
  8  model al-feat: -0.0899832 (tension=9.13528)
     final tension: 9.34126
ITERATION 3
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
.................................................. [750000]
.................................................. [800000]
.................................................. [850000]
.................................................. [900000]
.................................................. [950000]
.................................................. [1000000]
.................................................. [1050000]
.................................................. [1100000]
.................................................. [1150000]
.................................................. [1200000]
.................................................. [1250000]
.................................................. [1300000]
.................................................. [1350000]
.................................................. [1400000]
.................................................. [1450000]
.................................................. [1500000]
.................................................. [1550000]
.................................................. [1600000]
.................................................. [1650000]
.................................................. [1700000]
.................................................. [1750000]
.................................................. [1800000]
.................................................. [1850000]
.................................................. [1900000]
.................................................. [1950000]
.................................................. [2000000]
.................................................. [2050000]
.................................................. [2100000]
.................................................. [2150000]
.................................................. [2200000]
.................................................. [2250000]
.................................................. [2300000]
.................................................. [2350000]
.................................................. [2400000]
.................................................. [2450000]
.................................................. [2500000]
.................................................. [2550000]
.................................................. [2600000]
.................................................. [2650000]
.................................................. [2700000]
.................................................. [2750000]
.................................................. [2800000]
.................................................. [2850000]
.................................................. [2900000]
.................................................. [2950000]
.................................................. [3000000]
.................................................. [3050000]
.................................................. [3100000]
.................................................. [3150000]
.................................................. [3200000]
.................................................. [3250000]
.................................................. [3300000]
.................................................. [3350000]
.................................................. [3400000]
.................................................. [3450000]
.................................................. [3500000]
.................................................. [3550000]
.................................................. [3600000]
.................................................. [3650000]
.................................................. [3700000]
.................................................. [3750000]
.................................................. [3800000]
.................................................. [3850000]
.................................................. [3900000]
.................................................. [3950000]
.................................................. [4000000]
.................................................. [4050000]
.................................................. [4100000]
.................................................. [4150000]
.................................................. [4200000]
.................................................. [4250000]
.................................................. [4300000]
.................................................. [4350000]
.................................................. [4400000]
.................................................. [4450000]
.................................................. [4500000]
.................................................. [4550000]
.................................................. [4600000]
.................................................. [4650000]
.................................................. [4700000]
.................................................. [4750000]
.................................................. [4800000]
.................................................. [4850000]
.................................................. [4900000]
.................................................. [4950000]
.................................................. [5000000]
.................................................. [5050000]
.................................................. [5100000]
.................................................. [5150000]
.................................................. [5200000]
.................................................. [5250000]
.................................................. [5300000]
.................................................. [5350000]
.................................................. [5400000]
.................................................. [5450000]
.................................................. [5500000]
.................................................. [5550000]
.................................................. [5600000]
.................................................. [5650000]
.................................................. [5700000]
.................................................. [5750000]
.................................................. [5800000]
.................................................. [5850000]
.................................................. [5900000]
.................................................. [5950000]
.................................................. [6000000]
.................................................. [6050000]
.................................................. [6100000]
.................................................. [6150000]
.................................................. [6200000]
.................................................. [6250000]
.................................................. [6300000]
.................................................. [6350000]
.................................................. [6400000]
.................................................. [6450000]
.................................................. [6500000]
.................................................. [6550000]
.................................................. [6600000]
.................................................. [6650000]
.................................................. [6700000]
.................................................. [6750000]
.................................................. [6800000]
.................................
  log_e likelihood: -2.30788e+08
  log_2 likelihood: -3.32957e+08
     cross entropy: 2.48403
        perplexity: 5.59459
      posterior p0: 0.0163097
 posterior al-feat: -0.0550771
       size counts: 164
  1  model al-feat: -0.0881056 (tension=9.34126)
  2  model al-feat: -0.0825106 (tension=10.0018)
  3  model al-feat: -0.078305 (tension=10.5505)
  4  model al-feat: -0.0750185 (tension=11.0151)
  5  model al-feat: -0.0723773 (tension=11.4139)
  6  model al-feat: -0.0702091 (tension=11.7599)
  7  model al-feat: -0.0683998 (tension=12.0625)
  8  model al-feat: -0.0668697 (tension=12.329)
     final tension: 12.5648
ITERATION 4
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
.................................................. [750000]
.................................................. [800000]
.................................................. [850000]
.................................................. [900000]
.................................................. [950000]
.................................................. [1000000]
.................................................. [1050000]
.................................................. [1100000]
.................................................. [1150000]
.................................................. [1200000]
.................................................. [1250000]
.................................................. [1300000]
.................................................. [1350000]
.................................................. [1400000]
.................................................. [1450000]
.................................................. [1500000]
.................................................. [1550000]
.................................................. [1600000]
.................................................. [1650000]
.................................................. [1700000]
.................................................. [1750000]
.................................................. [1800000]
.................................................. [1850000]
.................................................. [1900000]
.................................................. [1950000]
.................................................. [2000000]
.................................................. [2050000]
.................................................. [2100000]
.................................................. [2150000]
.................................................. [2200000]
.................................................. [2250000]
.................................................. [2300000]
.................................................. [2350000]
.................................................. [2400000]
.................................................. [2450000]
.................................................. [2500000]
.................................................. [2550000]
.................................................. [2600000]
.................................................. [2650000]
.................................................. [2700000]
.................................................. [2750000]
.................................................. [2800000]
.................................................. [2850000]
.................................................. [2900000]
.................................................. [2950000]
.................................................. [3000000]
.................................................. [3050000]
.................................................. [3100000]
.................................................. [3150000]
.................................................. [3200000]
.................................................. [3250000]
.................................................. [3300000]
.................................................. [3350000]
.................................................. [3400000]
.................................................. [3450000]
.................................................. [3500000]
.................................................. [3550000]
.................................................. [3600000]
.................................................. [3650000]
.................................................. [3700000]
.................................................. [3750000]
.................................................. [3800000]
.................................................. [3850000]
.................................................. [3900000]
.................................................. [3950000]
.................................................. [4000000]
.................................................. [4050000]
.................................................. [4100000]
.................................................. [4150000]
.................................................. [4200000]
.................................................. [4250000]
.................................................. [4300000]
.................................................. [4350000]
.................................................. [4400000]
.................................................. [4450000]
.................................................. [4500000]
.................................................. [4550000]
.................................................. [4600000]
.................................................. [4650000]
.................................................. [4700000]
.................................................. [4750000]
.................................................. [4800000]
.................................................. [4850000]
.................................................. [4900000]
.................................................. [4950000]
.................................................. [5000000]
.................................................. [5050000]
.................................................. [5100000]
.................................................. [5150000]
.................................................. [5200000]
.................................................. [5250000]
.................................................. [5300000]
.................................................. [5350000]
.................................................. [5400000]
.................................................. [5450000]
.................................................. [5500000]
.................................................. [5550000]
.................................................. [5600000]
.................................................. [5650000]
.................................................. [5700000]
.................................................. [5750000]
.................................................. [5800000]
.................................................. [5850000]
.................................................. [5900000]
.................................................. [5950000]
.................................................. [6000000]
.................................................. [6050000]
.................................................. [6100000]
.................................................. [6150000]
.................................................. [6200000]
.................................................. [6250000]
.................................................. [6300000]
.................................................. [6350000]
.................................................. [6400000]
.................................................. [6450000]
.................................................. [6500000]
.................................................. [6550000]
.................................................. [6600000]
.................................................. [6650000]
.................................................. [6700000]
.................................................. [6750000]
.................................................. [6800000]
.................................
  log_e likelihood: -1.79896e+08
  log_2 likelihood: -2.59536e+08
     cross entropy: 1.93627
        perplexity: 3.82715
      posterior p0: 0.0165254
 posterior al-feat: -0.0522026
       size counts: 164
  1  model al-feat: -0.065562 (tension=12.5648)
  2  model al-feat: -0.0641306 (tension=12.832)
  3  model al-feat: -0.0628953 (tension=13.0706)
  4  model al-feat: -0.0618207 (tension=13.2844)
  5  model al-feat: -0.0608795 (tension=13.4768)
  6  model al-feat: -0.0600501 (tension=13.6503)
  7  model al-feat: -0.0593157 (tension=13.8073)
  8  model al-feat: -0.0586625 (tension=13.9496)
     final tension: 14
ITERATION 5 (FINAL)
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
.................................................. [750000]
.................................................. [800000]
.................................................. [850000]
.................................................. [900000]
.................................................. [950000]
.................................................. [1000000]
.................................................. [1050000]
.................................................. [1100000]
.................................................. [1150000]
.................................................. [1200000]
.................................................. [1250000]
.................................................. [1300000]
.................................................. [1350000]
.................................................. [1400000]
.................................................. [1450000]
.................................................. [1500000]
.................................................. [1550000]
.................................................. [1600000]
.................................................. [1650000]
.................................................. [1700000]
.................................................. [1750000]
.................................................. [1800000]
.................................................. [1850000]
.................................................. [1900000]
.................................................. [1950000]
.................................................. [2000000]
.................................................. [2050000]
.................................................. [2100000]
.................................................. [2150000]
.................................................. [2200000]
.................................................. [2250000]
.................................................. [2300000]
.................................................. [2350000]
.................................................. [2400000]
.................................................. [2450000]
.................................................. [2500000]
.................................................. [2550000]
.................................................. [2600000]
.................................................. [2650000]
.................................................. [2700000]
.................................................. [2750000]
.................................................. [2800000]
.................................................. [2850000]
.................................................. [2900000]
.................................................. [2950000]
.................................................. [3000000]
.................................................. [3050000]
.................................................. [3100000]
.................................................. [3150000]
.................................................. [3200000]
.................................................. [3250000]
.................................................. [3300000]
.................................................. [3350000]
.................................................. [3400000]
.................................................. [3450000]
.................................................. [3500000]
.................................................. [3550000]
.................................................. [3600000]
.................................................. [3650000]
.................................................. [3700000]
.................................................. [3750000]
.................................................. [3800000]
.................................................. [3850000]
.................................................. [3900000]
.................................................. [3950000]
.................................................. [4000000]
.................................................. [4050000]
.................................................. [4100000]
.................................................. [4150000]
.................................................. [4200000]
.................................................. [4250000]
.................................................. [4300000]
.................................................. [4350000]
.................................................. [4400000]
.................................................. [4450000]
.................................................. [4500000]
.................................................. [4550000]
.................................................. [4600000]
.................................................. [4650000]
.................................................. [4700000]
.................................................. [4750000]
.................................................. [4800000]
.................................................. [4850000]
.................................................. [4900000]
.................................................. [4950000]
.................................................. [5000000]
.................................................. [5050000]
.................................................. [5100000]
.................................................. [5150000]
.................................................. [5200000]
.................................................. [5250000]
.................................................. [5300000]
.................................................. [5350000]
.................................................. [5400000]
.................................................. [5450000]
.................................................. [5500000]
.................................................. [5550000]
.................................................. [5600000]
.................................................. [5650000]
.................................................. [5700000]
.................................................. [5750000]
.................................................. [5800000]
.................................................. [5850000]
.................................................. [5900000]
.................................................. [5950000]
.................................................. [6000000]
.................................................. [6050000]
.................................................. [6100000]
.................................................. [6150000]
.................................................. [6200000]
.................................................. [6250000]
.................................................. [6300000]
.................................................. [6350000]
.................................................. [6400000]
.................................................. [6450000]
.................................................. [6500000]
.................................................. [6550000]
.................................................. [6600000]
.................................................. [6650000]
.................................................. [6700000]
.................................................. [6750000]
.................................................. [6800000]
.................................
  log_e likelihood: -1.65516e+08
  log_2 likelihood: -2.3879e+08
     cross entropy: 1.7815
        perplexity: 3.43782
      posterior p0: 0
 posterior al-feat: 0
       size counts: 164
conditional probabilities: fwd_params