pytorch wav2vec2 automatic-speech-recognition dataset:common_voice transformers generated_from_trainer license:apache-2.0 model-index
---
license: apache-2.0
tags:
- generated_from_trainer
datasets:
- common_voice
model-index:
- name: wav2vec2-xls-r-300m-ar-12
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-xls-r-300m-ar-12

This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the common_voice dataset.
It achieves the following results on the evaluation set:
- Loss: 77.9014
- Wer: 0.1633

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 64
- eval_batch_size: 16
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 256
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 200
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Wer    |
|:-------------:|:-----:|:-----:|:---------------:|:------:|
| 16832.9559    | 1.0   | 85    | 1596.5383       | 1.0    |
| 4748.8934     | 2.0   | 170   | 698.8426        | 1.0    |
| 2939.1952     | 3.0   | 255   | 633.2770        | 1.0    |
| 2833.7857     | 4.0   | 340   | 615.9734        | 1.0    |
| 2778.75       | 5.0   | 425   | 609.7852        | 1.0    |
| 2603.4421     | 6.0   | 510   | 435.0911        | 0.9998 |
| 1420.6594     | 7.0   | 595   | 165.1980        | 0.7542 |
| 811.7357      | 8.0   | 680   | 117.7532        | 0.5570 |
| 582.7924      | 9.0   | 765   | 93.8724         | 0.4447 |
| 469.1885      | 10.0  | 850   | 87.4084         | 0.3961 |
| 399.7348      | 11.0  | 935   | 78.7740         | 0.3562 |
| 348.0169      | 12.0  | 1020  | 72.9545         | 0.3278 |
| 314.0225      | 13.0  | 1105  | 70.8449         | 0.3149 |
| 281.4823      | 14.0  | 1190  | 66.1416         | 0.3013 |
| 263.0267      | 15.0  | 1275  | 66.6624         | 0.2761 |
| 238.7656      | 16.0  | 1360  | 66.3659         | 0.2742 |
| 227.9712      | 17.0  | 1445  | 65.1213         | 0.2616 |
| 209.4785      | 18.0  | 1530  | 66.3502         | 0.2600 |
| 198.6275      | 19.0  | 1615  | 66.7867         | 0.2589 |
| 189.7333      | 20.0  | 1700  | 65.1457         | 0.2499 |
| 183.3984      | 21.0  | 1785  | 68.7480         | 0.2534 |
| 174.6036      | 22.0  | 1870  | 67.8124         | 0.2480 |
| 167.1744      | 23.0  | 1955  | 70.3643         | 0.2438 |
| 160.6194      | 24.0  | 2040  | 68.3434         | 0.2387 |
| 154.096       | 25.0  | 2125  | 69.3449         | 0.2391 |
| 148.2008      | 26.0  | 2210  | 66.6332         | 0.2359 |
| 143.9339      | 27.0  | 2295  | 67.2253         | 0.2292 |
| 143.2862      | 28.0  | 2380  | 68.5232         | 0.2299 |
| 136.5192      | 29.0  | 2465  | 71.3180         | 0.2286 |
| 138.1667      | 30.0  | 2550  | 68.1166         | 0.2241 |
| 129.6961      | 31.0  | 2635  | 69.9885         | 0.2270 |
| 125.0034      | 32.0  | 2720  | 68.5696         | 0.2288 |
| 122.382       | 33.0  | 2805  | 69.9053         | 0.2237 |
| 121.4687      | 34.0  | 2890  | 72.5378         | 0.2325 |
| 121.637       | 35.0  | 2975  | 74.0948         | 0.2302 |
| 114.8182      | 36.0  | 3060  | 71.6004         | 0.2236 |
| 114.9692      | 37.0  | 3145  | 73.0708         | 0.2215 |
| 111.2695      | 38.0  | 3230  | 70.1939         | 0.2172 |
| 109.1332      | 39.0  | 3315  | 73.6910         | 0.2216 |
| 109.5747      | 40.0  | 3400  | 73.0911         | 0.2192 |
| 112.0337      | 41.0  | 3485  | 72.5238         | 0.2285 |
| 102.5452      | 42.0  | 3570  | 73.1730         | 0.2156 |
| 104.4951      | 43.0  | 3655  | 70.9824         | 0.2116 |
| 100.2483      | 44.0  | 3740  | 77.4810         | 0.2141 |
| 100.7275      | 45.0  | 3825  | 70.5330         | 0.2131 |
| 97.4453       | 46.0  | 3910  | 69.3713         | 0.2117 |
| 97.4768       | 47.0  | 3995  | 78.6786         | 0.2150 |
| 97.9564       | 48.0  | 4080  | 74.7395         | 0.2080 |
| 95.7626       | 49.0  | 4165  | 73.5510         | 0.2165 |
| 94.4995       | 50.0  | 4250  | 71.3337         | 0.2152 |
| 92.4394       | 51.0  | 4335  | 74.3506         | 0.2091 |
| 89.1442       | 52.0  | 4420  | 71.3629         | 0.2076 |
| 89.8932       | 53.0  | 4505  | 70.2986         | 0.2119 |
| 88.6913       | 54.0  | 4590  | 71.3645         | 0.2077 |
| 91.1411       | 55.0  | 4675  | 74.9795         | 0.2166 |
| 87.5678       | 56.0  | 4760  | 77.4106         | 0.2081 |
| 83.0826       | 57.0  | 4845  | 75.1502         | 0.2099 |
| 83.7437       | 58.0  | 4930  | 74.9253         | 0.2071 |
| 85.8112       | 59.0  | 5015  | 70.0373         | 0.2067 |
| 81.7675       | 60.0  | 5100  | 76.5425         | 0.2156 |
| 81.6714       | 61.0  | 5185  | 75.3845         | 0.2083 |
| 81.9356       | 62.0  | 5270  | 74.8665         | 0.2069 |
| 77.8237       | 63.0  | 5355  | 74.6538         | 0.2036 |
| 79.3037       | 64.0  | 5440  | 73.3461         | 0.2006 |
| 81.3878       | 65.0  | 5525  | 72.3601         | 0.2022 |
| 77.7095       | 66.0  | 5610  | 72.7715         | 0.2034 |
| 76.6013       | 67.0  | 5695  | 78.5694         | 0.2073 |
| 74.7015       | 68.0  | 5780  | 72.6246         | 0.2032 |
| 76.637        | 69.0  | 5865  | 73.9210         | 0.2095 |
| 74.1983       | 70.0  | 5950  | 75.4212         | 0.1995 |
| 73.328        | 71.0  | 6035  | 76.0840         | 0.1958 |
| 73.2174       | 72.0  | 6120  | 75.8443         | 0.2006 |
| 73.2776       | 73.0  | 6205  | 80.3562         | 0.2058 |
| 69.7834       | 74.0  | 6290  | 77.4640         | 0.2018 |
| 70.2896       | 75.0  | 6375  | 75.3303         | 0.1989 |
| 67.4863       | 76.0  | 6460  | 76.7881         | 0.2021 |
| 69.5997       | 77.0  | 6545  | 73.3460         | 0.1990 |
| 66.8822       | 78.0  | 6630  | 76.5326         | 0.2000 |
| 68.8483       | 79.0  | 6715  | 75.6460         | 0.1996 |
| 64.6421       | 80.0  | 6800  | 73.5708         | 0.1966 |
| 65.7658       | 81.0  | 6885  | 79.4043         | 0.1981 |
| 68.3581       | 82.0  | 6970  | 74.2181         | 0.1995 |
| 66.8769       | 83.0  | 7055  | 74.5230         | 0.1970 |
| 63.3021       | 84.0  | 7140  | 78.5190         | 0.1968 |
| 61.6227       | 85.0  | 7225  | 77.4760         | 0.1974 |
| 62.5638       | 86.0  | 7310  | 79.0764         | 0.1979 |
| 63.4932       | 87.0  | 7395  | 77.3330         | 0.1938 |
| 60.8015       | 88.0  | 7480  | 74.0066         | 0.1913 |
| 60.5176       | 89.0  | 7565  | 76.4915         | 0.1930 |
| 61.0698       | 90.0  | 7650  | 76.3846         | 0.1936 |
| 61.2012       | 91.0  | 7735  | 77.7306         | 0.1916 |
| 59.9138       | 92.0  | 7820  | 74.8689         | 0.1904 |
| 59.955        | 93.0  | 7905  | 77.6994         | 0.1921 |
| 60.1327       | 94.0  | 7990  | 77.2062         | 0.1896 |
| 57.2662       | 95.0  | 8075  | 78.6637         | 0.1926 |
| 60.3225       | 96.0  | 8160  | 79.5939         | 0.1921 |
| 56.1769       | 97.0  | 8245  | 79.2807         | 0.1917 |
| 56.4212       | 98.0  | 8330  | 76.9330         | 0.1904 |
| 55.0239       | 99.0  | 8415  | 76.5063         | 0.1890 |
| 54.8932       | 100.0 | 8500  | 76.7235         | 0.1866 |
| 55.0942       | 101.0 | 8585  | 74.4022         | 0.1875 |
| 53.9534       | 102.0 | 8670  | 76.1983         | 0.1855 |
| 54.8974       | 103.0 | 8755  | 74.1427         | 0.1834 |
| 53.0833       | 104.0 | 8840  | 74.4284         | 0.1845 |
| 54.4095       | 105.0 | 8925  | 73.8318         | 0.1840 |
| 53.0103       | 106.0 | 9010  | 75.3837         | 0.1858 |
| 52.1488       | 107.0 | 9095  | 75.4422         | 0.1845 |
| 52.6274       | 108.0 | 9180  | 81.5232         | 0.1882 |
| 49.8969       | 109.0 | 9265  | 76.7468         | 0.1905 |
| 50.2353       | 110.0 | 9350  | 77.5954         | 0.1889 |
| 48.6322       | 111.0 | 9435  | 77.4254         | 0.1868 |
| 49.8443       | 112.0 | 9520  | 75.5615         | 0.1834 |
| 48.3942       | 113.0 | 9605  | 75.4467         | 0.1829 |
| 50.5596       | 114.0 | 9690  | 76.4219         | 0.1894 |
| 49.3698       | 115.0 | 9775  | 74.8749         | 0.1846 |
| 49.8104       | 116.0 | 9860  | 77.8855         | 0.1846 |
| 46.308        | 117.0 | 9945  | 77.7105         | 0.1877 |
| 48.2955       | 118.0 | 10030 | 75.8736         | 0.1887 |
| 48.086        | 119.0 | 10115 | 78.3174         | 0.1856 |
| 47.3039       | 120.0 | 10200 | 77.9972         | 0.1818 |
| 44.4335       | 121.0 | 10285 | 77.9906         | 0.1831 |
| 44.79         | 122.0 | 10370 | 77.6622         | 0.1829 |
| 45.2491       | 123.0 | 10455 | 74.7864         | 0.1788 |
| 43.4817       | 124.0 | 10540 | 79.8335         | 0.1840 |
| 42.8565       | 125.0 | 10625 | 77.1184         | 0.1823 |
| 43.3137       | 126.0 | 10710 | 78.8980         | 0.1806 |
| 47.5019       | 127.0 | 10795 | 76.0757         | 0.1802 |
| 42.8448       | 128.0 | 10880 | 74.3782         | 0.1805 |
| 43.371        | 129.0 | 10965 | 75.9817         | 0.1763 |
| 42.5875       | 130.0 | 11050 | 75.2765         | 0.1790 |
| 41.3362       | 131.0 | 11135 | 76.6064         | 0.1771 |
| 42.0271       | 132.0 | 11220 | 75.4263         | 0.1784 |
| 39.8784       | 133.0 | 11305 | 77.8300         | 0.1794 |
| 40.6921       | 134.0 | 11390 | 78.6296         | 0.1792 |
| 39.4606       | 135.0 | 11475 | 79.6816         | 0.1778 |
| 37.5287       | 136.0 | 11560 | 78.0326         | 0.1782 |
| 41.5487       | 137.0 | 11645 | 77.2891         | 0.1758 |
| 41.2244       | 138.0 | 11730 | 75.5363         | 0.1758 |
| 38.8745       | 139.0 | 11815 | 78.4477         | 0.1757 |
| 39.4361       | 140.0 | 11900 | 74.8600         | 0.1745 |
| 37.9799       | 141.0 | 11985 | 74.5921         | 0.1767 |
| 40.0375       | 142.0 | 12070 | 75.4366         | 0.1755 |
| 38.1776       | 143.0 | 12155 | 76.9755         | 0.1757 |
| 39.0457       | 144.0 | 12240 | 78.5006         | 0.1783 |
| 36.8371       | 145.0 | 12325 | 74.9189         | 0.1755 |
| 36.6938       | 146.0 | 12410 | 78.4304         | 0.1746 |
| 35.208        | 147.0 | 12495 | 79.0332         | 0.1774 |
| 36.08         | 148.0 | 12580 | 77.9339         | 0.1746 |
| 37.4205       | 149.0 | 12665 | 76.0473         | 0.1748 |
| 36.1532       | 150.0 | 12750 | 77.6417         | 0.1740 |
| 36.4478       | 151.0 | 12835 | 77.7077         | 0.1740 |
| 35.2669       | 152.0 | 12920 | 77.4225         | 0.1728 |
| 33.9716       | 153.0 | 13005 | 76.0476         | 0.1722 |
| 33.7335       | 154.0 | 13090 | 75.8777         | 0.1717 |
| 33.2638       | 155.0 | 13175 | 78.7736         | 0.1716 |
| 32.744        | 156.0 | 13260 | 75.9818         | 0.1692 |
| 33.7618       | 157.0 | 13345 | 77.9544         | 0.1705 |
| 32.5823       | 158.0 | 13430 | 74.5033         | 0.1710 |
| 32.435        | 159.0 | 13515 | 77.1456         | 0.1703 |
| 32.631        | 160.0 | 13600 | 75.2885         | 0.1706 |
| 31.8537       | 161.0 | 13685 | 76.6699         | 0.1674 |
| 32.7374       | 162.0 | 13770 | 77.5112         | 0.1679 |
| 31.7985       | 163.0 | 13855 | 77.2261         | 0.1686 |
| 33.4709       | 164.0 | 13940 | 77.0829         | 0.1688 |
| 32.5837       | 165.0 | 14025 | 81.3337         | 0.1688 |
| 31.3551       | 166.0 | 14110 | 77.3803         | 0.1672 |
| 30.5367       | 167.0 | 14195 | 79.0103         | 0.1689 |
| 30.7095       | 168.0 | 14280 | 77.3184         | 0.1683 |
| 31.0545       | 169.0 | 14365 | 77.5170         | 0.1675 |
| 29.7835       | 170.0 | 14450 | 76.5517         | 0.1661 |
| 24.643        | 171.0 | 14535 | 77.7856         | 0.1684 |
| 29.8659       | 172.0 | 14620 | 78.2275         | 0.1689 |
| 29.8893       | 173.0 | 14705 | 76.9425         | 0.1677 |
| 29.0071       | 174.0 | 14790 | 76.2374         | 0.1674 |
| 28.8064       | 175.0 | 14875 | 77.7253         | 0.1657 |
| 28.1371       | 176.0 | 14960 | 77.0664         | 0.1666 |
| 28.3809       | 177.0 | 15045 | 77.4184         | 0.1659 |
| 27.953        | 178.0 | 15130 | 77.5284         | 0.1651 |
| 29.4455       | 179.0 | 15215 | 76.8801         | 0.1647 |
| 27.7792       | 180.0 | 15300 | 75.6964         | 0.1638 |
| 29.7077       | 181.0 | 15385 | 77.7636         | 0.1648 |
| 28.0373       | 182.0 | 15470 | 77.2047         | 0.1655 |
| 27.5775       | 183.0 | 15555 | 77.2836         | 0.1631 |
| 26.3244       | 184.0 | 15640 | 77.2574         | 0.1645 |
| 27.4902       | 185.0 | 15725 | 77.4289         | 0.1649 |
| 27.4503       | 186.0 | 15810 | 76.1098         | 0.1636 |
| 25.7041       | 187.0 | 15895 | 77.4126         | 0.1627 |
| 26.0029       | 188.0 | 15980 | 77.8391         | 0.1640 |
| 26.2039       | 189.0 | 16065 | 77.9678         | 0.1644 |
| 25.3233       | 190.0 | 16150 | 77.9595         | 0.1636 |
| 26.3017       | 191.0 | 16235 | 77.7247         | 0.1640 |
| 25.3848       | 192.0 | 16320 | 77.0303         | 0.1631 |
| 26.489        | 193.0 | 16405 | 77.0221         | 0.1632 |
| 24.5612       | 194.0 | 16490 | 77.1831         | 0.1632 |
| 24.3228       | 195.0 | 16575 | 77.3499         | 0.1638 |
| 24.7961       | 196.0 | 16660 | 77.6399         | 0.1633 |
| 26.368        | 197.0 | 16745 | 77.8759         | 0.1639 |
| 26.0979       | 198.0 | 16830 | 77.9501         | 0.1634 |
| 26.2053       | 199.0 | 16915 | 77.8439         | 0.1633 |
| 25.9718       | 200.0 | 17000 | 77.9014         | 0.1633 |


### Framework versions

- Transformers 4.17.0
- Pytorch 1.11.0
- Datasets 1.18.4
- Tokenizers 0.12.1
