
# OPT-1.3B fine-tuned on officially translated light novels.

Fine-tuned [OPT-1.3b](https://huggingface.co/facebook/opt-1.3b) on 2,500 light novel volumes (~825MB of text).

| Epoch              | Test Loss | Train Loss |
|--------------------|-----------|------------|
| 0 (Not fine-tuned) | 4.9080    | N/A        |
| 1                  | 2.1659    | 2.0625     |
| 2                  | 2.0758    | 1.8504     |
| 3                  | 2.0222    | 1.7778     |
| 4                  | 1.9780    | 1.5146     |
| 5                  | 1.9463    | 1.5302     |

{"language": "en", "license": "other", "tags": ["text-generation", "opt"], "inference": false, "commercial": false}
transformers pytorch opt text-generation en license:other autotrain_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #opt #text-generation #en #license-other #autotrain_compatible #text-generation-inference #region-us 

OPT-1.3B fine-tuned on officially translated light novels.
==========================================================


Fine-tuned OPT-1.3b on 2,500 light novel volumes (~825MB of text).


Epoch: 0 (Not fine-tuned), Test Loss: 4.9080, Train Loss: N/A
Epoch: 1, Test Loss: 2.1659, Train Loss: 2.0625
Epoch: 2, Test Loss: 2.0758, Train Loss: 1.8504
Epoch: 3, Test Loss: 2.0222, Train Loss: 1.7778
Epoch: 4, Test Loss: 1.9780, Train Loss: 1.5146
Epoch: 5, Test Loss: 1.9463, Train Loss: 1.5302



TAGS
#transformers #pytorch #opt #text-generation #en #license-other #autotrain_compatible #text-generation-inference #region-us 

passage: TAGS
#transformers #pytorch #opt #text-generation #en #license-other #autotrain_compatible #text-generation-inference #region-us 
