Introduction

Catalan - Galician translation model for OpenNMT. These are the same models that we have in production at https://www.softcatala.org/traductor/. The models are quantified for low latency.

Usage

Install the necessary dependencies:

pip3 install ctranslate2 pyonmttok

Simple tokenization & translation using Python:

import ctranslate2
import pyonmttok
from huggingface_hub import snapshot_download
model_dir = snapshot_download(repo_id="softcatala/translate-cat-glg", revision="main")

tokenizer=pyonmttok.Tokenizer(mode="none", sp_model_path = model_dir + "/sp_m.model")
tokenized=tokenizer.tokenize("Hola amics")

translator = ctranslate2.Translator(model_dir)
translated = translator.translate_batch([tokenized[0]])
print(tokenizer.detokenize(translated[0][0]['tokens']))

Benchmarks

testset BLEU
test dataset (from train/dev/test) 69.4
Flores200 dataset 32.2

Additional information

Downloads last month
10
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.