
# Charmen-Electra

A byte-based transformer model trained on Hungarian language. In order to use the model you will need a custom Tokenizer which is available at: [https://github.com/szegedai/byte-offset-tokenizer](https://github.com/szegedai/byte-offset-tokenizer).

Since we use a custom architecture with Gradient Boosting, Down- and Up-Sampling, you have to enable Trusted Remote Code like:

```python
model = AutoModel.from_pretrained("SzegedAI/charmen-electra", trust_remote_code=True)
```
# Acknowledgement
[![Artificial Intelligence - National Laboratory - Hungary](https://milab.tk.hu/uploads/images/milab_logo_en.png)](https://mi.nemzetilabor.hu/)
{"language": "hu", "license": "apache-2.0", "tags": ["byte representation", "gradient boosting", "hungarian"], "datasets": ["common_crawl", "wikipedia"]}
transformers pytorch feature-extraction byte representation gradient boosting hungarian custom_code hu dataset:common_crawl dataset:wikipedia license:apache-2.0 region:us
TAGS
#transformers #pytorch #feature-extraction #byte representation #gradient boosting #hungarian #custom_code #hu #dataset-common_crawl #dataset-wikipedia #license-apache-2.0 #region-us 


# Charmen-Electra

A byte-based transformer model trained on Hungarian language. In order to use the model you will need a custom Tokenizer which is available at: URL

Since we use a custom architecture with Gradient Boosting, Down- and Up-Sampling, you have to enable Trusted Remote Code like:


# Acknowledgement
![Artificial Intelligence - National Laboratory - Hungary](URL
# Charmen-Electra

A byte-based transformer model trained on Hungarian language. In order to use the model you will need a custom Tokenizer which is available at: URL

Since we use a custom architecture with Gradient Boosting, Down- and Up-Sampling, you have to enable Trusted Remote Code like: # Acknowledgement
![Artificial Intelligence - National Laboratory - Hungary](URL
TAGS
#transformers #pytorch #feature-extraction #byte representation #gradient boosting #hungarian #custom_code #hu #dataset-common_crawl #dataset-wikipedia #license-apache-2.0 #region-us 
 # Charmen-Electra

A byte-based transformer model trained on Hungarian language. In order to use the model you will need a custom Tokenizer which is available at: URL

Since we use a custom architecture with Gradient Boosting, Down- and Up-Sampling, you have to enable Trusted Remote Code like: # Acknowledgement
![Artificial Intelligence - National Laboratory - Hungary](URL
passage: TAGS
#transformers #pytorch #feature-extraction #byte representation #gradient boosting #hungarian #custom_code #hu #dataset-common_crawl #dataset-wikipedia #license-apache-2.0 #region-us 
# Charmen-Electra

A byte-based transformer model trained on Hungarian language. In order to use the model you will need a custom Tokenizer which is available at: URL

Since we use a custom architecture with Gradient Boosting, Down- and Up-Sampling, you have to enable Trusted Remote Code like:# Acknowledgement
![Artificial Intelligence - National Laboratory - Hungary](URL