![](https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true)
# FineTuning 
|       **Architecture**      |     **Weights**     | **Training Loss** | **Validation Loss** |
|:-----------------------:|:---------------:|:----------------:|:----------------------:|
|       roberta-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-base) |      **0.641**      |          **0.4728**         |
|    bert-base-uncased    | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-base-uncased) |      0.6781     |          0.4977         |
|      albert-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-base) |       0.7119      |          0.5155         |
|       xlm-roberta-base       | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-xlm-roberta-base) |      0.7225      |          0.525          |
|      bert-large-uncased      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-large-uncased) |      0.7482      |         0.5161         |
|       albert-large      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-large) |      1.075      |          0.9921         |
| roberta-large | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-large) |       2.749      |          1.075         |

{"license": "cc0-1.0", "tags": ["kaggle"], "datasets": ["Commonlit-Readibility"], "thumbnail": "https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true"}
transformers pytorch albert fill-mask kaggle dataset:Commonlit-Readibility license:cc0-1.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #albert #fill-mask #kaggle #dataset-Commonlit-Readibility #license-cc0-1.0 #autotrain_compatible #endpoints_compatible #region-us 

![](URL


FineTuning
==========




TAGS
#transformers #pytorch #albert #fill-mask #kaggle #dataset-Commonlit-Readibility #license-cc0-1.0 #autotrain_compatible #endpoints_compatible #region-us 

passage: TAGS
#transformers #pytorch #albert #fill-mask #kaggle #dataset-Commonlit-Readibility #license-cc0-1.0 #autotrain_compatible #endpoints_compatible #region-us 
