diff --git a/README.md b/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..bc5f30d6632ac0efdc7be2e9095e9e9579af2e33
--- /dev/null
+++ b/README.md
@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
\ No newline at end of file
diff --git a/config.json b/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..6f0f890a586140cdbb0d7b9ebb535809447e5117
--- /dev/null
+++ b/config.json
@@ -0,0 +1,24 @@
+{
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.53.0.dev0",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}
diff --git a/model-00001-of-00081.safetensors b/model-00001-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d9563209a7c9e5927c441980cfdea27056f13584
--- /dev/null
+++ b/model-00001-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:922780b4082292e2c1bcde2e7237c2a378f29869dff8a5419e58d12acbfb3f54
+size 93763728
diff --git a/model-00002-of-00081.safetensors b/model-00002-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..49120b44c9d07ec6fbfa640cba0aa1767ea560a6
--- /dev/null
+++ b/model-00002-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e09e9db959249eeb7a9f3ec972e369e2f70348c471730e585f8c3dea71e8896
+size 1573008
diff --git a/model-00003-of-00081.safetensors b/model-00003-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..716e398b7589106938e83fc7ad381bee81f47910
--- /dev/null
+++ b/model-00003-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0bba7c4cc3c09348194179daecd9f048f808350908d9628f16e77f981951b547
+size 2359448
diff --git a/model-00004-of-00081.safetensors b/model-00004-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..09fef2e7ab75ec4b81c46465222079dd75c3f643
--- /dev/null
+++ b/model-00004-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa96cc94caf506ea2ce21e2cacdc4c1df6f742cbaa7b2dd166f994a4c5072b64
+size 2359448
diff --git a/model-00005-of-00081.safetensors b/model-00005-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..81a527ff034a1f05b2853618afcf75b57859a878
--- /dev/null
+++ b/model-00005-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a73579bc7b1b7e550c2db2d15262998f38636331d4bb2812d9b51ac6f33cea1b
+size 2359448
diff --git a/model-00006-of-00081.safetensors b/model-00006-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..86ffec3c9b38bfe08a5d5df7388b955b089b0479
--- /dev/null
+++ b/model-00006-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e363ed3e935be55b27e01a0ac111aeb8394a89baefd6a5af0a29e647e32b598
+size 2359448
diff --git a/model-00007-of-00081.safetensors b/model-00007-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..43396945b73c446befd7b735eaa989144e191b08
--- /dev/null
+++ b/model-00007-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b09703f318aa71ecdf1a85502c461ab87ca4861b62e31727d05cc3cb966a347
+size 9437336
diff --git a/model-00008-of-00081.safetensors b/model-00008-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..94c672229bce1291cc0889cd2d34a417829fdf7d
--- /dev/null
+++ b/model-00008-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:34d6f20112256fdd3924dfc5d3b0a56d152f5e74d7b3e17b393deabc495ad494
+size 9437328
diff --git a/model-00009-of-00081.safetensors b/model-00009-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..a081e8dbf945fabcaa6df05f39fd27f7e68d4505
--- /dev/null
+++ b/model-00009-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5780d866c201d569c825dc4d8b1ed3ba0e3f7f73062e8e8fb95e4e5669760e00
+size 2359448
diff --git a/model-00010-of-00081.safetensors b/model-00010-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c69e670766bf186b52b9d9dbcadc281084e5c0a6
--- /dev/null
+++ b/model-00010-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a298df281953bef2529f2bf205d632ac3992faee5cb7a55d50f32cb3a6d7877
+size 2359448
diff --git a/model-00011-of-00081.safetensors b/model-00011-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4242beb2669c5170bae8f86dc958c6d37aa657c2
--- /dev/null
+++ b/model-00011-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1618f829e4bdc29b8250f79f814b9027fa0096829303a91c70ece8dc7d9e5537
+size 2359448
diff --git a/model-00012-of-00081.safetensors b/model-00012-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dae8a2090d25704945e6fb4a41956977062f8932
--- /dev/null
+++ b/model-00012-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80f84e02773b88dc58c8a8bc57f749866d7a0e01c02181732642ff1061bcdc37
+size 2359448
diff --git a/model-00013-of-00081.safetensors b/model-00013-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ed98c46ee5f5bad2e2d05a3817030e960dff7d1e
--- /dev/null
+++ b/model-00013-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4fa6d8c66915e2a1690d5436d2e38dc1236246633f6faeafc2e67ca2f3561b4
+size 9437336
diff --git a/model-00014-of-00081.safetensors b/model-00014-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b4c218c65c7a52661706ef6cbcba88b9dfd3bc41
--- /dev/null
+++ b/model-00014-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf9b4849c6a244d1877857931a6dc909db9c7c122b6b018c21266f9f5fcf8aea
+size 9437328
diff --git a/model-00015-of-00081.safetensors b/model-00015-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..622b6bc3b4df4e8d4f5c809bc6f2bf926405b30c
--- /dev/null
+++ b/model-00015-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e8439ba0c3650a309fadb0042878bc2b60d3de8295763ae892555118d28bb43
+size 2359448
diff --git a/model-00016-of-00081.safetensors b/model-00016-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7f39638473b8a7551787e1914c1a35135f87afad
--- /dev/null
+++ b/model-00016-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdb04ffdb7c0643be61a539b38261752cd33af5dd6df0a29a49963af19703982
+size 2359448
diff --git a/model-00017-of-00081.safetensors b/model-00017-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b114c37b966f7f8b0eee4d16cc2b477f40e05cc7
--- /dev/null
+++ b/model-00017-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9700faa20e5e2c25870c743578a8656b7f8f6071337905a311210dc510f4cb98
+size 2359448
diff --git a/model-00018-of-00081.safetensors b/model-00018-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..75c3d1adf2a1728f368b77eea84204d7d438ecdb
--- /dev/null
+++ b/model-00018-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e29b1bd724da9d74b4684c89f7c0f84f63d2a2bf3306d657881aeb479b4e99d5
+size 100880
diff --git a/model-00019-of-00081.safetensors b/model-00019-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dbe3e6a476b4a0987d49aba11f5bdbd881af9d10
--- /dev/null
+++ b/model-00019-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:856c087656bf512da7a0b11791f33f4eeb58566614269e728a5f7bd76e4552f7
+size 2359448
diff --git a/model-00020-of-00081.safetensors b/model-00020-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c3a1fed54625f7dfe555cf74c283d81815ff466b
--- /dev/null
+++ b/model-00020-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:182705a0fcd613becabd652f89c3e6e3ed4ba12dd8fc9fd7e27278e9d28c785b
+size 9437336
diff --git a/model-00021-of-00081.safetensors b/model-00021-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7d96e657061a2fd0147d02901b60149a2db90fda
--- /dev/null
+++ b/model-00021-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:25e8e7af278f6741a3097dfc7e0916f552da38f9929032d908e80aee6290ad66
+size 9437328
diff --git a/model-00022-of-00081.safetensors b/model-00022-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..466111776d68c6fad0490d0c46a1c727c79d7eeb
--- /dev/null
+++ b/model-00022-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:afdb3f1f8aa910d309669dea2d4f08a739cd5328fa1114d5ffeff00fed694251
+size 2359448
diff --git a/model-00023-of-00081.safetensors b/model-00023-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..95fcfb58710c551247e7aabe9edce50f9d8dbe8e
--- /dev/null
+++ b/model-00023-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5bf295344203061e40a27e8b81868de42a4797c31f662b9145302820c3855e39
+size 2359448
diff --git a/model-00024-of-00081.safetensors b/model-00024-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..81749e2cb625861db45e67fe935cbf8088589528
--- /dev/null
+++ b/model-00024-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54fd6faa4ce37cc28a1bcb09f3d9be7f227eab54c88da2ccb8cfa427eef50ec0
+size 2359448
diff --git a/model-00025-of-00081.safetensors b/model-00025-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d79bb77577089d8f3bbc8f6c40ca4c22b3a02bfe
--- /dev/null
+++ b/model-00025-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77a9378818a7ced820fed1c762490b77573eb391b6f30fe003dae762d827d6e5
+size 2359448
diff --git a/model-00026-of-00081.safetensors b/model-00026-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..bbde7169f4604fdd725e78246d01af970264696e
--- /dev/null
+++ b/model-00026-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:632bc17ccedc1882504ee997c4822f11dd675dd2e56938cfb98483073f872d30
+size 9437336
diff --git a/model-00027-of-00081.safetensors b/model-00027-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..1204edefa0b31f456b2a4a4b482c74fd3d560ddc
--- /dev/null
+++ b/model-00027-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fce58536c2b4b00bbe2b4fc383f67e559d779ba20657f13809403cebad50f435
+size 9437328
diff --git a/model-00028-of-00081.safetensors b/model-00028-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..29f441855776125882cd98bca5cc2cd8a0f0c9f3
--- /dev/null
+++ b/model-00028-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4b5fb543c2efe04557eaccb04a004f4e004723c42c3132664224765fced44c1
+size 2359448
diff --git a/model-00029-of-00081.safetensors b/model-00029-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c9950a9de5369dbbcfda8f174d95f28483c8567c
--- /dev/null
+++ b/model-00029-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:205342a6c9af8406858cb55d7f5907054165083fca703cb11bd390b81cd47c18
+size 2359448
diff --git a/model-00030-of-00081.safetensors b/model-00030-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..db44062050c02b0f873b043188a05e4c98fe0342
--- /dev/null
+++ b/model-00030-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71900008fa27cb56f72078dc31f397f9fdd1823309d145c15a764d088c1bacfa
+size 2359448
diff --git a/model-00031-of-00081.safetensors b/model-00031-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..153f6681149c0f9dd4d6966755dae1569f73ed95
--- /dev/null
+++ b/model-00031-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:be2d4cec5fbae648109b07bd49ccc7a0f3b7798b54bff0ed4d10490107f2430c
+size 2359448
diff --git a/model-00032-of-00081.safetensors b/model-00032-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..603740ac91782c161c3ac28a3096e750b4fa1b12
--- /dev/null
+++ b/model-00032-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:15d83def5853b59f27ddd69e2b8e575283548e25cff12b6e901b059bef66be53
+size 9437336
diff --git a/model-00033-of-00081.safetensors b/model-00033-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..bd97ff183e8653c5a4408789ac191292fdc4dfdc
--- /dev/null
+++ b/model-00033-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47b59aafd862ff59c6841d462d0572a137a192159b7b9bfbf978ab55b65bd3a6
+size 94680
diff --git a/model-00034-of-00081.safetensors b/model-00034-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c015dc9483ebc17503aa1d3eb1c4bc1dc235edd6
--- /dev/null
+++ b/model-00034-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a54de327b1f19967a25a303a9f106975e3639a5914a78d41beb7264139aaa70
+size 9437328
diff --git a/model-00035-of-00081.safetensors b/model-00035-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..37cc71016d8adc93b13bd97da9d31c957a6356bb
--- /dev/null
+++ b/model-00035-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7231faa9cee56c1d3002ea864155c7b480b87b64c3333c4706f9f26b6507ff9e
+size 2359448
diff --git a/model-00036-of-00081.safetensors b/model-00036-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..0b040a50096940964633a2bad5be96013388efa9
--- /dev/null
+++ b/model-00036-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61edb41410051bcce8c54e04839990bdd449d43fe0b7b8dd4439002e12b3e89a
+size 2359448
diff --git a/model-00037-of-00081.safetensors b/model-00037-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..aae1269fab08497cb018c059b71bfe9791476c9f
--- /dev/null
+++ b/model-00037-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11e1c1dd57544c54eb00063db3ea3ea3b34e870e7b37a0db82d4154878061a26
+size 2359448
diff --git a/model-00038-of-00081.safetensors b/model-00038-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..359cdf6eaad1557bf7500f425d0a979ba1b7999c
--- /dev/null
+++ b/model-00038-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8385321aa1e73fc68d011c27baa311f35e889d8a6946c2c98e7d6944d6b75e41
+size 2359448
diff --git a/model-00039-of-00081.safetensors b/model-00039-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..e41ba5bc0124252a6ebc053e4cc5360841ce19ef
--- /dev/null
+++ b/model-00039-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c0f44bc5b8f382fc1c3951fc91e52d01b15a8fe82dfcf67d689cdeada704bc7
+size 9437336
diff --git a/model-00040-of-00081.safetensors b/model-00040-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2c3b4ea2fdd8b40869650e35527696b637ee0e92
--- /dev/null
+++ b/model-00040-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:907327ed7e2bf775c2db100d836db1ee921db76e7f1b656d536b5937d3bcdfec
+size 9437328
diff --git a/model-00041-of-00081.safetensors b/model-00041-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..8529dcfc408b39650e8981d1783621bca93204f5
--- /dev/null
+++ b/model-00041-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c6db7c94fd1230455cd5138c06a90928b57932c7c3ee8bfbb7dd894f2f43b2d
+size 2359448
diff --git a/model-00042-of-00081.safetensors b/model-00042-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..e572476fbf9964edfdde418759142d24487fffb5
--- /dev/null
+++ b/model-00042-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c19b86894e639d16c5e990ac387e16972a95665c93fe19551f1c90918b588b42
+size 2359448
diff --git a/model-00043-of-00081.safetensors b/model-00043-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..04d518beec6037dd2f2b89fd7b6f330ade397d0d
--- /dev/null
+++ b/model-00043-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebcce834d69b4dc859150d24e0f234ec658e411c7159adadc407e7c6c82373f0
+size 2359448
diff --git a/model-00044-of-00081.safetensors b/model-00044-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c429630e6860408abc0588edcc96abc1fec7aff1
--- /dev/null
+++ b/model-00044-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28946dd60fa7b5ae309e4b90b6a4825a7056ab39f07bf4929f5fadc52bd8e4ec
+size 2359448
diff --git a/model-00045-of-00081.safetensors b/model-00045-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..e91cd65b2d409f20a0e681929c44c373daf1435e
--- /dev/null
+++ b/model-00045-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2f0bceaa1506593b4470b3a4f44955724e5044c7706b64c8436cc8c43af5c5fc
+size 9437336
diff --git a/model-00046-of-00081.safetensors b/model-00046-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ce5cad7128abb0340ae5ec7b9fd644c1aaa1f5b4
--- /dev/null
+++ b/model-00046-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:58006080fad1460ab87fa89d855089168c93c6a7cb630b0321d9c9bcd8cedd5f
+size 9437328
diff --git a/model-00047-of-00081.safetensors b/model-00047-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ab1f73ed44c7df558ee2c80a2d73766d0b5ecc8b
--- /dev/null
+++ b/model-00047-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e559902be3384a6445d306d7803dc26c3b4a97b764ca58d6acbc9ae82c0f885
+size 100696
diff --git a/model-00048-of-00081.safetensors b/model-00048-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c94678843cf02ee32e251ecc881f335d5785ddcb
--- /dev/null
+++ b/model-00048-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:562133b527f890370f5becaac2872406a189b6736d7e732c37d157baa531e086
+size 2359448
diff --git a/model-00049-of-00081.safetensors b/model-00049-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d9c6766e5b354e721389d07ff734e919283ff53c
--- /dev/null
+++ b/model-00049-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b581c7be9d00f9662acb3d0eb502fecc64192edf3795551988e7096391da5732
+size 2359448
diff --git a/model-00050-of-00081.safetensors b/model-00050-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..a8f12efdd3ae740636def7ac0401d5d53b5ed57a
--- /dev/null
+++ b/model-00050-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ae16bdfc974321a84a4a8c283a48c0646e15f719346fa82d10cba1c0c2c4f12
+size 2359448
diff --git a/model-00051-of-00081.safetensors b/model-00051-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..997aaffd9264ef371a75a029d5559c94d445601c
--- /dev/null
+++ b/model-00051-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80298da1e247db95cf23614e7d9c012a9f0689f21761f235e2a1a21e19a3a3b4
+size 2359448
diff --git a/model-00052-of-00081.safetensors b/model-00052-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..84fdc11eed6b6933b48be80d6ab17cb0442cc84e
--- /dev/null
+++ b/model-00052-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1bbc9e4a1055f3f6d3b6f1f6a4d27968cd8bf0960c074aeaf7c318629824f806
+size 9437336
diff --git a/model-00053-of-00081.safetensors b/model-00053-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..80cfeb7d1ac66cb77d6450d0d054c5b84d5dfd00
--- /dev/null
+++ b/model-00053-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:851db9bd55672540a8e490b9457f8971f379ff1ab978b7cc796042febf40ce00
+size 9437328
diff --git a/model-00054-of-00081.safetensors b/model-00054-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2df757bc700babc544519c0af975c8102648c84e
--- /dev/null
+++ b/model-00054-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d087eadc37ffc26be2f546060af96ae9b4ee2492d5a9aa66856697a731751ddf
+size 2359448
diff --git a/model-00055-of-00081.safetensors b/model-00055-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..1d3fab3ae9b44a442e6251264991479c9634b04b
--- /dev/null
+++ b/model-00055-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f06d5d92ecc6aceda40ad35c2b9e825a787c14be1014ad1e74536b51ac20a64c
+size 2359448
diff --git a/model-00056-of-00081.safetensors b/model-00056-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3cf8b4a819075ba419df21ba242f5e019f402d8c
--- /dev/null
+++ b/model-00056-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f264ec003983752107bdbcca647c590585158a6ffecdfd2215f9b546450d72e4
+size 2359448
diff --git a/model-00057-of-00081.safetensors b/model-00057-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..82ec2eb92cba56959c30dd6637eecb499ce65d02
--- /dev/null
+++ b/model-00057-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6cbe5a99607d477c90ab8ffb1f1fb42b07bc4cf7ea8cafbcc5482f62de9da52c
+size 2359448
diff --git a/model-00058-of-00081.safetensors b/model-00058-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..080f5b06850c9a7d6080ceb80479183758ea8b02
--- /dev/null
+++ b/model-00058-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b8098c531fba270bb6b7e19961b990fb08a81cafbeee2561aee993e236a5501d
+size 9437336
diff --git a/model-00059-of-00081.safetensors b/model-00059-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..110292d78496ce447fb7be2fb5196abe5fc9270b
--- /dev/null
+++ b/model-00059-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4278e7cd018403634be35ba3033772a0fbec919f154eca352100a09e968c2bd1
+size 9437328
diff --git a/model-00060-of-00081.safetensors b/model-00060-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6d43957de5ac9c6190d2446cab4c0c6a52251940
--- /dev/null
+++ b/model-00060-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d383413dda5f4d316096cde7875902226ff494ff2a5609e0e69627ce41f81ee4
+size 2359448
diff --git a/model-00061-of-00081.safetensors b/model-00061-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4187de4ebbd22e21c81a3b3bc2eabf709b14b410
--- /dev/null
+++ b/model-00061-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f87fe67c01848c1b4dfc7b2a8acb7b7f2b8a560f923ecce4a60c37dc3a010d15
+size 2359448
diff --git a/model-00062-of-00081.safetensors b/model-00062-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..78fc50fb47e2f47cbe9896b16f09976c09eba500
--- /dev/null
+++ b/model-00062-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c4d0a43f1df20ffaed909e8de4c75f647d88b90a3a063897fc2f12e6977f1a6d
+size 2359448
diff --git a/model-00063-of-00081.safetensors b/model-00063-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c957d79e807db9ee55679bb04f5cd6a5fe63a7ee
--- /dev/null
+++ b/model-00063-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d604eab8ce901ab3ac58398666d6fa7b5c41fd19fb6ed7428192a54ff9fbca45
+size 2359448
diff --git a/model-00064-of-00081.safetensors b/model-00064-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7bb3d3146dbfdcbb8d99f60acaf9400f31d4f7ff
--- /dev/null
+++ b/model-00064-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:446357f326c109e0aab70acb5f617c48ced7577825ccafc069620b010c58fdf9
+size 101016
diff --git a/model-00065-of-00081.safetensors b/model-00065-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..77ab9a899fb2846668d6c34af3772c91bcde0af5
--- /dev/null
+++ b/model-00065-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:536b401b9ff8a159864a93671b83bb8e769e3dd870005d1c1ba727d46746131f
+size 9437336
diff --git a/model-00066-of-00081.safetensors b/model-00066-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..9061f577ffec99381f1278c4f843d6dac6334bdb
--- /dev/null
+++ b/model-00066-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4616ad36087d6b7f120dbf7d90c3128fddfa82804dfba2a060d496c9294d7f83
+size 9437328
diff --git a/model-00067-of-00081.safetensors b/model-00067-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3c0f06bfa5c1d44a4ed66c4be126e4047fbf10ff
--- /dev/null
+++ b/model-00067-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e0474740b5dd28f8fc3c5c550883edc6eb85bd6d80d5dfe26ccebdbc5215676
+size 2359448
diff --git a/model-00068-of-00081.safetensors b/model-00068-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..bf7f5532b2256ff66c080b87fd82c8e2f781e99b
--- /dev/null
+++ b/model-00068-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:325d029fcee9b521a0af0d74c16af442d504e274f46e0b0ea3518990fb36d300
+size 2359448
diff --git a/model-00069-of-00081.safetensors b/model-00069-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..97e95b07c00684eb31421153bfb1826f5d089a44
--- /dev/null
+++ b/model-00069-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fd09bd056fcc83d597cacb3746f747f8a5551846a42e3ea4d18111617528a40
+size 2359448
diff --git a/model-00070-of-00081.safetensors b/model-00070-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2a5ef3154a3af9c9bd8bb4372956ac61938e1d2d
--- /dev/null
+++ b/model-00070-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20aa90c224b0d666a699311e9bfb374a1c746cbecfddf9b1abcb5cb2d627572e
+size 2359448
diff --git a/model-00071-of-00081.safetensors b/model-00071-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d93087dfa0b7cbcbb03f5534204aa2e380a4bc3e
--- /dev/null
+++ b/model-00071-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:092812abc0f7df0df71a9da838cc68eec6c45d276384c70490ad11d056334114
+size 9437336
diff --git a/model-00072-of-00081.safetensors b/model-00072-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..57ccbc0eb30dfd7c5f1038ecf1a66b9af82f01aa
--- /dev/null
+++ b/model-00072-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c10f40a1627cbefedd694827d89f7662538d1e26f1321389c1a37730fbfa3e67
+size 9437328
diff --git a/model-00073-of-00081.safetensors b/model-00073-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..380c99a0ffd008753e4702f50049a9823261ac13
--- /dev/null
+++ b/model-00073-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:03a3be83b2ffd3d5705a9d03c4ee839002db3ae5ffdb47aab7dfe77b176905bd
+size 2359448
diff --git a/model-00074-of-00081.safetensors b/model-00074-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..bb5c7e6936ac3712fde0040834115c8caa0a7a55
--- /dev/null
+++ b/model-00074-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ba2966fb97dcb76f998b1a052d7aab1aa846f6f9fc0dc9b87d0c14ce335e485
+size 2359448
diff --git a/model-00075-of-00081.safetensors b/model-00075-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..29643e81d97689bc197278b953ac61d2c79bcb82
--- /dev/null
+++ b/model-00075-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:584252f6279c2bba92bf9354fd562af969af046a4d7401fe4827ebcbb6d96931
+size 2359448
diff --git a/model-00076-of-00081.safetensors b/model-00076-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6741ce911f283a0e4a708bcaf2241bb7baa549fe
--- /dev/null
+++ b/model-00076-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ddb3b19f263b6b5b54e2b7ddcb859500e2191b527fc48a2b64b9554725e4704
+size 2359448
diff --git a/model-00077-of-00081.safetensors b/model-00077-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4333fc2625a9c815c8a415ebd10f1766e0e95f33
--- /dev/null
+++ b/model-00077-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:338e7dd28d9334837103c228b6ce110786ff2670850666131635c1431bdbdfa6
+size 9437336
diff --git a/model-00078-of-00081.safetensors b/model-00078-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..29fe3c0e6709dd19ea53d64b377292dc03196804
--- /dev/null
+++ b/model-00078-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb96aa770594d81f64fbe062998a9425fe9d389d273d6c210e695da364cab023
+size 9437328
diff --git a/model-00079-of-00081.safetensors b/model-00079-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2a6318e9132ab669b65e584d01072fa6913e1ad3
--- /dev/null
+++ b/model-00079-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:122a2feab1a6b755f082a9ba2a8f384bf7c0cc489c8147a093937b22d4b014e5
+size 100720
diff --git a/model-00080-of-00081.safetensors b/model-00080-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d9d17650ba6341f9d288d90fcf36cd61e1aa8d06
--- /dev/null
+++ b/model-00080-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d124eff66cb24bf0d932d630f1cc9afcfda2f7db2b172629c3e80c59317de573
+size 2359424
diff --git a/model-00081-of-00081.safetensors b/model-00081-of-00081.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..de84512b729860620ac98355b5ab850beb847bc7
--- /dev/null
+++ b/model-00081-of-00081.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:51147476178829a1477417a45e19a54b804c492e0e1f006a3cddac0a8b3cc1f5
+size 9528
diff --git a/model.safetensors.index.json b/model.safetensors.index.json
new file mode 100644
index 0000000000000000000000000000000000000000..189b5b8ba0efc9c940a816328590a8990cd5fbc6
--- /dev/null
+++ b/model.safetensors.index.json
@@ -0,0 +1,207 @@
+{
+  "metadata": {
+    "total_parameters": 109482240,
+    "total_size": 437928960
+  },
+  "weight_map": {
+    "embeddings.LayerNorm.bias": "model-00018-of-00081.safetensors",
+    "embeddings.LayerNorm.weight": "model-00018-of-00081.safetensors",
+    "embeddings.position_embeddings.weight": "model-00002-of-00081.safetensors",
+    "embeddings.token_type_embeddings.weight": "model-00018-of-00081.safetensors",
+    "embeddings.word_embeddings.weight": "model-00001-of-00081.safetensors",
+    "encoder.layer.0.attention.output.LayerNorm.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.attention.output.LayerNorm.weight": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.attention.output.dense.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.attention.output.dense.weight": "model-00006-of-00081.safetensors",
+    "encoder.layer.0.attention.self.key.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.attention.self.key.weight": "model-00004-of-00081.safetensors",
+    "encoder.layer.0.attention.self.query.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.attention.self.query.weight": "model-00003-of-00081.safetensors",
+    "encoder.layer.0.attention.self.value.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.attention.self.value.weight": "model-00005-of-00081.safetensors",
+    "encoder.layer.0.intermediate.dense.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.intermediate.dense.weight": "model-00007-of-00081.safetensors",
+    "encoder.layer.0.output.LayerNorm.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.output.LayerNorm.weight": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.output.dense.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.0.output.dense.weight": "model-00008-of-00081.safetensors",
+    "encoder.layer.1.attention.output.LayerNorm.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.attention.output.LayerNorm.weight": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.attention.output.dense.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.attention.output.dense.weight": "model-00012-of-00081.safetensors",
+    "encoder.layer.1.attention.self.key.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.attention.self.key.weight": "model-00010-of-00081.safetensors",
+    "encoder.layer.1.attention.self.query.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.attention.self.query.weight": "model-00009-of-00081.safetensors",
+    "encoder.layer.1.attention.self.value.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.attention.self.value.weight": "model-00011-of-00081.safetensors",
+    "encoder.layer.1.intermediate.dense.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.intermediate.dense.weight": "model-00013-of-00081.safetensors",
+    "encoder.layer.1.output.LayerNorm.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.output.LayerNorm.weight": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.output.dense.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.1.output.dense.weight": "model-00014-of-00081.safetensors",
+    "encoder.layer.10.attention.output.LayerNorm.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.attention.output.LayerNorm.weight": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.attention.output.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.attention.output.dense.weight": "model-00070-of-00081.safetensors",
+    "encoder.layer.10.attention.self.key.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.attention.self.key.weight": "model-00068-of-00081.safetensors",
+    "encoder.layer.10.attention.self.query.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.attention.self.query.weight": "model-00067-of-00081.safetensors",
+    "encoder.layer.10.attention.self.value.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.attention.self.value.weight": "model-00069-of-00081.safetensors",
+    "encoder.layer.10.intermediate.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.intermediate.dense.weight": "model-00071-of-00081.safetensors",
+    "encoder.layer.10.output.LayerNorm.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.output.LayerNorm.weight": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.output.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.10.output.dense.weight": "model-00072-of-00081.safetensors",
+    "encoder.layer.11.attention.output.LayerNorm.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.attention.output.LayerNorm.weight": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.attention.output.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.attention.output.dense.weight": "model-00076-of-00081.safetensors",
+    "encoder.layer.11.attention.self.key.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.attention.self.key.weight": "model-00074-of-00081.safetensors",
+    "encoder.layer.11.attention.self.query.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.attention.self.query.weight": "model-00073-of-00081.safetensors",
+    "encoder.layer.11.attention.self.value.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.attention.self.value.weight": "model-00075-of-00081.safetensors",
+    "encoder.layer.11.intermediate.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.intermediate.dense.weight": "model-00077-of-00081.safetensors",
+    "encoder.layer.11.output.LayerNorm.bias": "model-00081-of-00081.safetensors",
+    "encoder.layer.11.output.LayerNorm.weight": "model-00081-of-00081.safetensors",
+    "encoder.layer.11.output.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.11.output.dense.weight": "model-00078-of-00081.safetensors",
+    "encoder.layer.2.attention.output.LayerNorm.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.attention.output.LayerNorm.weight": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.attention.output.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.attention.output.dense.weight": "model-00019-of-00081.safetensors",
+    "encoder.layer.2.attention.self.key.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.2.attention.self.key.weight": "model-00016-of-00081.safetensors",
+    "encoder.layer.2.attention.self.query.bias": "model-00018-of-00081.safetensors",
+    "encoder.layer.2.attention.self.query.weight": "model-00015-of-00081.safetensors",
+    "encoder.layer.2.attention.self.value.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.attention.self.value.weight": "model-00017-of-00081.safetensors",
+    "encoder.layer.2.intermediate.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.intermediate.dense.weight": "model-00020-of-00081.safetensors",
+    "encoder.layer.2.output.LayerNorm.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.output.LayerNorm.weight": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.output.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.2.output.dense.weight": "model-00021-of-00081.safetensors",
+    "encoder.layer.3.attention.output.LayerNorm.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.attention.output.LayerNorm.weight": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.attention.output.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.attention.output.dense.weight": "model-00025-of-00081.safetensors",
+    "encoder.layer.3.attention.self.key.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.attention.self.key.weight": "model-00023-of-00081.safetensors",
+    "encoder.layer.3.attention.self.query.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.attention.self.query.weight": "model-00022-of-00081.safetensors",
+    "encoder.layer.3.attention.self.value.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.attention.self.value.weight": "model-00024-of-00081.safetensors",
+    "encoder.layer.3.intermediate.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.intermediate.dense.weight": "model-00026-of-00081.safetensors",
+    "encoder.layer.3.output.LayerNorm.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.output.LayerNorm.weight": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.output.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.3.output.dense.weight": "model-00027-of-00081.safetensors",
+    "encoder.layer.4.attention.output.LayerNorm.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.4.attention.output.LayerNorm.weight": "model-00033-of-00081.safetensors",
+    "encoder.layer.4.attention.output.dense.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.4.attention.output.dense.weight": "model-00031-of-00081.safetensors",
+    "encoder.layer.4.attention.self.key.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.4.attention.self.key.weight": "model-00029-of-00081.safetensors",
+    "encoder.layer.4.attention.self.query.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.4.attention.self.query.weight": "model-00028-of-00081.safetensors",
+    "encoder.layer.4.attention.self.value.bias": "model-00033-of-00081.safetensors",
+    "encoder.layer.4.attention.self.value.weight": "model-00030-of-00081.safetensors",
+    "encoder.layer.4.intermediate.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.4.intermediate.dense.weight": "model-00032-of-00081.safetensors",
+    "encoder.layer.4.output.LayerNorm.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.4.output.LayerNorm.weight": "model-00047-of-00081.safetensors",
+    "encoder.layer.4.output.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.4.output.dense.weight": "model-00034-of-00081.safetensors",
+    "encoder.layer.5.attention.output.LayerNorm.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.attention.output.LayerNorm.weight": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.attention.output.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.attention.output.dense.weight": "model-00038-of-00081.safetensors",
+    "encoder.layer.5.attention.self.key.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.attention.self.key.weight": "model-00036-of-00081.safetensors",
+    "encoder.layer.5.attention.self.query.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.attention.self.query.weight": "model-00035-of-00081.safetensors",
+    "encoder.layer.5.attention.self.value.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.attention.self.value.weight": "model-00037-of-00081.safetensors",
+    "encoder.layer.5.intermediate.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.intermediate.dense.weight": "model-00039-of-00081.safetensors",
+    "encoder.layer.5.output.LayerNorm.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.output.LayerNorm.weight": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.output.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.5.output.dense.weight": "model-00040-of-00081.safetensors",
+    "encoder.layer.6.attention.output.LayerNorm.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.attention.output.LayerNorm.weight": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.attention.output.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.attention.output.dense.weight": "model-00044-of-00081.safetensors",
+    "encoder.layer.6.attention.self.key.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.attention.self.key.weight": "model-00042-of-00081.safetensors",
+    "encoder.layer.6.attention.self.query.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.attention.self.query.weight": "model-00041-of-00081.safetensors",
+    "encoder.layer.6.attention.self.value.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.attention.self.value.weight": "model-00043-of-00081.safetensors",
+    "encoder.layer.6.intermediate.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.intermediate.dense.weight": "model-00045-of-00081.safetensors",
+    "encoder.layer.6.output.LayerNorm.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.6.output.LayerNorm.weight": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.output.dense.bias": "model-00047-of-00081.safetensors",
+    "encoder.layer.6.output.dense.weight": "model-00046-of-00081.safetensors",
+    "encoder.layer.7.attention.output.LayerNorm.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.attention.output.LayerNorm.weight": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.attention.output.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.attention.output.dense.weight": "model-00051-of-00081.safetensors",
+    "encoder.layer.7.attention.self.key.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.attention.self.key.weight": "model-00049-of-00081.safetensors",
+    "encoder.layer.7.attention.self.query.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.attention.self.query.weight": "model-00048-of-00081.safetensors",
+    "encoder.layer.7.attention.self.value.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.attention.self.value.weight": "model-00050-of-00081.safetensors",
+    "encoder.layer.7.intermediate.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.intermediate.dense.weight": "model-00052-of-00081.safetensors",
+    "encoder.layer.7.output.LayerNorm.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.output.LayerNorm.weight": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.output.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.7.output.dense.weight": "model-00053-of-00081.safetensors",
+    "encoder.layer.8.attention.output.LayerNorm.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.attention.output.LayerNorm.weight": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.attention.output.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.attention.output.dense.weight": "model-00057-of-00081.safetensors",
+    "encoder.layer.8.attention.self.key.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.attention.self.key.weight": "model-00055-of-00081.safetensors",
+    "encoder.layer.8.attention.self.query.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.attention.self.query.weight": "model-00054-of-00081.safetensors",
+    "encoder.layer.8.attention.self.value.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.attention.self.value.weight": "model-00056-of-00081.safetensors",
+    "encoder.layer.8.intermediate.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.intermediate.dense.weight": "model-00058-of-00081.safetensors",
+    "encoder.layer.8.output.LayerNorm.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.output.LayerNorm.weight": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.output.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.8.output.dense.weight": "model-00059-of-00081.safetensors",
+    "encoder.layer.9.attention.output.LayerNorm.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.9.attention.output.LayerNorm.weight": "model-00064-of-00081.safetensors",
+    "encoder.layer.9.attention.output.dense.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.9.attention.output.dense.weight": "model-00063-of-00081.safetensors",
+    "encoder.layer.9.attention.self.key.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.9.attention.self.key.weight": "model-00061-of-00081.safetensors",
+    "encoder.layer.9.attention.self.query.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.9.attention.self.query.weight": "model-00060-of-00081.safetensors",
+    "encoder.layer.9.attention.self.value.bias": "model-00064-of-00081.safetensors",
+    "encoder.layer.9.attention.self.value.weight": "model-00062-of-00081.safetensors",
+    "encoder.layer.9.intermediate.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.9.intermediate.dense.weight": "model-00065-of-00081.safetensors",
+    "encoder.layer.9.output.LayerNorm.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.9.output.LayerNorm.weight": "model-00079-of-00081.safetensors",
+    "encoder.layer.9.output.dense.bias": "model-00079-of-00081.safetensors",
+    "encoder.layer.9.output.dense.weight": "model-00066-of-00081.safetensors",
+    "pooler.dense.bias": "model-00081-of-00081.safetensors",
+    "pooler.dense.weight": "model-00080-of-00081.safetensors"
+  }
+}