Hugging Face's logo

mahbubhimel
/
florence-2-finetuned-bangla-tokenizer

Transformers
Model card Files Community
mahbubhimel commited on
Commit
792d1b9
·
verified ·
1 Parent(s): 6bb2b86

Upload tokenizer

Browse files
Files changed (6) hide show
  1. README.md +199 -0
  2. merges.txt +0 -0
  3. special_tokens_map.json +1041 -0
  4. tokenizer.json +0 -0
  5. tokenizer_config.json +0 -0
  6. vocab.json +0 -0
README.md ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags: []
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+ This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,1041 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<od>",
4
+ "</od>",
5
+ "<ocr>",
6
+ "</ocr>",
7
+ "<loc_0>",
8
+ "<loc_1>",
9
+ "<loc_2>",
10
+ "<loc_3>",
11
+ "<loc_4>",
12
+ "<loc_5>",
13
+ "<loc_6>",
14
+ "<loc_7>",
15
+ "<loc_8>",
16
+ "<loc_9>",
17
+ "<loc_10>",
18
+ "<loc_11>",
19
+ "<loc_12>",
20
+ "<loc_13>",
21
+ "<loc_14>",
22
+ "<loc_15>",
23
+ "<loc_16>",
24
+ "<loc_17>",
25
+ "<loc_18>",
26
+ "<loc_19>",
27
+ "<loc_20>",
28
+ "<loc_21>",
29
+ "<loc_22>",
30
+ "<loc_23>",
31
+ "<loc_24>",
32
+ "<loc_25>",
33
+ "<loc_26>",
34
+ "<loc_27>",
35
+ "<loc_28>",
36
+ "<loc_29>",
37
+ "<loc_30>",
38
+ "<loc_31>",
39
+ "<loc_32>",
40
+ "<loc_33>",
41
+ "<loc_34>",
42
+ "<loc_35>",
43
+ "<loc_36>",
44
+ "<loc_37>",
45
+ "<loc_38>",
46
+ "<loc_39>",
47
+ "<loc_40>",
48
+ "<loc_41>",
49
+ "<loc_42>",
50
+ "<loc_43>",
51
+ "<loc_44>",
52
+ "<loc_45>",
53
+ "<loc_46>",
54
+ "<loc_47>",
55
+ "<loc_48>",
56
+ "<loc_49>",
57
+ "<loc_50>",
58
+ "<loc_51>",
59
+ "<loc_52>",
60
+ "<loc_53>",
61
+ "<loc_54>",
62
+ "<loc_55>",
63
+ "<loc_56>",
64
+ "<loc_57>",
65
+ "<loc_58>",
66
+ "<loc_59>",
67
+ "<loc_60>",
68
+ "<loc_61>",
69
+ "<loc_62>",
70
+ "<loc_63>",
71
+ "<loc_64>",
72
+ "<loc_65>",
73
+ "<loc_66>",
74
+ "<loc_67>",
75
+ "<loc_68>",
76
+ "<loc_69>",
77
+ "<loc_70>",
78
+ "<loc_71>",
79
+ "<loc_72>",
80
+ "<loc_73>",
81
+ "<loc_74>",
82
+ "<loc_75>",
83
+ "<loc_76>",
84
+ "<loc_77>",
85
+ "<loc_78>",
86
+ "<loc_79>",
87
+ "<loc_80>",
88
+ "<loc_81>",
89
+ "<loc_82>",
90
+ "<loc_83>",
91
+ "<loc_84>",
92
+ "<loc_85>",
93
+ "<loc_86>",
94
+ "<loc_87>",
95
+ "<loc_88>",
96
+ "<loc_89>",
97
+ "<loc_90>",
98
+ "<loc_91>",
99
+ "<loc_92>",
100
+ "<loc_93>",
101
+ "<loc_94>",
102
+ "<loc_95>",
103
+ "<loc_96>",
104
+ "<loc_97>",
105
+ "<loc_98>",
106
+ "<loc_99>",
107
+ "<loc_100>",
108
+ "<loc_101>",
109
+ "<loc_102>",
110
+ "<loc_103>",
111
+ "<loc_104>",
112
+ "<loc_105>",
113
+ "<loc_106>",
114
+ "<loc_107>",
115
+ "<loc_108>",
116
+ "<loc_109>",
117
+ "<loc_110>",
118
+ "<loc_111>",
119
+ "<loc_112>",
120
+ "<loc_113>",
121
+ "<loc_114>",
122
+ "<loc_115>",
123
+ "<loc_116>",
124
+ "<loc_117>",
125
+ "<loc_118>",
126
+ "<loc_119>",
127
+ "<loc_120>",
128
+ "<loc_121>",
129
+ "<loc_122>",
130
+ "<loc_123>",
131
+ "<loc_124>",
132
+ "<loc_125>",
133
+ "<loc_126>",
134
+ "<loc_127>",
135
+ "<loc_128>",
136
+ "<loc_129>",
137
+ "<loc_130>",
138
+ "<loc_131>",
139
+ "<loc_132>",
140
+ "<loc_133>",
141
+ "<loc_134>",
142
+ "<loc_135>",
143
+ "<loc_136>",
144
+ "<loc_137>",
145
+ "<loc_138>",
146
+ "<loc_139>",
147
+ "<loc_140>",
148
+ "<loc_141>",
149
+ "<loc_142>",
150
+ "<loc_143>",
151
+ "<loc_144>",
152
+ "<loc_145>",
153
+ "<loc_146>",
154
+ "<loc_147>",
155
+ "<loc_148>",
156
+ "<loc_149>",
157
+ "<loc_150>",
158
+ "<loc_151>",
159
+ "<loc_152>",
160
+ "<loc_153>",
161
+ "<loc_154>",
162
+ "<loc_155>",
163
+ "<loc_156>",
164
+ "<loc_157>",
165
+ "<loc_158>",
166
+ "<loc_159>",
167
+ "<loc_160>",
168
+ "<loc_161>",
169
+ "<loc_162>",
170
+ "<loc_163>",
171
+ "<loc_164>",
172
+ "<loc_165>",
173
+ "<loc_166>",
174
+ "<loc_167>",
175
+ "<loc_168>",
176
+ "<loc_169>",
177
+ "<loc_170>",
178
+ "<loc_171>",
179
+ "<loc_172>",
180
+ "<loc_173>",
181
+ "<loc_174>",
182
+ "<loc_175>",
183
+ "<loc_176>",
184
+ "<loc_177>",
185
+ "<loc_178>",
186
+ "<loc_179>",
187
+ "<loc_180>",
188
+ "<loc_181>",
189
+ "<loc_182>",
190
+ "<loc_183>",
191
+ "<loc_184>",
192
+ "<loc_185>",
193
+ "<loc_186>",
194
+ "<loc_187>",
195
+ "<loc_188>",
196
+ "<loc_189>",
197
+ "<loc_190>",
198
+ "<loc_191>",
199
+ "<loc_192>",
200
+ "<loc_193>",
201
+ "<loc_194>",
202
+ "<loc_195>",
203
+ "<loc_196>",
204
+ "<loc_197>",
205
+ "<loc_198>",
206
+ "<loc_199>",
207
+ "<loc_200>",
208
+ "<loc_201>",
209
+ "<loc_202>",
210
+ "<loc_203>",
211
+ "<loc_204>",
212
+ "<loc_205>",
213
+ "<loc_206>",
214
+ "<loc_207>",
215
+ "<loc_208>",
216
+ "<loc_209>",
217
+ "<loc_210>",
218
+ "<loc_211>",
219
+ "<loc_212>",
220
+ "<loc_213>",
221
+ "<loc_214>",
222
+ "<loc_215>",
223
+ "<loc_216>",
224
+ "<loc_217>",
225
+ "<loc_218>",
226
+ "<loc_219>",
227
+ "<loc_220>",
228
+ "<loc_221>",
229
+ "<loc_222>",
230
+ "<loc_223>",
231
+ "<loc_224>",
232
+ "<loc_225>",
233
+ "<loc_226>",
234
+ "<loc_227>",
235
+ "<loc_228>",
236
+ "<loc_229>",
237
+ "<loc_230>",
238
+ "<loc_231>",
239
+ "<loc_232>",
240
+ "<loc_233>",
241
+ "<loc_234>",
242
+ "<loc_235>",
243
+ "<loc_236>",
244
+ "<loc_237>",
245
+ "<loc_238>",
246
+ "<loc_239>",
247
+ "<loc_240>",
248
+ "<loc_241>",
249
+ "<loc_242>",
250
+ "<loc_243>",
251
+ "<loc_244>",
252
+ "<loc_245>",
253
+ "<loc_246>",
254
+ "<loc_247>",
255
+ "<loc_248>",
256
+ "<loc_249>",
257
+ "<loc_250>",
258
+ "<loc_251>",
259
+ "<loc_252>",
260
+ "<loc_253>",
261
+ "<loc_254>",
262
+ "<loc_255>",
263
+ "<loc_256>",
264
+ "<loc_257>",
265
+ "<loc_258>",
266
+ "<loc_259>",
267
+ "<loc_260>",
268
+ "<loc_261>",
269
+ "<loc_262>",
270
+ "<loc_263>",
271
+ "<loc_264>",
272
+ "<loc_265>",
273
+ "<loc_266>",
274
+ "<loc_267>",
275
+ "<loc_268>",
276
+ "<loc_269>",
277
+ "<loc_270>",
278
+ "<loc_271>",
279
+ "<loc_272>",
280
+ "<loc_273>",
281
+ "<loc_274>",
282
+ "<loc_275>",
283
+ "<loc_276>",
284
+ "<loc_277>",
285
+ "<loc_278>",
286
+ "<loc_279>",
287
+ "<loc_280>",
288
+ "<loc_281>",
289
+ "<loc_282>",
290
+ "<loc_283>",
291
+ "<loc_284>",
292
+ "<loc_285>",
293
+ "<loc_286>",
294
+ "<loc_287>",
295
+ "<loc_288>",
296
+ "<loc_289>",
297
+ "<loc_290>",
298
+ "<loc_291>",
299
+ "<loc_292>",
300
+ "<loc_293>",
301
+ "<loc_294>",
302
+ "<loc_295>",
303
+ "<loc_296>",
304
+ "<loc_297>",
305
+ "<loc_298>",
306
+ "<loc_299>",
307
+ "<loc_300>",
308
+ "<loc_301>",
309
+ "<loc_302>",
310
+ "<loc_303>",
311
+ "<loc_304>",
312
+ "<loc_305>",
313
+ "<loc_306>",
314
+ "<loc_307>",
315
+ "<loc_308>",
316
+ "<loc_309>",
317
+ "<loc_310>",
318
+ "<loc_311>",
319
+ "<loc_312>",
320
+ "<loc_313>",
321
+ "<loc_314>",
322
+ "<loc_315>",
323
+ "<loc_316>",
324
+ "<loc_317>",
325
+ "<loc_318>",
326
+ "<loc_319>",
327
+ "<loc_320>",
328
+ "<loc_321>",
329
+ "<loc_322>",
330
+ "<loc_323>",
331
+ "<loc_324>",
332
+ "<loc_325>",
333
+ "<loc_326>",
334
+ "<loc_327>",
335
+ "<loc_328>",
336
+ "<loc_329>",
337
+ "<loc_330>",
338
+ "<loc_331>",
339
+ "<loc_332>",
340
+ "<loc_333>",
341
+ "<loc_334>",
342
+ "<loc_335>",
343
+ "<loc_336>",
344
+ "<loc_337>",
345
+ "<loc_338>",
346
+ "<loc_339>",
347
+ "<loc_340>",
348
+ "<loc_341>",
349
+ "<loc_342>",
350
+ "<loc_343>",
351
+ "<loc_344>",
352
+ "<loc_345>",
353
+ "<loc_346>",
354
+ "<loc_347>",
355
+ "<loc_348>",
356
+ "<loc_349>",
357
+ "<loc_350>",
358
+ "<loc_351>",
359
+ "<loc_352>",
360
+ "<loc_353>",
361
+ "<loc_354>",
362
+ "<loc_355>",
363
+ "<loc_356>",
364
+ "<loc_357>",
365
+ "<loc_358>",
366
+ "<loc_359>",
367
+ "<loc_360>",
368
+ "<loc_361>",
369
+ "<loc_362>",
370
+ "<loc_363>",
371
+ "<loc_364>",
372
+ "<loc_365>",
373
+ "<loc_366>",
374
+ "<loc_367>",
375
+ "<loc_368>",
376
+ "<loc_369>",
377
+ "<loc_370>",
378
+ "<loc_371>",
379
+ "<loc_372>",
380
+ "<loc_373>",
381
+ "<loc_374>",
382
+ "<loc_375>",
383
+ "<loc_376>",
384
+ "<loc_377>",
385
+ "<loc_378>",
386
+ "<loc_379>",
387
+ "<loc_380>",
388
+ "<loc_381>",
389
+ "<loc_382>",
390
+ "<loc_383>",
391
+ "<loc_384>",
392
+ "<loc_385>",
393
+ "<loc_386>",
394
+ "<loc_387>",
395
+ "<loc_388>",
396
+ "<loc_389>",
397
+ "<loc_390>",
398
+ "<loc_391>",
399
+ "<loc_392>",
400
+ "<loc_393>",
401
+ "<loc_394>",
402
+ "<loc_395>",
403
+ "<loc_396>",
404
+ "<loc_397>",
405
+ "<loc_398>",
406
+ "<loc_399>",
407
+ "<loc_400>",
408
+ "<loc_401>",
409
+ "<loc_402>",
410
+ "<loc_403>",
411
+ "<loc_404>",
412
+ "<loc_405>",
413
+ "<loc_406>",
414
+ "<loc_407>",
415
+ "<loc_408>",
416
+ "<loc_409>",
417
+ "<loc_410>",
418
+ "<loc_411>",
419
+ "<loc_412>",
420
+ "<loc_413>",
421
+ "<loc_414>",
422
+ "<loc_415>",
423
+ "<loc_416>",
424
+ "<loc_417>",
425
+ "<loc_418>",
426
+ "<loc_419>",
427
+ "<loc_420>",
428
+ "<loc_421>",
429
+ "<loc_422>",
430
+ "<loc_423>",
431
+ "<loc_424>",
432
+ "<loc_425>",
433
+ "<loc_426>",
434
+ "<loc_427>",
435
+ "<loc_428>",
436
+ "<loc_429>",
437
+ "<loc_430>",
438
+ "<loc_431>",
439
+ "<loc_432>",
440
+ "<loc_433>",
441
+ "<loc_434>",
442
+ "<loc_435>",
443
+ "<loc_436>",
444
+ "<loc_437>",
445
+ "<loc_438>",
446
+ "<loc_439>",
447
+ "<loc_440>",
448
+ "<loc_441>",
449
+ "<loc_442>",
450
+ "<loc_443>",
451
+ "<loc_444>",
452
+ "<loc_445>",
453
+ "<loc_446>",
454
+ "<loc_447>",
455
+ "<loc_448>",
456
+ "<loc_449>",
457
+ "<loc_450>",
458
+ "<loc_451>",
459
+ "<loc_452>",
460
+ "<loc_453>",
461
+ "<loc_454>",
462
+ "<loc_455>",
463
+ "<loc_456>",
464
+ "<loc_457>",
465
+ "<loc_458>",
466
+ "<loc_459>",
467
+ "<loc_460>",
468
+ "<loc_461>",
469
+ "<loc_462>",
470
+ "<loc_463>",
471
+ "<loc_464>",
472
+ "<loc_465>",
473
+ "<loc_466>",
474
+ "<loc_467>",
475
+ "<loc_468>",
476
+ "<loc_469>",
477
+ "<loc_470>",
478
+ "<loc_471>",
479
+ "<loc_472>",
480
+ "<loc_473>",
481
+ "<loc_474>",
482
+ "<loc_475>",
483
+ "<loc_476>",
484
+ "<loc_477>",
485
+ "<loc_478>",
486
+ "<loc_479>",
487
+ "<loc_480>",
488
+ "<loc_481>",
489
+ "<loc_482>",
490
+ "<loc_483>",
491
+ "<loc_484>",
492
+ "<loc_485>",
493
+ "<loc_486>",
494
+ "<loc_487>",
495
+ "<loc_488>",
496
+ "<loc_489>",
497
+ "<loc_490>",
498
+ "<loc_491>",
499
+ "<loc_492>",
500
+ "<loc_493>",
501
+ "<loc_494>",
502
+ "<loc_495>",
503
+ "<loc_496>",
504
+ "<loc_497>",
505
+ "<loc_498>",
506
+ "<loc_499>",
507
+ "<loc_500>",
508
+ "<loc_501>",
509
+ "<loc_502>",
510
+ "<loc_503>",
511
+ "<loc_504>",
512
+ "<loc_505>",
513
+ "<loc_506>",
514
+ "<loc_507>",
515
+ "<loc_508>",
516
+ "<loc_509>",
517
+ "<loc_510>",
518
+ "<loc_511>",
519
+ "<loc_512>",
520
+ "<loc_513>",
521
+ "<loc_514>",
522
+ "<loc_515>",
523
+ "<loc_516>",
524
+ "<loc_517>",
525
+ "<loc_518>",
526
+ "<loc_519>",
527
+ "<loc_520>",
528
+ "<loc_521>",
529
+ "<loc_522>",
530
+ "<loc_523>",
531
+ "<loc_524>",
532
+ "<loc_525>",
533
+ "<loc_526>",
534
+ "<loc_527>",
535
+ "<loc_528>",
536
+ "<loc_529>",
537
+ "<loc_530>",
538
+ "<loc_531>",
539
+ "<loc_532>",
540
+ "<loc_533>",
541
+ "<loc_534>",
542
+ "<loc_535>",
543
+ "<loc_536>",
544
+ "<loc_537>",
545
+ "<loc_538>",
546
+ "<loc_539>",
547
+ "<loc_540>",
548
+ "<loc_541>",
549
+ "<loc_542>",
550
+ "<loc_543>",
551
+ "<loc_544>",
552
+ "<loc_545>",
553
+ "<loc_546>",
554
+ "<loc_547>",
555
+ "<loc_548>",
556
+ "<loc_549>",
557
+ "<loc_550>",
558
+ "<loc_551>",
559
+ "<loc_552>",
560
+ "<loc_553>",
561
+ "<loc_554>",
562
+ "<loc_555>",
563
+ "<loc_556>",
564
+ "<loc_557>",
565
+ "<loc_558>",
566
+ "<loc_559>",
567
+ "<loc_560>",
568
+ "<loc_561>",
569
+ "<loc_562>",
570
+ "<loc_563>",
571
+ "<loc_564>",
572
+ "<loc_565>",
573
+ "<loc_566>",
574
+ "<loc_567>",
575
+ "<loc_568>",
576
+ "<loc_569>",
577
+ "<loc_570>",
578
+ "<loc_571>",
579
+ "<loc_572>",
580
+ "<loc_573>",
581
+ "<loc_574>",
582
+ "<loc_575>",
583
+ "<loc_576>",
584
+ "<loc_577>",
585
+ "<loc_578>",
586
+ "<loc_579>",
587
+ "<loc_580>",
588
+ "<loc_581>",
589
+ "<loc_582>",
590
+ "<loc_583>",
591
+ "<loc_584>",
592
+ "<loc_585>",
593
+ "<loc_586>",
594
+ "<loc_587>",
595
+ "<loc_588>",
596
+ "<loc_589>",
597
+ "<loc_590>",
598
+ "<loc_591>",
599
+ "<loc_592>",
600
+ "<loc_593>",
601
+ "<loc_594>",
602
+ "<loc_595>",
603
+ "<loc_596>",
604
+ "<loc_597>",
605
+ "<loc_598>",
606
+ "<loc_599>",
607
+ "<loc_600>",
608
+ "<loc_601>",
609
+ "<loc_602>",
610
+ "<loc_603>",
611
+ "<loc_604>",
612
+ "<loc_605>",
613
+ "<loc_606>",
614
+ "<loc_607>",
615
+ "<loc_608>",
616
+ "<loc_609>",
617
+ "<loc_610>",
618
+ "<loc_611>",
619
+ "<loc_612>",
620
+ "<loc_613>",
621
+ "<loc_614>",
622
+ "<loc_615>",
623
+ "<loc_616>",
624
+ "<loc_617>",
625
+ "<loc_618>",
626
+ "<loc_619>",
627
+ "<loc_620>",
628
+ "<loc_621>",
629
+ "<loc_622>",
630
+ "<loc_623>",
631
+ "<loc_624>",
632
+ "<loc_625>",
633
+ "<loc_626>",
634
+ "<loc_627>",
635
+ "<loc_628>",
636
+ "<loc_629>",
637
+ "<loc_630>",
638
+ "<loc_631>",
639
+ "<loc_632>",
640
+ "<loc_633>",
641
+ "<loc_634>",
642
+ "<loc_635>",
643
+ "<loc_636>",
644
+ "<loc_637>",
645
+ "<loc_638>",
646
+ "<loc_639>",
647
+ "<loc_640>",
648
+ "<loc_641>",
649
+ "<loc_642>",
650
+ "<loc_643>",
651
+ "<loc_644>",
652
+ "<loc_645>",
653
+ "<loc_646>",
654
+ "<loc_647>",
655
+ "<loc_648>",
656
+ "<loc_649>",
657
+ "<loc_650>",
658
+ "<loc_651>",
659
+ "<loc_652>",
660
+ "<loc_653>",
661
+ "<loc_654>",
662
+ "<loc_655>",
663
+ "<loc_656>",
664
+ "<loc_657>",
665
+ "<loc_658>",
666
+ "<loc_659>",
667
+ "<loc_660>",
668
+ "<loc_661>",
669
+ "<loc_662>",
670
+ "<loc_663>",
671
+ "<loc_664>",
672
+ "<loc_665>",
673
+ "<loc_666>",
674
+ "<loc_667>",
675
+ "<loc_668>",
676
+ "<loc_669>",
677
+ "<loc_670>",
678
+ "<loc_671>",
679
+ "<loc_672>",
680
+ "<loc_673>",
681
+ "<loc_674>",
682
+ "<loc_675>",
683
+ "<loc_676>",
684
+ "<loc_677>",
685
+ "<loc_678>",
686
+ "<loc_679>",
687
+ "<loc_680>",
688
+ "<loc_681>",
689
+ "<loc_682>",
690
+ "<loc_683>",
691
+ "<loc_684>",
692
+ "<loc_685>",
693
+ "<loc_686>",
694
+ "<loc_687>",
695
+ "<loc_688>",
696
+ "<loc_689>",
697
+ "<loc_690>",
698
+ "<loc_691>",
699
+ "<loc_692>",
700
+ "<loc_693>",
701
+ "<loc_694>",
702
+ "<loc_695>",
703
+ "<loc_696>",
704
+ "<loc_697>",
705
+ "<loc_698>",
706
+ "<loc_699>",
707
+ "<loc_700>",
708
+ "<loc_701>",
709
+ "<loc_702>",
710
+ "<loc_703>",
711
+ "<loc_704>",
712
+ "<loc_705>",
713
+ "<loc_706>",
714
+ "<loc_707>",
715
+ "<loc_708>",
716
+ "<loc_709>",
717
+ "<loc_710>",
718
+ "<loc_711>",
719
+ "<loc_712>",
720
+ "<loc_713>",
721
+ "<loc_714>",
722
+ "<loc_715>",
723
+ "<loc_716>",
724
+ "<loc_717>",
725
+ "<loc_718>",
726
+ "<loc_719>",
727
+ "<loc_720>",
728
+ "<loc_721>",
729
+ "<loc_722>",
730
+ "<loc_723>",
731
+ "<loc_724>",
732
+ "<loc_725>",
733
+ "<loc_726>",
734
+ "<loc_727>",
735
+ "<loc_728>",
736
+ "<loc_729>",
737
+ "<loc_730>",
738
+ "<loc_731>",
739
+ "<loc_732>",
740
+ "<loc_733>",
741
+ "<loc_734>",
742
+ "<loc_735>",
743
+ "<loc_736>",
744
+ "<loc_737>",
745
+ "<loc_738>",
746
+ "<loc_739>",
747
+ "<loc_740>",
748
+ "<loc_741>",
749
+ "<loc_742>",
750
+ "<loc_743>",
751
+ "<loc_744>",
752
+ "<loc_745>",
753
+ "<loc_746>",
754
+ "<loc_747>",
755
+ "<loc_748>",
756
+ "<loc_749>",
757
+ "<loc_750>",
758
+ "<loc_751>",
759
+ "<loc_752>",
760
+ "<loc_753>",
761
+ "<loc_754>",
762
+ "<loc_755>",
763
+ "<loc_756>",
764
+ "<loc_757>",
765
+ "<loc_758>",
766
+ "<loc_759>",
767
+ "<loc_760>",
768
+ "<loc_761>",
769
+ "<loc_762>",
770
+ "<loc_763>",
771
+ "<loc_764>",
772
+ "<loc_765>",
773
+ "<loc_766>",
774
+ "<loc_767>",
775
+ "<loc_768>",
776
+ "<loc_769>",
777
+ "<loc_770>",
778
+ "<loc_771>",
779
+ "<loc_772>",
780
+ "<loc_773>",
781
+ "<loc_774>",
782
+ "<loc_775>",
783
+ "<loc_776>",
784
+ "<loc_777>",
785
+ "<loc_778>",
786
+ "<loc_779>",
787
+ "<loc_780>",
788
+ "<loc_781>",
789
+ "<loc_782>",
790
+ "<loc_783>",
791
+ "<loc_784>",
792
+ "<loc_785>",
793
+ "<loc_786>",
794
+ "<loc_787>",
795
+ "<loc_788>",
796
+ "<loc_789>",
797
+ "<loc_790>",
798
+ "<loc_791>",
799
+ "<loc_792>",
800
+ "<loc_793>",
801
+ "<loc_794>",
802
+ "<loc_795>",
803
+ "<loc_796>",
804
+ "<loc_797>",
805
+ "<loc_798>",
806
+ "<loc_799>",
807
+ "<loc_800>",
808
+ "<loc_801>",
809
+ "<loc_802>",
810
+ "<loc_803>",
811
+ "<loc_804>",
812
+ "<loc_805>",
813
+ "<loc_806>",
814
+ "<loc_807>",
815
+ "<loc_808>",
816
+ "<loc_809>",
817
+ "<loc_810>",
818
+ "<loc_811>",
819
+ "<loc_812>",
820
+ "<loc_813>",
821
+ "<loc_814>",
822
+ "<loc_815>",
823
+ "<loc_816>",
824
+ "<loc_817>",
825
+ "<loc_818>",
826
+ "<loc_819>",
827
+ "<loc_820>",
828
+ "<loc_821>",
829
+ "<loc_822>",
830
+ "<loc_823>",
831
+ "<loc_824>",
832
+ "<loc_825>",
833
+ "<loc_826>",
834
+ "<loc_827>",
835
+ "<loc_828>",
836
+ "<loc_829>",
837
+ "<loc_830>",
838
+ "<loc_831>",
839
+ "<loc_832>",
840
+ "<loc_833>",
841
+ "<loc_834>",
842
+ "<loc_835>",
843
+ "<loc_836>",
844
+ "<loc_837>",
845
+ "<loc_838>",
846
+ "<loc_839>",
847
+ "<loc_840>",
848
+ "<loc_841>",
849
+ "<loc_842>",
850
+ "<loc_843>",
851
+ "<loc_844>",
852
+ "<loc_845>",
853
+ "<loc_846>",
854
+ "<loc_847>",
855
+ "<loc_848>",
856
+ "<loc_849>",
857
+ "<loc_850>",
858
+ "<loc_851>",
859
+ "<loc_852>",
860
+ "<loc_853>",
861
+ "<loc_854>",
862
+ "<loc_855>",
863
+ "<loc_856>",
864
+ "<loc_857>",
865
+ "<loc_858>",
866
+ "<loc_859>",
867
+ "<loc_860>",
868
+ "<loc_861>",
869
+ "<loc_862>",
870
+ "<loc_863>",
871
+ "<loc_864>",
872
+ "<loc_865>",
873
+ "<loc_866>",
874
+ "<loc_867>",
875
+ "<loc_868>",
876
+ "<loc_869>",
877
+ "<loc_870>",
878
+ "<loc_871>",
879
+ "<loc_872>",
880
+ "<loc_873>",
881
+ "<loc_874>",
882
+ "<loc_875>",
883
+ "<loc_876>",
884
+ "<loc_877>",
885
+ "<loc_878>",
886
+ "<loc_879>",
887
+ "<loc_880>",
888
+ "<loc_881>",
889
+ "<loc_882>",
890
+ "<loc_883>",
891
+ "<loc_884>",
892
+ "<loc_885>",
893
+ "<loc_886>",
894
+ "<loc_887>",
895
+ "<loc_888>",
896
+ "<loc_889>",
897
+ "<loc_890>",
898
+ "<loc_891>",
899
+ "<loc_892>",
900
+ "<loc_893>",
901
+ "<loc_894>",
902
+ "<loc_895>",
903
+ "<loc_896>",
904
+ "<loc_897>",
905
+ "<loc_898>",
906
+ "<loc_899>",
907
+ "<loc_900>",
908
+ "<loc_901>",
909
+ "<loc_902>",
910
+ "<loc_903>",
911
+ "<loc_904>",
912
+ "<loc_905>",
913
+ "<loc_906>",
914
+ "<loc_907>",
915
+ "<loc_908>",
916
+ "<loc_909>",
917
+ "<loc_910>",
918
+ "<loc_911>",
919
+ "<loc_912>",
920
+ "<loc_913>",
921
+ "<loc_914>",
922
+ "<loc_915>",
923
+ "<loc_916>",
924
+ "<loc_917>",
925
+ "<loc_918>",
926
+ "<loc_919>",
927
+ "<loc_920>",
928
+ "<loc_921>",
929
+ "<loc_922>",
930
+ "<loc_923>",
931
+ "<loc_924>",
932
+ "<loc_925>",
933
+ "<loc_926>",
934
+ "<loc_927>",
935
+ "<loc_928>",
936
+ "<loc_929>",
937
+ "<loc_930>",
938
+ "<loc_931>",
939
+ "<loc_932>",
940
+ "<loc_933>",
941
+ "<loc_934>",
942
+ "<loc_935>",
943
+ "<loc_936>",
944
+ "<loc_937>",
945
+ "<loc_938>",
946
+ "<loc_939>",
947
+ "<loc_940>",
948
+ "<loc_941>",
949
+ "<loc_942>",
950
+ "<loc_943>",
951
+ "<loc_944>",
952
+ "<loc_945>",
953
+ "<loc_946>",
954
+ "<loc_947>",
955
+ "<loc_948>",
956
+ "<loc_949>",
957
+ "<loc_950>",
958
+ "<loc_951>",
959
+ "<loc_952>",
960
+ "<loc_953>",
961
+ "<loc_954>",
962
+ "<loc_955>",
963
+ "<loc_956>",
964
+ "<loc_957>",
965
+ "<loc_958>",
966
+ "<loc_959>",
967
+ "<loc_960>",
968
+ "<loc_961>",
969
+ "<loc_962>",
970
+ "<loc_963>",
971
+ "<loc_964>",
972
+ "<loc_965>",
973
+ "<loc_966>",
974
+ "<loc_967>",
975
+ "<loc_968>",
976
+ "<loc_969>",
977
+ "<loc_970>",
978
+ "<loc_971>",
979
+ "<loc_972>",
980
+ "<loc_973>",
981
+ "<loc_974>",
982
+ "<loc_975>",
983
+ "<loc_976>",
984
+ "<loc_977>",
985
+ "<loc_978>",
986
+ "<loc_979>",
987
+ "<loc_980>",
988
+ "<loc_981>",
989
+ "<loc_982>",
990
+ "<loc_983>",
991
+ "<loc_984>",
992
+ "<loc_985>",
993
+ "<loc_986>",
994
+ "<loc_987>",
995
+ "<loc_988>",
996
+ "<loc_989>",
997
+ "<loc_990>",
998
+ "<loc_991>",
999
+ "<loc_992>",
1000
+ "<loc_993>",
1001
+ "<loc_994>",
1002
+ "<loc_995>",
1003
+ "<loc_996>",
1004
+ "<loc_997>",
1005
+ "<loc_998>",
1006
+ "<loc_999>",
1007
+ "<cap>",
1008
+ "</cap>",
1009
+ "<ncap>",
1010
+ "</ncap>",
1011
+ "<dcap>",
1012
+ "</dcap>",
1013
+ "<grounding>",
1014
+ "</grounding>",
1015
+ "<seg>",
1016
+ "</seg>",
1017
+ "<sep>",
1018
+ "<region_cap>",
1019
+ "</region_cap>",
1020
+ "<region_to_desciption>",
1021
+ "</region_to_desciption>",
1022
+ "<proposal>",
1023
+ "</proposal>",
1024
+ "<poly>",
1025
+ "</poly>",
1026
+ "<and>"
1027
+ ],
1028
+ "bos_token": "<s>",
1029
+ "cls_token": "<s>",
1030
+ "eos_token": "</s>",
1031
+ "mask_token": {
1032
+ "content": "<mask>",
1033
+ "lstrip": true,
1034
+ "normalized": true,
1035
+ "rstrip": false,
1036
+ "single_word": false
1037
+ },
1038
+ "pad_token": "<pad>",
1039
+ "sep_token": "</s>",
1040
+ "unk_token": "<unk>"
1041
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
The diff for this file is too large to render. See raw diff
 
vocab.json ADDED
The diff for this file is too large to render. See raw diff