kkmkorea commited on
Commit
54f1cce
ยท
verified ยท
1 Parent(s): d0631e5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -97,6 +97,25 @@ cd korscideberta/experiments/glue;ย chmod 777 *.sh;
97
 
98
  </code></pre>
99
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
100
  ### Out-of-Scope Use
101
 
102
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
 
97
 
98
  </code></pre>
99
 
100
+ ### pip๋ฅผ ์ด์šฉํ•œ KorSciDeBERTa ์„ค์น˜
101
+ ์œ„ ์ฝ”๋“œ๋Š” ๋‚ด๋ ค๋ฐ›์•„ ํŒŒ์ด์„  ํ™˜๊ฒฝ์— ์„ค์น˜ํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒŒ ์•„๋‹ˆ๋ผ,
102
+ ๋‚ด ์ฝ”๋“œ์™€ ๊ฐ™์€ ๊ณณ( ๋˜๋Š” ํŠน์ • ์œ„์น˜)์— ๋‘๊ณ  importํ•ด์„œ ์จ์•ผํ•ด์„œ ๋ถˆํŽธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
103
+ ๊ทธ๋ž˜์„œ, pip ๋ช…๋ น์œผ๋กœ ๊ฐ€์ƒ ํ™˜๊ฒฝ(์ฝ˜๋‹ค ํ™˜๊ฒฝ)์— ์„ค์น˜ํ•  ์ˆ˜ ์žˆ๋„๋ก pyproject.toml์„ ๊ธฐ์ˆ ํ•˜์˜€๊ณ ,
104
+ tokenization.py์—์„œ normalize.py์™€ unicode.py๋ฅผ importํ•  ๋•Œ, "korscideberta."์„ ์ถ”๊ฐ€ํ•˜์—ฌ,
105
+ korscideberta ํŒจํ‚ค์ง€๋ฅผ importํ•˜์—ฌ ์“ธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
106
+
107
+ ./ ์œ„์น˜์—์„œ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์‹คํ–‰ํ•˜๋ฉด, ํ˜„์žฌ ์ฝ˜๋‹ค ํ™˜๊ฒฝ์— korscideberta ๋ผ๋Š” ์ด๋ฆ„์œผ๋กœ ์„ค์น˜๋ฉ๋‹ˆ๋‹ค.
108
+ pyproject.toml์— dependencies๋ฅผ ๊ธฐ์ˆ ํ•˜์—ฌ ํ•„์š”ํ•œ ํŒจํ‚ค์ง€(๋ฒ„์ „)(eg. sentencepiece, mecab, konlpy)์„ ํ™•์ธํ•˜๊ณ  ๊ฐ™์ด ์„ค์น˜ํ•ฉ๋‹ˆ๋‹ค.
109
+ $ pip install .
110
+
111
+ ์„ค์น˜ ํ›„์—๋Š” ์•„๋ž˜์™€ ๊ฐ™์ด importํ•ด์„œ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
112
+
113
+ <pre><code>
114
+ import korscideberta
115
+ tokenizer = korscideberta.tokenization_korscideberta_v2.DebertaV2Tokenizer.from_pretrained(path)
116
+
117
+ </code></pre>
118
+
119
  ### Out-of-Scope Use
120
 
121
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->