YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

<llama2 ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ์„ ๋†’์ด๊ธฐ ์œ„ํ•ด ์ถ”๊ฐ€์ ์ธ ๋ฏธ์„ธํŠœ๋‹์„ ์ง„ํ–‰ํ•˜์˜€๋‹ค.>

#์ฒซ๋ฒˆ์งธ ์‹œ๋„

  • ์‹คํ—˜ ๋‚ด์šฉ: ์ฃผ์–ด์ง„ ์ฝ”๋“œ ๊ทธ๋Œ€๋กœ ์ผ๋‹จ ์‹คํ–‰ํ•˜์—ฌ ์„ฑ๋Šฅ์„ ํ™•์ธํ–ˆ๋‹ค.

  • ์‹คํ—˜ ๊ฒฐ๊ณผ: TP: 337 TN: 390 PP: 132 PN: 141 Accuracy: 0.727

#๋‘๋ฒˆ์งธ ์‹œ๋„

  • ์‹คํ—˜ ๋‚ด์šฉ:
  1. ์ด์ „ ํ”„๋กœ์ ํŠธ๋ฅผ ์ง„ํ–‰ํ•˜๋‹ค๋ณด๋ฉด ๋ณดํ†ต epoch ์ˆ˜๋ฅผ ๋Š˜๋ฆฌ๋ฉด ์„ฑ๋Šฅ์ด ์ข‹์•„์ง์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ๋‹ค. ๋” ๋งŽ์€ ๋ฐ์ดํ„ฐ๋ฅผ ํ•™์Šตํ•ด๋ณด๊ธฐ ์œ„ํ•ด ์ฆ๊ฐ€์‹œ์ผฐ๋‹ค. (num_train_epochs: 1-> 1000๋กœ ๋ณ€๊ฒฝ)
  2. weight_decay๋Š” ๊ณผ์ ํ•ฉ์„ ๋ฐฉ์ง€ํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐ’์œผ๋กœ ๋„ˆ๋ฌด ํฌ๋ฉด underfitting, ๋„ˆ๋ฌด ์ž‘์œผ๋ฉด overfitting์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. 0.05 ์ •๋„ ๊ฐ’์„ ๋” ํ‚ค์›Œ์„œ overfitting์ด ์ผ์–ด๋‚˜์ง€ ์•Š๋„๋ก ํ–ˆ๋‹ค. (weight_decay: 0.05-> 0.1๋กœ ๋ณ€๊ฒฝ)
  3. max_grad_norm์ด ํฌ๋ฉด ๋ฐœ์‚ฐ์˜ ์œ„ํ—˜์ด ํฌ๊ณ  ์ˆ˜๋ ด์ด ์–ด๋ ค์›Œ์ง€๋ฉฐ, ์ •ํ™•๋„๊ฐ€ ๊ฐ์†Œ๋  ์ˆ˜ ์žˆ๊ธฐ ๋•Œ๋ฌธ์— ์–ด๋Š์ •๋„ ๊ฐ’์„ ์ค„์—ฌ์ฃผ์—ˆ๋‹ค. (max_grad_norm: 0.3-> 0.1๋กœ ๋ณ€๊ฒฝ)
  • ์‹คํ—˜ ๊ฒฐ๊ณผ: TP: 409 TN: 398 PP: 108 PN: 85 Accuracy: 0.807

<์•„์ฃผ ๋†’์€ ์ •ํ™•๋„๋Š” ํ™•์ธํ•  ์ˆ˜ ์—†์—ˆ์ง€๋งŒ ๊ทธ๋ž˜๋„ ์ •ํ™•๋„๊ฐ€ ๊ฐœ์„ ๋˜์—ˆ์Œ์„ ํ™•์ธํ•˜์˜€๋‹ค.>

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.