AIdenU
/

SOLAR-10.7b-ko-Y24_v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

AIdenU commited on Mar 18, 2024

Commit

f4d1fb7

·

verified ·

1 Parent(s): f6dfd19

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -16,8 +16,8 @@ tags:
 ```
 from transforemrs import AutoTokenizer, AutoModelForCausalLM
-model = AutoModelForCausalLM.from_pretrained("AIdenU/SOLAR-10b-ko-Y24_v0.1", device_map="auto")
-tokenizer = AutoTokenizer.from_pretrained("AIdenU/SOLAR-10b-ko-Y24_v0.1", use_fast=True)
 prompt = [
   {'role': 'system', 'content': '당신은 지시를 매우 잘 따르는 인공지능 비서입니다.'},

 ```
 from transforemrs import AutoTokenizer, AutoModelForCausalLM
+model = AutoModelForCausalLM.from_pretrained("AIdenU/SOLAR-10.7b-ko-Y24_v0.1", device_map="auto", torch_dtype=torch.float16)
+tokenizer = AutoTokenizer.from_pretrained("AIdenU/SOLAR-10.7b-ko-Y24_v0.1", use_fast=True)
 prompt = [
   {'role': 'system', 'content': '당신은 지시를 매우 잘 따르는 인공지능 비서입니다.'},