miguelcarv
/

phi-2-slimorca

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

miguelcarv commited on Feb 27, 2024

Commit

8721165

·

verified ·

1 Parent(s): 688b22e

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -21,7 +21,6 @@ import transformers
 model = transformers.AutoModelForCausalLM.from_pretrained(
     "miguelcarv/phi-2-slimorca",
     trust_remote_code=True,
-    torch_dtype=torch.bfloat16
 ).to('cuda')
 tokenizer = transformers.AutoTokenizer.from_pretrained("microsoft/phi-2")

 model = transformers.AutoModelForCausalLM.from_pretrained(
     "miguelcarv/phi-2-slimorca",
     trust_remote_code=True,
 ).to('cuda')
 tokenizer = transformers.AutoTokenizer.from_pretrained("microsoft/phi-2")