Spaces:

AlexTransformer
/

ernie_embebbing_layer_example

Running

AlexTransformer commited on 16 days ago

Commit

c48013e

verified ·

1 Parent(s): 029adaf

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -11,7 +11,8 @@ tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
 model = AutoModelForCausalLM.from_pretrained(
     model_name,
     trust_remote_code=True,
-    torch_dtype=torch.float32,
 )
 embedding_layer = model.get_input_embeddings()

 model = AutoModelForCausalLM.from_pretrained(
     model_name,
     trust_remote_code=True,
+    device_map="auto",
+    torch_dtype=torch.bfloat16
 )
 embedding_layer = model.get_input_embeddings()