Spaces:

VicGerardoPR
/

ChatBotOpenAi

Sleeping

VicGerardoPR commited on Jan 28

Commit

fc75423

verified ·

1 Parent(s): 2429727

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -18,8 +18,7 @@ def load_model():
             bnb_4bit_use_double_quant=True
         )
-        model = AutoModelForCausalLM.from_pretrained(
-            "microsoft/Phi-3-mini-4k-instruct",
             device_map="mps",  # Forzar uso de Metal
             quantization_config=quantization_config,
             torch_dtype=torch.bfloat16,  # Tipo de dato compatible

             bnb_4bit_use_double_quant=True
         )
+            model_name = "HuggingFaceH4/zephyr-7b-beta"  # Alternativa compatible
             device_map="mps",  # Forzar uso de Metal
             quantization_config=quantization_config,
             torch_dtype=torch.bfloat16,  # Tipo de dato compatible