microsoft
/

Phi-4-mini-instruct

pavankumarbalijepalli commited on 14 days ago

Commit

fad2462

verified ·

1 Parent(s): d02e859

Update sample_finetune.py (#17)

- Update sample_finetune.py (6c4e0743182186aa1eee5b6b59a7dfe4e20ba8e0)

Co-authored-by: Pavan Kumar Balijepalli <[email protected]>

Files changed (1) hide show

sample_finetune.py CHANGED Viewed

@@ -132,7 +132,7 @@ checkpoint_path = "microsoft/Phi-4-mini-instruct"
 model_kwargs = dict(
     use_cache=False,
     trust_remote_code=True,
-    attn_implementation="flash_attention_2",  # loading the model with flash-attenstion support
     torch_dtype=torch.bfloat16,
     device_map=None
 )

 model_kwargs = dict(
     use_cache=False,
     trust_remote_code=True,
+    attn_implementation="flash_attention_2",  # loading the model with flash-attention support
     torch_dtype=torch.bfloat16,
     device_map=None
 )