LLAMA3-MED-v2.1 / README.md
rhyliieee's picture
Update README.md
53f1f6d verified
---
license: mit
datasets:
- rhyliieee/notes-completion-set
base_model:
- aaditya/Llama3-OpenBioLLM-8B
pipeline_tag: text-generation
library_name: transformers
---
Finetuned a pretrained Model with Lora, then applied Merge and Unload to Merge Peft Model with the Base Model.
Precision of Base Model is converted into half precision before Merging.
"""
# convert peft_model to half precision
peft8 = peft_model.half()
# merge peft model with base model
merged_peft_base = peft8.merge_and_unload()
"""