license: mit | |
datasets: | |
- rhyliieee/notes-completion-set | |
base_model: | |
- aaditya/Llama3-OpenBioLLM-8B | |
pipeline_tag: text-generation | |
library_name: transformers | |
Finetuned a pretrained Model with Lora, then applied Merge and Unload to Merge Peft Model with the Base Model. | |
Precision of Base Model is converted into half precision before Merging. | |
""" | |
# convert peft_model to half precision | |
peft8 = peft_model.half() | |
# merge peft model with base model | |
merged_peft_base = peft8.merge_and_unload() | |
""" |