| license: mit | |
| datasets: | |
| - rhyliieee/notes-completion-set | |
| base_model: | |
| - aaditya/Llama3-OpenBioLLM-8B | |
| pipeline_tag: text-generation | |
| library_name: transformers | |
| Finetuned a pretrained Model with Lora, then applied Merge and Unload to Merge Peft Model with the Base Model. | |
| Precision of Base Model is converted into half precision before Merging. | |
| """ | |
| # convert peft_model to half precision | |
| peft8 = peft_model.half() | |
| # merge peft model with base model | |
| merged_peft_base = peft8.merge_and_unload() | |
| """ |