--- base_model: unsloth/Llama-3.2-3B-bnb-4bit tags: - transformers - unsloth - llama - trl license: apache-2.0 language: - en datasets: - quangduc1112001/python-code-DPO-fine-tune pipeline_tag: question-answering --- # Uploaded model - **Developed by:** PriyanshiD - **License:** apache-2.0 - **Finetuned from model :** unsloth/Llama-3.2-3B-bnb-4bit This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. [](https://github.com/unslothai/unsloth)