---
library_name: transformers
tags:
- unsloth
- fim
- code-completion
license: mit
base_model:
- unsloth/Qwen2.5-Coder-14B-bnb-4bit
---

# qwen2.5-coder-14b-finetune

This model is a fine-tune of Qwen 2.5 Coder 14B on code from a single repo. 

More details: https://prvn.sh/build-your-own-github-copilot/

## How to Get Started with the Model

See Jupyter notebook here: https://github.com/prvnsmpth/finetune-code-assistant

## Training Details

### Training Data

Training data was generated from source files in https://github.com/hcengineering/platform. Dataset generation script: https://github.com/prvnsmpth/finetune-code-assistant/tree/master/src/dataset_gen

## Evaluation

The model was tested on a 2% holdout of source files in the target repository.

#### Metrics

1. Exact match
2. Corpus BLEU score

#### Summary

The fine-tuned model shows a 47% uplift in exact match FIM performance versus the baseline.