File size: 919 Bytes
f12897c
 
 
 
57fffcd
 
 
 
 
f12897c
 
57fffcd
f12897c
57fffcd
f12897c
57fffcd
f12897c
 
 
57fffcd
f12897c
 
 
 
 
57fffcd
f12897c
 
 
57fffcd
f12897c
 
 
57fffcd
 
f12897c
 
 
57fffcd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
---
library_name: transformers
tags:
- unsloth
- fim
- code-completion
license: mit
base_model:
- unsloth/Qwen2.5-Coder-14B-bnb-4bit
---

# qwen2.5-coder-14b-finetune

This model is a fine-tune of Qwen 2.5 Coder 14B on code from a single repo. 

More details: https://prvn.sh/build-your-own-github-copilot/

## How to Get Started with the Model

See Jupyter notebook here: https://github.com/prvnsmpth/finetune-code-assistant

## Training Details

### Training Data

Training data was generated from source files in https://github.com/hcengineering/platform. Dataset generation script: https://github.com/prvnsmpth/finetune-code-assistant/tree/master/src/dataset_gen

## Evaluation

The model was tested on a 2% holdout of source files in the target repository.

#### Metrics

1. Exact match
2. Corpus BLEU score

#### Summary

The fine-tuned model shows a 47% uplift in exact match FIM performance versus the baseline.