File size: 3,145 Bytes
5fb9deb 0255b32 33ece32 0255b32 2b75165 ca84cf7 2b75165 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 |
---
license: gemma
datasets:
- flytech/python-codes-25k
widget:
- text: "write a simple python function"
example_title: "Example 1"
- text: "write a python program using flask"
example_title: "Example 2"
- text: "make a todo list using python"
example_title: "Example 3"
- text: "print current date and time using python"
example_title: "Example 4"
language:
- en
pipeline_tag: text-generation
---
# Gemma-2b-it-finetuned-python-codes
This model card corresponds to the 2B finetuned version of the Gemma-2b-it model. You can visit the model card of the [2B Gemma Instruct](https://huggingface.co/google/gemma-2b-it).
**Author**: Dishank Shah
### Description
GifPC-2b (Gemma-2b-it-finetuned-python-codes) LLM is trained on a dataset containing Python code snippets.
This specialized training aimed to enhance Gemma-2b-it's understanding of Python syntax, semantics, and common programming patterns.
With this finetuning, Gemma-2b-it is now proficient in not only comprehending Python code but also capable of assisting in debugging tasks.
Users can leverage its trained knowledge to seek guidance on Python-related issues, understand code logic, and identify potential errors within their programs.
This specialized Gemma-2b-it variant serves as a valuable tool for programmers seeking assistance and guidance in Python programming and debugging tasks.
### Usage
Below we share some code snippets on how to get quickly started with running the model. First make sure to `pip install -U transformers`, then copy the snippet from the section that is relevant for your usecase.
#### Running the model on Google Colab CPU
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "shahdishank/gemma-2b-it-finetune-python-codes"
HUGGING_FACE_TOKEN = "YOUR_TOKEN"
tokenizer = AutoTokenizer.from_pretrained(model_name, token="HUGGING_FACE_TOKEN")
model = AutoModelForCausalLM.from_pretrained(model_name, token="HUGGING_FACE_TOKEN")
prompt_template = """\
user:\n{query} \n\n assistant:\n
"""
prompt = prompt_template.format(query="write a simple python function") # write your query here
input_ids = tokenizer(prompt, return_tensors="pt", add_special_tokens=True)
outputs = model.generate(**input_ids, max_new_tokens=2000, do_sample=True, pad_token_id=tokenizer.eos_token_id)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)
```
## Model Data
Data used for model training [python-codes-25k](https://huggingface.co/datasets/flytech/python-codes-25k).
### Training Dataset
These models were trained on a dataset of text data that includes a wide variety
of python codes. Here are the key components:
* Instruction: The instructional task to be performed / User input.
* Input: Very short, introductive part of AI response or empty.
* Output: Python code that accomplishes the task.
* Text: All fields combined together.
This diverse data source is crucial for training a powerful
language model that can handle a wide variety of different tasks.
### Usage
This LLM can be used for:
* Code generation
* Debugging
* Learn and understand various python coding styles |