Update README.md

README.md

@@ -25,7 +25,7 @@ Now imagine, if you will, having this bad boy generate a bunch of different prom
 
 In other words, giving it a system prompt like "You are a creative writing partner", "You are an advanced coding assistant", "You are a damn good psychologist", etc, you can can quickly generate prompts for a niche dataset that can then be answered by large model. 
 
-In a different language: Ved hjælp af Husskades indsigt, hvor man udnytter sprogmodellers natur til at skabe tilpasningsdata, kan man med fordel bruge denne sprogmodel til at skrive instruktioner, og endda styre indholdet ved hjælp at system beskeden.
+In a different language: Ved hjælp af Husskades indsigt, hvor man udnytter sprogmodellers natur til at skabe tilpasningsdata, kan man med fordel bruge denne sprogmodel til at skrive instruktioner, og endda styre indholdet ved hjælp af system beskeden.
 
 ## Training
 
@@ -50,7 +50,7 @@ All the datasets were used seperately and merged together using [Model Stock](ht
 It actually generates an EOS token at the end of a *"user"* prompt. Lawdy that has been a pain when trying to use large models for this purpose. Good luck; have fun.
 
 
-### Example
+### Response preview
 Giving the model this text at a temperature of 0.9:
 ```
 <|im_start|>system
@@ -60,4 +60,37 @@ You are an AI coding assistant.<|im_end|>
 Will return this:
 ```
 Hey, can you help me write a simple program that generates a Fibonacci sequence until a certain number of terms? Like this: Fib(5) should give me the first five numbers in the series.
+```
+
+### Code example to use it
+
+```python
+import torch
+from unsloth import FastLanguageModel
+
+model, tokenizer = FastLanguageModel.from_pretrained(
+	"trollek/LittleInstructionMaker-4B-v0.1",
+	dtype=torch.bfloat16,
+	load_in_4bit=True,
+	max_seq_length=8192
+)
+FastLanguageModel.for_inference(model)
+
+def instruction_generator(system_message: str, num_instructions: int) -> str:
+	if system_message is None or "":
+		raise ValueError
+	if num_instructions < 1:
+		raise ValueError
+	magpie_template = f"<|im_start|>system\n{system_message}<|im_end|>\n<|im_start|>user\n"
+	input_ids = tokenizer(danube_magpie, return_tensors="pt").input_ids.to("cuda")
+	for idx in range(num_instructions):
+		generated_ids = model.generate(input_ids, max_new_tokens=512, temperature=0.9, repetition_penalty=1.1, do_sample=True, eos_token_id=tokenizer.eos_token_id)
+		response = tokenizer.decode(generated_ids[0][input_ids.shape[-1]:], skip_special_tokens=True, clean_up_tokenization_space=True)
+		yield response
+
+for instruct in instruction_generator("You are an AI coding assistant.", 2):
+	print(instruct)
+
+# Can you help me write a simple programming language syntax?
+# I want to create a Python program for a social media app that allows users to post and comment on stories. The message I want to convey is that staying connected with others is essential in life. Can you suggest a way to design the program?
 ```