Update README.md

README.md

@@ -75,6 +75,45 @@ MIRA is licensed under apache-2.0. Please refer to the LICENSE file for more det
 - **Finetuned from model:** [unsloth/meta-llama-3.1-8b-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-bnb-4bit)
 
 
+To Load this model using unsloth
+
+``` from unsloth import FastLanguageModel
+    model, tokenizer = FastLanguageModel.from_pretrained(
+        model_name = "Msp/mira-1.0", # YOUR MODEL YOU USED FOR TRAINING
+        max_seq_length = 4096,
+        dtype = None,
+        load_in_4bit = True,
+        #token="hf.."
+    )
+    FastLanguageModel.for_inference(model) # Enable native 2x faster inference
+
+alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
+
+### Instruction:
+{}
+
+### Input:
+{}
+
+### Response:
+{}"""
+
+inputs = tokenizer(
+[
+    alpaca_prompt.format(
+        "your name is mira", # instruction
+        "whats your name", # input
+        "", # output - leave this blank for generation!
+    )
+], return_tensors = "pt").to("cuda")
+
+from transformers import TextStreamer
+text_streamer = TextStreamer(tokenizer)
+_ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 512)
+
+```
+
+
 This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)