YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
qwen-rag-lora-50k
This is a LoRA adapter trained on the Qwen model for RAG tasks.
Model Details
- Base Model: Qwen/Qwen2.5-0.5B-Instruct
- Training Type: LoRA
- Task: RAG (Retrieval-Augmented Generation)
Usage
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM, AutoTokenizer
# Load base model and tokenizer
model_name = "Qwen/Qwen2.5-0.5B-Instruct"
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True)
# Load LoRA weights
peft_model = PeftModel.from_pretrained(model, "TatvaJoshi-AHS/qwen-rag-lora-50k")
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.