SHRDFU-7b LoRA
- Developed by: maldv
- License: cc-by-nc-4.0
- Finetuned from model: cgato/Thespis-CurtainCall-7b-v0.3
- Methodology: Targeting attention layers with peft to condition; then small full layer tuning; extending intelligence and problem solving w/ crabcanon
As I work on understanding how to layer information in to the model, this dataset proved to be very interesting. It did show that it is very easy to overbake with inadequate sample size; but it sure thinks it is a smart model now.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.
Model tree for maldv/SHRDFU-7b-overbaked-lora
Base model
cgato/Thespis-CurtainCall-7b-v0.3