Model Card for Model-demo-35M

This model is used for a demo classification task

Task type

Protein-level Classification

Model input type

SA Sequence

Label meanings

0: A

1: B

2: C

3: D

LoRA config

  • r: 8
  • lora_dropout: 0.0
  • lora_alpha: 16
  • target_modules: ['query', 'intermediate.dense', 'key', 'value', 'output.dense']
  • modules_to_save: ['classifier']

Training config

  • optimizer:
    • class: AdamW
    • betas: (0.9, 0.98)
    • weight_decay: 0.01
  • learning rate: 0.001
  • epoch: 1
  • batch size: 2
  • precision: 16-mixed
Downloads last month
11
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for CluelessNovice/demo_cls

Adapter
(60)
this model