huypn16
/

sae-qwen-2.5-1.5B-OMS-16x

Model card Files Files and versions Community

huypn16 commited on Oct 15, 2024

Commit

06cadf5

·

verified ·

1 Parent(s): f9ab964

Update layers.8/cfg.json

Files changed (1) hide show

layers.8/cfg.json +1 -1

layers.8/cfg.json CHANGED Viewed

@@ -13,7 +13,7 @@
   'finetuning_scaling_factor': False,
   'context_size': 1024,
   'model_name': 'Qwen/Qwen2.5-1.5B-Instruct',
-  'hook_name': 'blocks.8.hook_resid_post',
   'hook_layer': 8,
   'hook_head_index': None,
   'prepend_bos': True,

   'finetuning_scaling_factor': False,
   'context_size': 1024,
   'model_name': 'Qwen/Qwen2.5-1.5B-Instruct',
+  'hook_name': 'blocks.8.hook_sae_acts_topk',
   'hook_layer': 8,
   'hook_head_index': None,
   'prepend_bos': True,