YOYO-AI
/

QwQ-coder-32B

Text Generation

text-generation-inference

Model card Files Files and versions

QwQ-coder-32B / mergekit_config.yml

YOYO-AI's picture

Upload folder using huggingface_hub

90c3e28 verified 8 months ago

235 Bytes

	merge_method: sce
	models:
	- model: Qwen/QwQ-32B
	- model: Qwen/Qwen2.5-Coder-32B-Instruct
	base_model: Qwen/Qwen2.5-Coder-32B
	parameters:
	select_topk: 1
	dtype: bfloat16
	tokenizer_source: Qwen/QwQ-32B
	normalize: true
	int8_mask: true