ehristoforu
/

Llama3-8B-Instruct-pruned

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama3-8B-Instruct-pruned / mergekit_config.yml

ehristoforu's picture

Upload folder using huggingface_hub

61704ae verified 7 months ago

history blame contribute delete

234 Bytes

	slices:
	- sources:
	- model: NousResearch/Meta-Llama-3-8B
	layer_range: [0, 21]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B
	layer_range: [29,32]

	merge_method: passthrough
	dtype: bfloat16