nm-testing
/

granite-8b-code-instruct-128k2of4-sparse

compressed-tensors

Model card Files Files and versions

granite-8b-code-instruct-128k2of4-sparse / recipe.yaml

horheynm's picture

Upload folder using huggingface_hub

3dd9b4b verified over 1 year ago

177 Bytes

	DEFAULT_stage:
	DEFAULT_modifiers:
	SparseGPTModifier:
	sparsity: 0.5
	mask_structure: '2:4'
	sequential_update: true
	targets: ['re:model.layers.\d*$']