kristaller486
/

test

8-bit precision

compressed-tensors

Model card Files Files and versions

test / recipe.yaml

kristaller486's picture

Upload folder using huggingface_hub

b5cc33e verified 6 months ago

history blame contribute delete

213 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: ['re:.lm_head.', 're:.embed_tokens.', 're:vision_tower.', 're:multi_modal_projector.']
	scheme: NVFP4