allenai
/

olmOCR-7B-0825-FP8

text-generation-inference

compressed-tensors

Model card Files Files and versions

olmOCR-7B-0825-FP8 / recipe.yaml

jakep-allenai's picture

Upload folder using huggingface_hub

a626e89 verified 11 days ago

history blame contribute delete

164 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: ['re:.lm_head', 're:model.visual.']
	scheme: FP8_DYNAMIC