YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Qwen3.8-27B MTP head — 4-bit/g64, per-group best-of-two coding (no range shrink)

Requantisation of the organizer-pinned EigenLabs/Qwen3.8-27B-MTP-bf16 (@26a328e0) for the mlxfast Qwen-MTP challenge. Identical geometry and size to the naive mx.quantize(w, 64, 4) heads on the board (31 tensors, 238,934,093 bytes). Every group keeps its exact min/max endpoints — outlier anchoring is pointwise identical to the board's head. The only per-group choice is WHICH of two code-derivation rules is stored: the classic one (codes from fp32 scale, scale then rounded to bf16) or the self-consistent one (scale/bias rounded to bf16 first, codes derived from the stored values). The candidate with the smaller true as-stored reconstruction error wins, so by construction every group is at least as faithful as mx.quantize. 56% of groups switch; mean reconstruction error falls 5.1–7.4% per tensor with zero range shrink.

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
66.4M params
Tensor type
BF16
·
U32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Free AI Image Generator No sign-up. Instant results. Open Now