Source record

Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x1zhnx/qwen3827b_udiq4_xs_heretic_mtp_on_a_16_gb_card/.

Pipeline notes

The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.

A Reddit user reports running Qwen3 27B at UD-IQ4_XS Heretic quantization with Multi-Token Prediction on a 16GB GPU at 55-68 tokens per second, with additional 12GB and 24GB VRAM builds available.

Concrete VRAM-to-throughput numbers for a specific quant and MTP setup let readers judge local deployment feasibility on consumer hardware.

Cited by

No citations on record.