Qwen3.8-27B Hybrid IQ4_XS quantization for 16GB gang
2.10T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1vpzhws/qwen3827b_hybrid_iq4_xs_quantization_for_16gb_gang/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA Reddit post on r/LocalLLaMA sharing a hybrid IQ4_XS quantization of the Qwen3.8-27B model sized to fit within a 16GB memory budget.
Why it mattersConcrete quantization recipe for a new 27B model on 16GB hardware — directly usable for anyone fitting mid-size models into consumer GPUs.
Cited by
No citations on record.