Qwen3.8-Flash-Next @ 1.66bpw-exl3 STABLE under 36gb
1.80T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xbgi6i/qwen38flashnext_166bpwexl3_stable_under_36gb/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryReddit user reports that the Qwen3-8B-Flash-Next model quantized at 1.66 bits per weight via exl3 runs stably within a 36GB VRAM budget on local inference hardware.
Why it mattersConfirms a specific model-plus-quantization fit for ~36GB VRAM rigs, sparing readers with that hardware a trial-and-error round.
Cited by
No citations on record.