Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x89ptz/qwen_27b_iq4_xs_q8q4_kv_at_full_262k_context_on_a/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA user on r/LocalLLaMA reports running Qwen 27B with IQ4_XS weights and Q8/Q4 KV cache at the full 262k context window on a 16GB RX 9070 XT, achieving 80+ tokens/sec decode speed using Adaptive KV Streaming.
Why it mattersConcrete configuration and measured throughput for fitting a 27B model with 262k context into 16GB VRAM. Useful baseline for sizing local long-context setups on consumer GPUs.
Cited by
No citations on record.