2x CMP 170HX 64GB: GLM-5.3-Flash at 384K context / ~90 tok/s (EXL3, HBM-first setup) + Qwen3.8 comparison
2.85T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x0b1ws/2x_cmp_170hx_64gb_glm53flash_at_384k_context_90/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA community report benchmarking GLM-5.3-Flash at 384K context reaching about 90 tokens per second on 2x CMP 170HX 64GB GPUs in an HBM-first EXL3 configuration, with a side-by-side comparison to Qwen3.8.
Why it mattersFirsthand throughput numbers on repurposed mining GPUs at very long context — directly useful for anyone weighing budget HBM hardware against consumer cards for local inference.
Cited by
No citations on record.