Xolotl (Strata based) - DeepSeek-V4.1-Flash (552B) on a single 4090 at ~27 tok/s, Uncensored 1017 quant coming in a couple of days
2.55T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x8m0jj/xolotl_strata_based_deepseekv41flash_552b_on_a/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA new Strata-based inference engine called Xolotl is reported to run DeepSeek-V4.1-Flash, a 552B parameter model, on a single RTX 4090 at roughly 27 tokens per second, with an uncensored 1017-bit quantization announced as forthcoming.
Why it mattersSingle-GPU inference of a 500B+ class model at usable speed, if reproducible, raises the ceiling for local agentic setups on consumer hardware.
Cited by
No citations on record.