DeepSeek-V4.1-Flash-1017 on one RTX 3090: Big updates to the Delta Inference Engine v0.93. Same 41 tok/s at 192GB/IQ2 at better quality, usable from 64 GB RAM, first token ~40% sooner, new Unsloth quants at full speed, EXL3, basic multi-GPU, public CI and more
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xoq4vq/deepseekv41flash1017_on_one_rtx_3090_big_updates/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryDelta Inference Engine v0.93 adds support for running DeepSeek-V4.1-Flash-1017 on one RTX 3090, reporting 41 tokens per second with IQ2 quantization, faster first-token latency, 64 GB RAM support, Unsloth quants, EXL3, basic multi-GPU, and public CI.
Why it mattersRecords a tested local-model configuration and engine update, useful for comparing quantization, memory requirements, and serving features.
Cited by
No citations on record.