Lawyer with too many GPUs, part 3: DeepSeek-V4.1-Flash on 2x DGX Spark + an old 3090 box. 2,600+ tok/s prefill to 256K, 322 tok/s structured output, full stack and raw data published
3.15T2 sourcer/LocalLLaMA
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xk20x5/lawyer_with_too_many_gpus_part_3_deepseekv41flash/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA hardware build combines two NVIDIA DGX Spark systems with an RTX 3090 desktop to run DeepSeek-V4.1-Flash. It reports over 2,600 tokens per second prefill at 256K context and 322 tokens per second for structured output, with the full stack and raw data published.
Why it mattersThe disclosed configuration, throughput measurements, and underlying data provide a reproducible reference for high-throughput local inference and structured-output workflows.
Cited by
No citations on record.