Lawyer with too many GPUs, part 4: DeepSeek-V4.1-Flash on eight V100s from 2018. 200+ tok/s on code, ~110 on legal writing, 2,200 tok/s prefill at 128K, 524K context, every weight in VRAM
3.00T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xoubyo/lawyer_with_too_many_gpus_part_4_deepseekv41flash/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA Reddit post reports running DeepSeek-V4.1-Flash on eight V100 GPUs, with claimed speeds of over 200 tokens per second for code, about 110 for legal writing, 2,200-token prefill at 128K context, and 524K context support.
Why it mattersDocuments an unusual eight-V100 deployment with measured throughput, long-context behavior, and all weights held in VRAM for comparison with other local inference setups.
Cited by
No citations on record.