Lawyer with too many GPUs, part 5: DeepSeek-V4.1-Flash at near-NVFP4 quality on eight V100s from 2018. 524K context, 100+ tok/s decode, ~160 tok/s with two chats at once, and my legal harness now runs on it, 100% local
3.15T2 sourcer/LocalLLaMA
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xus81t/lawyer_with_too_many_gpus_part_5_deepseekv41flash/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA Reddit author reports running DeepSeek-V4.1-Flash on eight 2018 V100 GPUs, claiming near-NVFP4 quality, 524K context, over 100 tokens per second, and about 160 tokens per second with two simultaneous chats, now powering a fully local legal workflow.
Why it mattersThe post provides an unusual legacy-GPU deployment with concrete throughput and context claims, relevant to readers building fully local, long-context model setups.
Cited by
No citations on record.