Source record

Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1woq1yg/what_tps_is_too_slow_for_you/.

Pipeline notes

The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.

Reddit post on r/LocalLLaMA asking community members what tokens-per-second they consider too slow for local LLM inference.

Crowdsourced tolerance for inference speed gives a practical benchmark when sizing local LLM hardware and quantization choices.

Cited by

No citations on record.