PSA: llama.cpp -cram should be increased for agentic workflows (default is 8192)
2.40T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1wp5668/psa_llamacpp_cram_should_be_increased_for_agentic/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA Reddit post advising that the -cram parameter in llama.cpp should be raised above its default value of 8192 for agentic workflow use cases.
Why it mattersConcrete configuration advice for local LLM users; the default value may bottleneck agentic tasks that push larger context windows.
Cited by
No citations on record.