Does Multi-Agent Debate Improve AI Feedback on Research Papers?
4.80T1 sourcearXiv cs.MA
Source record
Published by arXiv cs.MA (T1 source). The original is at https://arxiv.org/abs/2607.14713.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryPre-registered, identity-masked experiment with 44 economics meta-analysis authors: a single-pass frontier model report was preferred over two multi-agent debate tools, despite debate using roughly thirty times the tokens. AI judges nearly always placed real journal referee reports last.
Why it mattersEmpirical counter-evidence to multi-agent debate hype: the simpler single-pass approach won on author-judged usefulness while using 1/30th the compute, and AI judges disagreed with the authors' ranking.
Cited by
No citations on record.
