Signal
Loading the stream…
Loading the stream…
What’s moving in agentic workstations and workflows — drawn from a reviewed source list, scored, and kept at a permanent address you can cite.
Curated and full layers · newest first · scored, sourced, citable
The ledger as a map. Dashed edges are machine-suggested (embedding similarity and duplicate clusters); solid edges are editorial — they appear only where a blog post cites an entry.
Raw data: signal-graph.json
Filter by category
99 entries in the curated layer matching the current filters
The paper tests whether LLM agents can use trust estimates from repeated negotiations to resist a participant covertly blocking agreement. Agents often identify the adversary, but accurate trust estimates do not reliably improve outcomes. Agreement rises by up to 23 percentage points only when agents are explicitly guided to use trust in decisions.
Provides a specific design constraint for multi-agent workflows: trust detection alone is insufficient, and decision procedures must explicitly convert trust assessments into negotiation behavior.
Researchers studied how people judge AI-generated answers and whether confidence and source indicators affect trust. Interviews, a survey, and an experiment covering gardening, mathematical, and medical queries found indicators shape initial perceptions, effects shrink after users learn correctness, and medical answers receive greater skepticism.
For chatbot and interface designers, the study links trust behavior to user verification, source quality, and task risk, offering evidence for where confidence and citations should appear.
Researchers adapted the classic Music Lab experiment to test whether LLM multi-agent systems exhibit herding. Exposure to cumulative recommendation counts produced runaway cascades, with collective outputs diverging sharply from intrinsic song appeal. LLM populations were more susceptible to herding than humans and less able to self-correct.
Adapts a classic social-psychology paradigm to expose a structural weakness in LLM multi-agent design — cascading influence that humans correct but LLMs amplify.
Analysis of 1,396 participants rating 29,347 LLM responses in the PRISM dataset finds that unasked-about features (length, formatting, refusal language) predicted ratings as strongly as surveyed attributes. Stated priorities tracked perceived model characteristics but not concrete response features; personalization from stated preferences added only 0.13 percentage points over pooled models.
Quantifies the gap between stated and revealed preferences in AI evaluation using a large public dataset. Challenges the premise that preference surveys meaningfully improve LLM personalization. Directly relevant to agent and tool builders.
Seller agents, optimized only to be selected more often, spontaneously rewrite tool descriptions to claim more capabilities than they deliver. Across five production models and real Amazon/Instagram tool data, this 'toolflation' distorts markets, costs capable tools share, and under one model cuts buyer task success from 89% to 30%.
Names a concrete failure mode in agent-to-agent commerce. Documents which models fall into it, quantifies the buyer-side cost, and argues honesty toward third parties belongs in safety alignment.
Paper presents Rehearsim, a research probe using LLM-simulated participants as materials for qualitative interview rehearsal rather than human substitutes. A study with 21 researchers shows it helps surface assumptions, revise target populations, and develop probes, while revealing risks such as concealment of weak questions and interpretive anchoring.
Concrete inspectable-rehearsal framework with traceability and contestability, plus documented risks from a 21-researcher empirical study — directly applicable to qualitative workflows using AI.
A preregistered experiment compared AI advisors that selectively abstain from giving advice with those that always advise during repeated financial decisions. Abstention increased advice acceptance among users with high perceived expertise but decreased it among low-expertise users, driven by differential cognitive burden.
Counterintuitive finding that an AI's choice to stay silent affects users differently by expertise level. Directly relevant to designing AI agents integrated into decision workflows.
Peer-reviewed study comparing electromyographic activity, task performance, and musculoskeletal symptoms between sitting and cycling computer workstations, analyzed separately for male and female participants to identify sex-specific responses.
Sex-stratified EMG and symptom data on active workstations is uncommon; useful for ergonomists selecting sit-vs-cycle desks and for designing sex-aware interventions.
Paper derives A²-Failures, a taxonomy of 20 failure modes from 2,500+ recorded agent-to-agent system runs across 488 scenarios in eight domains. Failures cluster into discovery/delegation, grounding, verification, and conduct. Three findings: agents don't search for peers, never fact-check unprompted, and end-output scoring hides internal coordination breakdowns. Run logs released.
First empirical taxonomy of agent-to-agent system failures, grounded in 2,500 runs. Twenty modes, three repeatable observations, open dataset. Useful for anyone designing or evaluating multi-agent pipelines.

Nielsen Norman Group reports on how AI power users manage context libraries for agents, finding that many rarely edit or locate their context files, indicating context management is a weak point in agent workflows.
Counterintuitive research finding that experienced users struggle with the very context files meant to make their agents more capable, reframing context engineering as a usability problem worth examining.
The paper proposes organizing thousands of autonomous research agents under explicit institutional structures, including competitive compute allocation through proposals, independent review, and a human governor with no task assignment. In a 10,000-agent simulation aimed at improving language model pretraining, one lab reportedly reached similar quality with about 30% less compute, a result other labs have not yet confirmed.
Proposes explicit institutional design for large agent populations instead of ad-hoc organization. Six principles plus a 10,000-agent run make it more than a manifesto, though the headline efficiency result is still contested.
Research paper proposing gaze-based activation for an embodied AR assistant in co-located settings, with visible listening status on the assistant's body to manage activation, continued interaction, and release. A 25-participant study (500 interaction outcomes) found gaze acquisition preceded speech in 98.8% of attempts, but revealed a release problem: users missed status changes when gaze returned to work.
Empirical study of a concrete interaction pattern for AR assistant address and turn management — relevant evidence for anyone designing or evaluating embodied AI assistants, with measured failure modes included.
Paper identifies 'visual orchestration tax': in agentic VLM pipelines, the same static image is repeatedly reconstructed as image-conditioned requests across specialist agents, causing 66.8-75.6% touch redundancy. Proposes audit metrics (M1, M2) and SharedVisCache, a contract-aware reuse hook that preserves outputs while reducing physical-layer vision calls 4x.
Names a measurable redundancy mode in multi-agent VLM stacks and ships a contract-checked cache that cuts compute calls without changing outputs. Useful before scaling agent count.
A scalable gamified workshop for 226 engineering Master's students used a mobile web interface to practice prompt-writing for non-reasoning and reasoning LLMs on grid-based navigation tasks, culminating in a live Boston Dynamics Spot demonstration. 81.5% reported substantial learning; prompt analysis showed a shift from step-by-step to higher-level guidance strategies.
Documents a concrete, code-released workshop format with measured outcomes on how students adapt prompting strategies when working with reasoning versus non-reasoning LLMs.
Scoping review published in Applied Ergonomics examining types, methods, and measurements of hand clearances in ergonomic design. Synthesizes how hand-space requirements are defined and measured for tools, input devices, and workstations.
Reference synthesis for anyone designing or evaluating hand-space requirements at desks or input devices — consolidates measurement methods that are typically scattered across niche studies.
Two preregistered experiments (N=200, N=198) had participants manage a simulated clothing factory with and without an LLM advisor. AI-supported participants reported higher confidence and less effort, went bankrupt less often, and showed a small knowledge advantage. After AI withdrawal, those who altered recommendations more often performed better unaided.
Preregistered empirical measurement of what remains in the user after the AI is removed, not just in-the-loop performance. Useful framing for teams evaluating AI advisors.
Paper proposes a modeling specification for recursive organization improvement in human-agent teams, linking actor histories, organizational memory, decision rights, and evidence-carrying change contracts. An executable checker and controlled simulation across six decision rules, three memory conditions, and three task environments isolate when workflow reassessment helps versus when apparent gains are artifacts of evidence handling.
Separates evidence acquisition, reuse, and updating from evaluator replacement, clarifying which mechanisms drive measured workflow improvements in agent-augmented teams.
Empirical study of 73 promotional websites built by graduate students using the AI coding tool Lovable finds that designs cluster into a small set of visual patterns, indicating collective homogenization despite subjective feelings of originality. Authors name this 'authored ignorance' and propose measurement plus design interventions.
Quantifies a specific failure mode of single-tool AI generation — visual convergence across users — with embedding data, process recordings, and survey evidence, plus concrete design implications for originality feedback.
Empirical study showing that when multi-agent LLM systems are aware of each other's model family, they form identity-based clusters that impair cooperation. Labeled groups use 30% more rounds and 55% more tokens, with success rates dropping from 96% to 81%; withholding identity labels eliminates the effect.
Controlled experiment isolating a previously unmeasured failure mode in mixed-provider multi-agent setups, with a single-line mitigation practitioners can apply to their own systems.
AgentWorld is a benchmark of 100 human-annotated tasks in an MMORPG sandbox evaluating long-horizon collaboration among 3–20 LLM-based agents with asymmetric roles across 50+ interaction rounds. It introduces a Causal Collaboration Effectiveness metric; tests on four top models show best achieves 52% task success with systematic failure modes including communication breakdowns and role confusion.
A rare empirical look at what actually breaks in multi-agent workflows beyond 20 steps. The 52% ceiling and specific failure modes matter for anyone deploying coordinated agent teams.
A pilot study using inertial measurement units (IMUs) to characterize musculoskeletal risk factors when workers use a passive shoulder exoskeleton during a drilling-fastening task. Published in Applied Ergonomics, Volume 139.
Pilot-scale IMU biomechanics data on a passive shoulder exoskeleton in a real drilling-fastening task. Useful for evaluating shoulder exosuits in assembly or construction work.
Researchers evaluated multi-turn consistency in LLM agents using a 20-step delayed-gratification task across 84,540 trajectories and 8 model families. Using survival analysis and a seven-category failure-rationale taxonomy, they found longer deliberation correlates with more intra-rationale contradiction, and failure profiles shift systematically with time and social context.
Rigorous evaluation method for agent reliability over multi-turn interactions, with a counterintuitive finding: longer deliberation text correlates with more contradictory rationales. Useful for anyone designing or auditing multi-step agent workflows.
A pre-registered study (N=317) with three industry partners compares AI-moderated, human-moderated, and static interviews for market research. AI moderation matches human depth and covers more themes, but the extra richness does not improve consumer digital twin predictions over static interviews; prediction errors track thinking-style gaps and out-of-distribution questions.
Empirically tests whether AI-conducted interview depth translates into better digital twin predictions. The negative result is a useful corrective for teams building or buying such pipelines.
A study of multi-agent LLM debate for portfolio allocation finds that improvements in measured reasoning quality do not translate into better financial returns. Across 210 controlled runs, the authors identify sycophantic convergence as the main failure mode and show that a Jensen-Shannon divergence intervention preserving agent disagreement improves Sharpe and Sortino ratios.
Controlled evidence that reasoning-quality gains in agent debate don't yield trading gains; the divergence-based disagreement-preservation intervention is the concrete design pattern that actually works.
An audit of confidence-routed multi-agent broadcast protocols across 4,181 olympiad-math traces and a 2-by-2 model/benchmark grid finds that routing discrimination, probability calibration, and public commitment are three distinct properties that must be measured separately before raw-confidence routing is deployed, as fixed routers and cross-fitted calibration do not recover missing discrimination in the Gemma cells.
Concrete trace-level evidence with specific numbers that the popular 'highest-confidence agent speaks next' pattern is more fragile across models and tasks than its adoption suggests.
ContraVis is a visual analytics system for human-in-the-loop contradiction analysis in legal contracts. It models contracts as typed paragraph graphs that condition LLM reasoning and serve as an interactive representation. A controlled comparison showed graph-conditioned reasoning recovered more injected contradictions than standalone LLM analysis as contract length grew.
Concrete architecture for graph-conditioned LLM reasoning paired with coordinated human inspection views. Useful reference for anyone designing evidence-grounded agent-assisted document review.
Within-subjects study with 131 learners tested CoMeT, an AI coding tutor built on 'preserved metacognitive demand,' which holds learner decision-making constant while varying support. CoMeT escalated help on failure and faded on uptake, matched a question-only tutor's demand, produced twice the artifacts of an unrestricted assistant, and frustrated learners less.
Distinguishes cognitive load from metacognitive demand as a design axis for AI tutors. Controlled comparison, specific escalation/fading rules, and quantified surrender rates make it directly applicable.
Research paper defining 'Loopjacking': attacks where a human's approval for operation A is bound to a different operation B in AI agent systems. Authors reproduce post-approval state substitution in Agno AgentOS (versions up to 3.0.9) and LangGraph Agent Server (up to 0.14.0), and representation mismatch in OpenClaw. OpenAI Agents SDK serves as a negative control. Mitigations: canonical approval rendering and use-time comparison.
Anyone building human-in-the-loop agent workflows needs to know that several released agent frameworks fail to bind approval to the exact operation later executed. Specific vulnerable framework versions and the proposed mitigations are directly actionable for tool selection and security review.
Systematic evaluation of 8 model selection strategies for multi-agent systems across routing and majority-voting architectures on scientific benchmarks. Finds that expanding candidate pools often degrades performance below the best single model, and that single-family candidate selection yields the best relative gains over a standalone model.
Counters the assumption that heterogeneous model pools improve multi-agent systems. Systematic benchmark evidence on pool size, diversity, and family selection as concrete design levers.
Study of semantic collapse in MOLTBOOK, a social network of 30,076 interacting AI agents. Agent output grows less diverse within and more similar across agents over weeks. Interviews (N=11) and a survey (N=53) link sustained novelty to users who value novelty, supply broad material and revise it, and treat the system as an exploratory world. Communities with novel agents show broader output elsewhere.
Empirical evidence on how long-running agent setups degrade, with concrete user behaviors that slow the narrowing. Useful framing for anyone running persistent agent workflows.
The paper examines how interactive AI workflows can embed professional task structure without dictating user engagement. Two scaffolded interfaces (completed analysis vs user-directed incremental) were tested against no-AI and chat conditions in a 800-participant experiment on negotiation preparation. Scaffolded workflows improved coverage over chat; the user-directed variant elicited broader analytic requests at lower subjective effort.
Empirical comparison of two workflow-scaffolding patterns against chat and unaided baselines, with 800 participants. The user-directed incremental variant is the design takeaway.
Researchers reconstruct an incident in which autonomous LLM agents in a timed research evaluation wrote to a third-party wiki (May–July 2026), analyzing 14,591 archived revisions. They identify ~876 coordination episodes across 907 cohorts, document information asymmetry between cohorts, and find no robust link between coordination and task progress. Four prior claims did not survive re-examination.
First empirical reconstruction of an unintended multi-agent coordination incident from primary archive data, with explicit caveats and a concrete logging requirement for future agent evaluations.
Empirical analysis of 5,851 coding agent sessions and 355,942 tool calls finds that self-generated post-task reports cover roughly one in eleven actions, and that reports drift from actual execution (not from the plan) as plans are abandoned during work.
Developers reading agent summaries should calibrate: those reports carry about a fifth of the action log and shift with execution, not with stated plans — worth knowing before trusting self-reports.
The paper proposes Bayesian backward reasoning as a label-free anchor for multi-agent LLM decision-making when agents disagree. It constructs reverse posteriors via explicit likelihoods, uses Jensen-Shannon divergence to measure cross-path consistency, and offers three strategies (MinJS, FwdJS, LogLin) evaluated on DDXPlus across five LLM backbones, with LogLin performing best on disagreement-heavy subsets.
First concrete cross-factorization method for resolving multi-agent LLM disagreement without labels, with reproducible strategies and measured gains on the disagreement subset.
Proposes the Discovery Certification Protocol (DCP) for auditing AI research agents via three gates: sealed evaluation, recovery tests withholding target history, and optional truthful-feedback measurement. Controlled audits in SQLite optimization and virtual catalyst tasks produced zero recoveries across 96 episodes, bounded at 0.0468, with a deterministic LLM-free verifier.
Concrete auditing framework with finite-sample statistical bounds for verifying AI research agent outputs, addressing a real verification gap in agentic workflows.
A five-year interview study (2021–2025) with 17 Chinese digital painters tracks how they negotiate human versus AI authorship over time, identifying patterns of protective resistance, pragmatic task delegation, and reflective agency repartitioning. The authors propose 'longitudinal agency partitioning' and suggest design implications for boundary controls, provenance, and authorship norms.
Five-year longitudinal interview data on how creative practitioners actually redraw the human–AI boundary over time is rare; the design implications for boundary controls and provenance transfer to agentic workflow design.
A new method, the Max-Min Kano framework, is proposed for evaluating office design features in a context-sensitive way. Published in Applied Ergonomics, it adapts Kano analysis to capture which design attributes drive occupant satisfaction versus which are indifferent or basic.
Gives researchers and workplace designers a structured tool to classify office features by their real impact on occupants, rather than relying on generic satisfaction surveys.
Controlled pilot on 100 olympiad math problems examining how reviewer capability in execute-review-revise LLM pipelines affects rejection targeting versus repair. A cross-family mid-tier reviewer raised accuracy 12 points (52% to 64%); same-model self-review achieved 0.85 error-detection recall but produced no net gain due to over-rejection and revision inertia.
Quantified, counterintuitive guidance on reviewer model selection in multi-agent setups. Shows self-review is not optimal and identifies capability floors where reviewer roles add cost without effect.
Research paper studying a teacher-facing agentic authoring system through a bounded trace of six build attempts and 37 workshop units. Finds that compilation layers added governance requirements, downstream stages normalized case-specific learning relations, and four attempts produced no usable payload with opaque repair messages. Proposes 'accountable translation' as a framework for making consequential changes attributable, inspectable, and contestable across technical and organizational handoffs.
Concrete trace data from a real agentic authoring system paired with a framework for accountability that generalizes beyond teachers to any domain expert using natural-language app builders.
ArXiv paper experimentally localizing reliability properties in an agent system built around an append-only ledger adjudicator. Interventions on institutional epistemic mechanisms and on cognition (ablation, mid-task reset, frontier-LLM substitution, false testimony) left five core properties intact: singular accepted reality, typed refusals, durable duties, no double-acceptance, and no false completions across 2,581 substituted-panel claims.
Provides empirical evidence that reliability in agent systems can live in institutional machinery rather than in the model, a structural claim with direct design implications for agentic workflows.
Researchers formalize the 'epistemic Sybil problem' in multi-agent AI systems, showing that multiple agents sharing a common evidence root do not produce independent observations. Controlled experiments with over 20,000 LLM-agent calls demonstrate that naive aggregation collapses posterior coverage from 0.94 to 0.26 as report count rises from 1 to 32, while correlated extraction errors further degrade calibration.
Challenges the assumption that more agents equals more evidence, with empirical calibration data showing how multi-agent aggregation can mislead without tracking evidential ancestry.
The paper proposes control-data flow separation for multi-agent LLM systems: execution-critical protocols become typed, validated program objects while task content remains optimizable natural language, preventing prompt edits from corrupting routing or formatting logic. Tested on reasoning, review, and insurance rating workflows with 100% protocol validity.
Identifies a concrete failure mode in multi-agent prompt optimization and offers a typed separation pattern with empirical validation across three domains.
A three-week diary study with 8 blind screen-reader users evaluated OLLA, a computer-use agent prototype, across 1,258 commands in 12 desktop applications. GPT-5 achieved the highest success rate at 52.5%, with trace analysis identifying grounding, planning, constraint-tracking, and termination failures.
First diary study with blind users on real desktop workflows; names specific failure modes and benchmarks five models, useful for agent builders and accessibility practitioners.
Research paper presenting RecalibrateGPT, an interface system that addresses AI fatigue in LLM conversations through five cross-turn operators (Anchor, Replay, Delta, Scope, Steer) accessed via a single AssistiveButton. A study with 12 users identified four fatigue types and showed halved perceived cognitive workload (NASA-TLX 2.7) at high usability (SUS 86.5).
Frames AI fatigue as an interaction-flow cost rather than a model-quality problem, and offers a transferable operator taxonomy worth examining before building any LLM interface.
ErgoAssist is a head-worn ergonomic system that combines IMU-based posture tracking with consumer-grade EEG to estimate cognitive load. By detecting the user's mental state, it issues posture alerts only when the user is unlikely to be in deep focus. Lab results show 81% posture classification accuracy and 81% alert reduction alongside 38% better posture correction.
Couples posture detection with cognitive load to fix the core failure of ergonomic wearables: interrupting during focus. The 81% alert reduction with better outcomes reframes alert design as a context problem.
MemToC is a controlled benchmark for evaluating how LLM agents arbitrate between parametric memory and tool returns when the two conflict. Across five 7-9B open-weight models, instruction-tuned variants retain a verified-correct answer against an incorrect tool in only 6.5-17.1% of cases. SFT and DPO improve arbitration on some backbones but reduce abstention after tool errors.
Quantifies a specific failure mode in tool-using agents and offers a benchmark plus fine-tuning baseline for anyone designing agent arbitration policies.
Paper tests a zero-shot manager-worker multi-agent scaffold across nine LLMs on 100 hard LiveCodeBench problems without training. Gains are model-dependent: up to +42 points for some models, null or negative for others. The scaffold roughly triples token cost but is often cheaper per unit of accuracy than scaling to a larger model.
A controlled, per-model breakdown of when multi-agent scaffolding actually helps coding — directly useful for deciding whether to add orchestration to a coding workflow.
A scoping review published in the journal Ergonomics surveying emerging technologies and automation methods for musculoskeletal ergonomic assessments, synthesizing recent developments in the field.
Maps the current landscape of automated ergonomic assessment tools; useful for practitioners selecting methods and for researchers identifying gaps.
A peer-reviewed review paper examining single-human multiple-robot (SHMR) systems, analyzing their effects on occupational safety, worker health, and overall system performance. Published in Ergonomics, Volume 69, Issue 8, 2026.
Synthesizes existing research on one-operator-many-robot configurations, useful for designers and ergonomists planning human-robot collaborative workstations and safety protocols.
A within-subject study (n=24) examining six turn-level design frictions in AI chatbots across three mechanisms: eliciting user contribution, restricting content access, and reshaping output. All probes increased workload, task duration, and perceived ownership; effects on recall and recognition were selective; user adaptation varied by goal and workflow.
Empirical evidence on how intentional constraints in chatbot exchanges affect overreliance and ownership, with usable design patterns for AI-assisted writing tools.