The Trust Paradox in LLM-Based Multi-Agent Systems
When Collaboration Becomes a Security Vulnerability
Bibliographic Data
| ID | 22108148 |
|---|---|
| Authors | Zijie Xu (0009-0003-1670-8134, Minzu University of, Beijing, China), Minfeng Qi (0000-0003-0357-642X, City University of Macau), Shiqing Wu (0000-0001-6785-1203, City University of Macau), Lefeng Zhang (0000-0002-7608-7910, City University of Macau), Qiwen Wei (0009-0001-7798-0938, Minzu University of China), Han He (0000-0002-7093-7451, City University of Macau, Macau SAR, China), He Han (0000-0002-0048-811X, City University of Macau), Ningran Li (0009-0005-8621-3617, Monash University) |
| Year | 2026 |
| Pages | 1-12 |
| Publication date | 2026-01-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | IEEE Transactions on Computational Social Systems (JOURNAL) |
| Journal identifiers | ISSN: 2329-924X • E-ISSN: 2373-7476 |
| Publisher | Institute of Electrical and Electronics Engineers (IEEE) (PUBLISHER) |
| DOI | 10.1109/tcss.2026.3695070 |
| OpenAlex | W4416056210 |
| Language | EN |
Multi-agent systems powered by large language models (LLMs) are advancing rapidly, yet the security implications of trust-mediated collaboration remain insufficiently understood. We introduce and empirically validate thetrust–vulnerability paradox (TVP): increasing inter-agent trust to improve coordination can simultaneously amplify risks of over-exposure and authorization drift (AD). To study this phenomenon under controlled and reproducible conditions, we operationalize trust as a system-level control parameter governing authorization strictness and information disclosure, rather than as a cognitive or social construct. We construct a purpose-built scenario-game dataset spanning three macro-scenes and nineteen sub-scenes, and conduct extensive closed-loop agent-to-agent (A2A) interactions with explicit trust parameterization. Usingminimum necessary information (MNI)as the safety baseline, we propose two unified metrics:over-exposure rate (OER)to quantify boundary violations, andADto capture the sensitivity of disclosure behavior to trust variation. Experiments across multiple model backends and orchestration frameworks reveal consistent trends: higher trust improves task success but also increases over-exposure risk, with substantial heterogeneity in risk sensitivity to trust across systems. We further evaluate mitigation strategies, including Sensitive Information Repartitioning and guardian-agent (GA-Agent) enablement, which effectively reduce OER and attenuate AD under elevated trust. Overall, this work formalizes TVP as a systemic security property, establishes reproducible experimental baselines with unified metrics, and demonstrates that trust must be modelled, calibrated, and managed as a first-class security variable in the design of LLM-based multi-agent systems (LLM-MAS)
Authorization · Information security · Security policy · Access Control and Trust · Explainable Artificial Intelligence (XAI · Security and Verification in Computing
| Highly cited | No |
|---|