Skip to main navigation Skip to search Skip to main content

Multi-AI Agent Oriented Privacy Policy Compliance Checking Based on Large Language Models in Mobile IoT Systems

  • Yangyan Zeng
  • , Wei Liu
  • , Anqi Wang
  • , Chunchao Zeng
  • , Yi Yang
  • , Wei Liang
  • , Xu Zhang
  • , M. Jamal Deen
  • , Xiaokang Zhou

Research output: Contribution to journal › Article › peer-review

5 Downloads (Pure)

Abstract

The proliferation of the Internet of Things (IoT) has exacerbated data privacy risks, necessitating rigorous compliance auditing of IoT companion application privacy policies. However, automated detection faces unique technical challenges, such as complex cross-paragraph dependencies and semantic conflicts between devices and applications. Traditional natural language processing (NLP) methods lack deep reasoning capabilities, while single large language models (LLMs) suffer from inherent reasoning biases and hallucination risks, failing to ensure strict legal traceability. To bridge this gap, we propose an evidence-traceable, mul tiagent collaborative compliance detection framework driven by heterogeneous LLMs. First, we construct a fine-grained evaluation paradigm based on the personal information protection law (PIPL) and employ an indicator-driven retrieval-augmented generation (RAG) mechanism to strictly anchor model reasoning to traceable policy fragments. Second, we design an evidence-quality-driven dynamic routing mechanism via a task complexity assessment model (TCAM), which adaptively dispatches multiple heterogeneous LLM agents based on quantitative difficulty and evidence scarcity, achieving an optimal balance between computational overhead and robustness. Furthermore, an iterative robust aggregation (IRA) and consistency-verification module is introduced to filter single-model biases and map identified risks to specific legal provisions. Extensive experiments demonstrate that the proposed framework achieves expert-level diagnostic precision with an average accuracy of 90.3%, a Macro-F1 of 89.3%, and a Cohen's Kappa of 0.85. Meanwhile, under the high-concurrence execution setting, the framework achieves approximately a 17-fold improvement in auditing efficiency compared with manual reviews, supporting high-throughput processing at 82 documents per hour. This end-to-end auditable system provides a highly scalable and interpretable regulatory technology solution for privacy governance in massive IoT ecosystems.

Original languageEnglish
Pages (from-to)41456-41502
Number of pages47
JournalIEEE Internet of Things Journal
Volume13
Issue number18
DOIs
Publication statusPublished - 15 Sept 2026

Keywords

  • Compliance detection
  • Internet of Things (IoT)
  • large language model (LLM)
  • multiagent system
  • personal information protection law (PIPL)
  • privacy policy
  • retrieval-augmented generation (RAG)

Cite this