The Controllability Trap: A Governance Framework for Military AI Agents

Agentic AI systems - capable of goal interpretation, world modeling, planning, tool use, long-horizon operation, and autonomous coordination - introduce distinct control failures not addressed by existing safety frameworks. We identify six agentic governance failures tied to these capabilities and show how they erode meaningful human control in military settings. We propose the Agentic Military AI Governance Framework (AMAGF), a measurable architecture structured around three pillars: Preventive Governance (reducing failure likelihood), Detective Governance (real-time detection of control degradation), and Corrective Governance (restoring or safely degrading operations). Its core mechanism, the Control Quality Score (CQS), is a composite real-time metric quantifying human control and enabling graduated responses as control weakens. For each failure type, we define concrete mechanisms, assign responsibilities across five institutional actors, and formalize evaluation metrics. A worked operational scenario illustrates implementation, and we situate the framework within established agent safety literature. We argue that governance must move from a binary conception of control to a continuous model in which control quality is actively measured and managed throughout the operational lifecycle.

More from arXiv.org

Architectural Requirements for Agentic AI Containment

arXiv.org·3

Does Point Cloud Boost Spatial Reasoning of Large Language Models?

arXiv.org·3

HeLa-Mem: Hebbian Learning and Associative Memory for LLM Agents

arXiv.org·12

LLMs Corrupt Your Documents When You Delegate

arXiv.org·5

AI prefers resumes written by itself: Self-preferencing in Algorithmic Hiring

arXiv.org·5

Mitigating Belief Inertia via Active Intervention in Embodied Agents

arXiv.org·2