Organizations: Mathematics and Computer science, Université du Québec à Trois-Rivières, 3351 Boul. des Forges, Trois-Rivières, G8Z 4M3, Québec, Canada. · LSSI - Laboratory of Signal and System Integration, Electrical and Computer Engineering Department, Université du Québec à Trois-Rivières, 3351 Boul. des Forges, Trois-Rivières, G8Z 4M3, Québec, Canada. · Social Communication Department, Université du Québec à Trois-Rivières, 3351 Boul. des Forges, Trois-Rivières, G8Z 4M3, Québec, Canada. · Department of Political Science, McGill University, 845 rue Sherbrooke, Montréal, H3A 0G4, Québec, Canada.
The rapid proliferation of large language model (LLM)-based agentic systems raises critical concerns regarding digital sovereignty, environmental sustainability, regulatory compliance, and ethical alignment. Whilst existing frameworks address individual dimensions in isolation, no unified architecture systematically integrates these imperatives into the decision-making processes of autonomous agents. This paper introduces the COMPASS (Compliance and Orchestration for Multi-dimensional Principles in Autonomous Systems with Sovereignty) Framework, a novel multi-agent orchestration system designed to enforce value-aligned AI through modular, extensible governance mechanisms. The framework comprises an Orchestrator and four specialised sub-agents addressing sovereignty, carbon-aware computing, compliance, and ethics, each augmented with Retrieval-Augmented Generation (RAG) to ground evaluations in verified, context-specific documents. By employing an LLM-as-a-judge methodology, the system assigns quantitative scores and generates explainable justifications for each assessment dimension, enabling real-time arbitration of conflicting objectives. We validate the architecture through automated evaluation, demonstrating that RAG integration significantly enhances semantic coherence and mitigates the hallucination risks. Our results indicate that the framework's composition-based design facilitates seamless integration into diverse application domains whilst preserving interpretability and traceability.
Figures & tables
Framework
Real-time mediation
Multi-dim. evaluation
Dynamic grounding
Cultural adaptability
Modular architecture
Explainable decisions
Ethos Institute
∘
∙
∘
∘
∘
∙
IEEE 7000
∘
∙
∘
∘
∘
∙
ETHOS (Web3)
∘
∘
∘
∘
∙
∙
Ocean Protocol
∘
∘
∘
∘
∙
∘
Constitutional AI
∙
∘
∘
∘
∘
∘
Value-aligned
∘
∙
∘
∙
∘
∙
Table 1: Comparative analysis of AI governance frameworks
Figure 1: High-level architecture of the multi-agent framework showing the decision-making flow from user input to final optimized action.
Figure 2: Simplified UML Class Diagram illustrating the object-oriented architecture and extensibility of the Framework.
LLM parameters
values
LLM’s name
mistralaiMistral-7B-Instruct-v0.2
max_new_tokens
256
temperature
0.7
top_p
0.7
repetition_penalty
1.2
do_sample
True
Table 2: Instantiation of prompt keywords with concrete values for a specific query.
keywords
values
keyword0
”SOV-02”
keyword1
”Canada”
keyword2
”Google Gemini”
keyword3
”France”
keyword4
”Canada”
keyword5
”Building a cloud-based AI chatbot for customer support automation”
Table 3: Example instantiation of prompt keywords with concrete values for a specific query.
Subjects
Reference documents
Digital Soverignty
Digital Sovereignty: A Framework to improve
digital readiness of the Government of Canada,
Government of Canada Secretariat (2025)
Carbon-Aware Computing
From Prompts to Power: Measuring the Energy
Footprint of LLM Inference Caravaca et al. (2025)
AI Compliance
Artificial Intelligence Act, European Union. [ 27 ]
Table 4: Reference documents used for the tests. These may vary by country and users’ preferences.
Test id.
Score without RAG
Score with RAG
Δ Score
Similarity
SOV-01
0.25
0.50
+0.25
74.7%
SOV-02
0.25
0.25
+0.00
76.1%
SOV-03
0.25
0.25
+0.00
77.0%
SOV-04
0.25
0.25
+0.00
79.2%
SOV-05
0.50
0.50
+0.00
80.4%
SOV-06
0.25
0.50
+0.25
80.3%
Table 5: Results for the evaluation of the sovereignty aspect.
Test id.
Score without RAG
Score with RAG
Δ Score
Similarity
CAR-01
0.85
0.80
-0.05
75.8%
CAR-02
0.50
0.50
+0.00
81.4%
CAR-03
0.50
0.50
+0.00
85.3%
CAR-04
0.65
0.60
-0.05
79.6%
CAR-05
0.50
0.50
+0.00
74.3%
CAR-06
0.50
0.53
+0.03
82.7%
Table 6: Results for the evaluation of the carbon aspect.
Test id.
Score without RAG
Score with RAG
Δ Score
Similarity
COM-01
0.50
0.25
-0.25
76.4%
COM-02
0.50
0.25
-0.25
75.6%
COM-03
0.50
0.50
+0.00
75.5%
COM-04
0.50
0.50
+0.00
76.8%
COM-05
0.50
0.25
-0.25
77.4%
COM-06
N/A
0.50
N/A
67.9%
Table 7: Results for the evaluation of the compliance aspect.
Test id.
Score without RAG
Score with RAG
Δ Score
Similarity
ETH-01
0.75
0.75
+0.00
76.4%
ETH-02
1.00
0.95
-0.05
81.4%
ETH-03
0.50
0.25
-0.25
77.2%
ETH-04
0.50
0.50
+0.00
78.2%
ETH-05
0.50
0.50
+0.00
90.8%
ETH-06
0.50
0.50
+0.00
77.9%
Table 8: Results for the evaluation of the ethical aspect.
Figure 3: Explainability: Bar chart for use case (test.id): SOV-05, CAR-05, COM-05, ETH-05.
Figure 4: Explainability: radar graphic for use case (test.id): SOV-05, CAR-05, COM-05, ETH-05.
Feature
Vanilla LLM
Standard RAG
sLLM Agents
(Ours)
Reasoning
Black-box
Retrieval-based
Goal-oriented
Value-aligned
Adaptability
No
Yes
Partial
Yes
(e.g. to new laws)
Sovereignty
Low
Medium
Medium
High
(Local exec.)
Multi-dim. Check
No
No
No
Yes
Table 9: Qualitative comparison of the Framework against existing AI paradigms.
The field of Artificial Intelligence is undergoing a transition from Generative AI -- probabilistic generation of text and images -- to Agentic AI, in which autonomous systems execute actions within external environments on behalf of users. This transition exposes a fundamental architectural mismatch: Large Language Models (LLMs) produce stochastic, unstructured outputs, whereas the backend infrastructure they must control -- databases, APIs, cloud services -- requires deterministic, schema-conformant inputs. The present paper describes the Auton Agentic AI Framework, a principled architecture for standardizing the creation, execution, and governance of autonomous agent systems. The framework is organized around a strict separation between the Cognitive Blueprint, a declarative, language-agnostic specification of agent identity and capabilities, and the Runtime Engine, the platform-specific execution substrate that instantiates and runs the agent. This separation enables cross-language portability, formal auditability, and modular tool integration via the Model Context Protocol (MCP). The paper formalizes the agent execution model as an augmented Partially Observable Markov Decision Process (POMDP) with a latent reasoning space, introduces a hierarchical memory consolidation architecture inspired by biological episodic memory systems, defines a constraint manifold formalism for safety enforcement via policy projection rather than post-hoc filtering, presents a three-level self-evolution framework spanning in-context adaptation through reinforcement learning, and describes runtime optimizations -- including parallel graph execution, speculative inference, and dynamic context pruning -- that reduce end-to-end latency for multi-step agent workflows.
Autonomous agents powered by large language models introduce a class of execution-layer vulnerabilities -- prompt injection, retrieval poisoning, and uncontrolled tool invocation -- that existing guardrails fail to address systematically. In this work, we propose the Layered Governance Architecture (LGA), a four-layer framework comprising execution sandboxing (L1), intent verification (L2), zero-trust inter-agent authorization (L3), and immutable audit logging (L4). To evaluate LGA, we construct a bilingual benchmark (Chinese original, English via machine translation) of 1,081 tool-call samples -- covering prompt injection, RAG poisoning, and malicious skill plugins -- and apply it to OpenClaw, a representative open-source agent framework. Experimental results on Layer 2 intent verification with four local LLM judges (Qwen3.5-4B, Llama-3.1-8B, Qwen3.5-9B, Qwen2.5-14B) and one cloud judge (GPT-4o-mini) show that all five LLM judges intercept 93.0-98.5% of TC1/TC2 malicious tool calls, while lightweight NLI baselines remain below 10%. TC3 (malicious skill plugins) proves harder at 75-94% IR among judges with meaningful precision-recall balance, motivating complementary enforcement at Layers 1 and 3. Qwen2.5-14B achieves the best local balance (98% IR, approximately 10-20% FPR); a two-stage cascade (Qwen3.5-9B->GPT-4o-mini) achieves 91.9-92.6% IR with 1.9-6.7% FPR; a fully local cascade (Qwen3.5-9B->Qwen2.5-14B) achieves 94.7-95.6% IR with 6.0-9.7% FPR for data-sovereign deployments. An end-to-end pipeline evaluation (n=100) demonstrates that all four layers operate in concert with 96% IR and a total P50 latency of approximately 980 ms, of which the non-judge layers contribute only approximately 18 ms. Generalization to the external InjecAgent benchmark yields 99-100% interception, confirming robustness beyond our synthetic data.
Yuxu Ge
University of York, Department of Computer Science, York, United Kingdom
The rapid evolution of Large Language Models (LLMs) from passive assistants to autonomous, execution-capable agents has introduced critical operational risks. Most current evaluation frameworks neglect procedural compliance, leading to ''Machiavellian'' behaviors where agents strategically violate safety rules to maximize rewards - a direct manifestation of Goodhart's Law. To address this blind spot, we introduce MAC-Bench, a dynamic, adversarial benchmark designed to evaluate the procedural alignment of multi-agent systems under realistic pressure. We propose the SERV(Seed - Evolve - Refine - Verify) pipeline, an ``Agent-as-a-Benchmark'' paradigm that transforms unstructured legal texts into executable, contamination-free scenarios. By synthesizing holographic sandbox environments and injecting calibrated social-engineering pressure vectors, MAC-Bench forces agents into Pareto-optimal trade-offs between task success and regulatory adherence. We introduced novel metrics: the Compliance-Weighted Success Rate (CSR) and the Machiavellian Gap (MG), and conducted a comprehensive evaluation of state-of-the-art frontier models to reveal the pervasive trade-offs between success and compliance.
Yiyang Zhao, Zhuo Zhang, Qingxuan Le +2
Fudan University Shanghai, China · Shanghai Academy of AI for Science Shanghai, China · Shanghai Artificial Intelligence Laboratory Shanghai, China +1