INTERVIEW | 4 min read

The Real Blocker in AI Governance Isn't the Model — It's the Architecture

Last edited: Oct 29, 2026
Listen
--:--
The Real Blocker in AI Governance Isn't the Model — It's the Architecture hero image

The gap between policy and code

When a team asks whether their AI tool is ready for a governance review, the answer rarely hinges on the model itself. According to Jonathan, Founder & Principal Systems Architect at Soluxaudit, the obstacle surfaces once you actually inspect the codebase.

He said "the biggest friction is almost always the gap between policy intent and actual code-level execution." Teams often assume that having "guardrail prompts" or high-level policy documents means they are governance-ready. In practice, that assumption tends to collapse under inspection.

What shows up instead, he explained, is "fuzzy logic where hard boundaries should exist—unmonitored sub-agent calls, unisolated runtime memory, or zero deterministic logging." These are not abstract concerns. They are concrete architectural conditions that determine whether a system can be audited at all.

His framing is direct: "Real governance isn't what you tell an LLM to do in a system prompt; it's what your software architecture physically permits or prevents at execution time." That distinction matters because it shifts the review from intent to enforcement. A policy document can describe what should happen. Only the architecture can guarantee what does happen.

What general guidance misses

Most online material on AI governance, Jonathan noted, treats the subject as a static compliance checklist. It lists EU AI Act bullet points or generic ethical principles. What it leaves out is the operational layer.

He pointed to three specific omissions: "runtime state isolation, deterministic fail-safe protocols (Fail-Closed behaviors when an agent hits an unknown or prohibited state), and cryptographic proof of evidence."

Each of these addresses a different failure mode. Runtime state isolation limits how far one process can reach into another. Fail-closed behavior ensures that when an agent encounters an unknown or prohibited state, it stops rather than improvises. Cryptographic proof of evidence produces a verifiable record of what occurred.

That last point is where checklists fall short. As Jonathan put it, "A checklist tells you what you should comply with, but it won't give an auditor a signed execution trace proving how your system handled a specific request under real conditions." The difference is between asserting compliance and demonstrating it. For teams preparing for external review, that gap is often the difference between a smooth assessment and a stalled one.

The order teams get wrong

When teams decide how to test an AI tool before release, Jonathan sees a consistent pattern: they prioritize output evaluations — accuracy, tone, hallucination benchmarks — before establishing architectural governance.

He described it plainly: "They test what the model says before securing what the system can actually do."

His recommended order is the reverse. First define hard boundaries: isolation, permission layers, fail-closed mechanics. Only then move to fine-tuning outputs. The reasoning is structural. When governance is treated as a wrapper applied at the end rather than built into the core design, "any slight update to the model or prompt breaks your entire safety posture."

That fragility is the practical cost of sequencing governance last. A prompt change or model swap can invalidate assumptions that were never enforced in code to begin with. Teams that build boundaries first tend to absorb those changes without losing their safety guarantees.

Practical takeaways

For teams preparing an AI tool for governance review, the interview points to a few concrete steps:

  • Inspect the codebase, not just the policy. Guardrail prompts and policy documents are not evidence of enforcement. Look for unmonitored sub-agent calls, unisolated runtime memory, and missing deterministic logging.
  • Treat fail-closed behavior as a design requirement. Define what happens when an agent hits an unknown or prohibited state, and make that behavior deterministic rather than improvised.
  • Plan for verifiable evidence. A signed execution trace is what allows an auditor to confirm how a system handled a specific request under real conditions.
  • Sequence governance before output tuning. Isolation, permission layers, and fail-closed mechanics should be in place before accuracy and tone benchmarks.

The broader point is that AI governance is an architectural discipline, not a documentation exercise. As Jonathan's answers suggest, the teams that fare best in review are the ones that treat boundaries as part of the core design — not as a wrapper added at the end.

For more on how Soluxaudit approaches AI tool and agent assessment, see the original listing in Peekwire's roundup of AI governance assessment services.