Human Approval Checkpoints for AI Agents in Regulated Finance
What FINRA, SR 11-7, the EU AI Act and GDPR actually say about human oversight, and how to turn it into engineering: risk-tiered checkpoints, reviewers who really review, and an evidence trail. Not legal advice.
By Naeem Akhtar · 13 min read
In short
- No single rule says 'every AI action needs a human'. Existing rules apply to AI, and they expect governance, oversight proportionate to risk, and evidence.
- Tier checkpoints by risk: money movement, customer-facing statements and decisions with significant effect deserve more than routine, reversible steps.
- A reviewer who approves everything is not oversight. Show evidence, track override rates and test reviewers with seeded errors.
- Log the request, versions, evidence, reviewer, decision and outcome. That record is what an examiner, auditor or customer complaint will ask for.
Read this first: engineering guidance, not legal advice
This article is written by an engineering team, not a law firm or a regulator. It explains what several public regulatory texts say about human oversight of AI, and then shows how a team might turn that into approval steps in an agent. It does not tell you what your firm is required to do. That depends on your jurisdiction, licence, products and the specific use case, and it should be decided with your compliance function and counsel.
We checked the sources named below on 10 November 2026. Regulation in this area is moving, including dates for the EU AI Act, so confirm the current position before relying on anything here. If you want the mechanics of pausing an agent first, read Pause an AI Agent for Human Approval with LangGraph interrupt() and Human-in-the-Loop AI Agent Frameworks Compared.
What the public texts say about human oversight
Four widely cited sources show the range. None of them is a complete answer on its own.
| Source | What it says that matters here | What it does not say |
|---|---|---|
| FINRA Regulatory Notice 24-09 (June 2024) | FINRA's rules are technology neutral and apply when firms use generative AI, including through third-party and embedded features. A firm needs a reasonably designed supervisory system under Rule 3110, and policies should address technology governance, including model risk management, data privacy and integrity, and reliability and accuracy. Content standards in Rule 2210 apply to communications whether a human or a tool produced them | It creates no new requirements, and it does not prescribe a human approval step for every AI action |
| SR 11-7, Guidance on Model Risk Management (Federal Reserve and OCC, 2011) | Model risk comes from errors and misuse. It emphasises effective challenge by objective, informed parties, validation with some independence from development and use, ongoing monitoring, outcomes analysis, governance, and an inventory of models. Rigour should scale with materiality | It was written for quantitative models. Whether and how it applies to an LLM agent is a judgement for the firm. It notes that approaches outside its definition should still have a rigorous control process |
| EU AI Act, Article 14 (human oversight) | For high-risk systems, oversight measures should be proportionate to risk, autonomy and context. People assigned to oversight should be able to understand the system's capacities and limits, stay aware of automation bias, interpret outputs, decide not to use or to override or reverse the output, and intervene or stop the system | It applies to systems classified as high-risk, and application dates have been subject to change. Whether your use case is high-risk needs checking against the Act's classification rules |
| GDPR, Article 22 | A person has the right not to be subject to a decision based solely on automated processing that has legal or similarly significant effects, with exceptions. Where exceptions for contract or explicit consent apply, safeguards include the right to obtain human intervention, to express a view and to contest the decision | The article text does not define how much human involvement removes a decision from 'solely automated'. Ask counsel how a light-touch approval would be viewed |
The pattern across them is consistent. Human oversight is expected to be proportionate to risk, effective rather than nominal, and evidenced. That is a design brief, and the rest of this article works from it.
Tier your checkpoints by risk, not by habit
A single approval step on everything creates queues and fatigue. No approval at all fails the first test above. The practical answer is tiers, decided with compliance and written down. The thresholds below are illustrations to start the conversation, not recommendations.
| Tier | Typical actions | Oversight pattern |
|---|---|---|
| 0: Read only | Summarising a document, drafting an internal note, retrieving a policy | No approval. Log and sample for quality |
| 1: Low impact, reversible | Updating a ticket, tagging a record, proposing a category | Act automatically, with random sampling reviewed after the fact |
| 2: Material | Customer-facing messages, changes to customer records, recommendations that inform a decision | Single reviewer approves before it takes effect |
| 3: High impact or hard to reverse | Moving money, releasing payments, closing or opening accounts, decisions with significant effect on a person | Two different people, or a designated authority, approve. Agent cannot proceed without both |
| 4: Human only | Actions the firm decides AI must never take on its own | The agent can prepare material but has no credentials to act |
Decide tier membership by three questions: how much could go wrong, how easily can it be undone, and does it affect a customer or a regulated outcome. Re-tier when the agent's abilities change, because adding a tool can quietly move an action up a tier.
Maker-checker for agents
Finance already has a control for this: the maker-checker, or four-eyes, principle, where the person or system that prepares an action is not the one who approves it. Applied to agents, the agent is the maker, and a person with the right authority is the checker. For tier 3 you may want two checkers.
Three rules make it real rather than ceremonial:
- Separation of duties: the approver must not be the requester of the underlying action, and approval rights should differ from build and deployment rights.
- Least privilege for the agent: the agent's credentials should allow it to propose, not to execute above its tier. Execution should happen in a step that only runs after an approval is recorded, with a different credential.
- Approval bound to the exact action: the person approves specific parameters, such as a payee and amount. If anything changes after approval, the approval is void and the request goes round again.
The mechanics for pausing, binding and resuming are covered in our LangGraph approval guide. The point here is the policy those mechanics enforce.
Oversight that is effective, not nominal
Article 14 of the EU AI Act explicitly names automation bias, the tendency to rely too much on a system's output. Every team that adds approval steps runs into it. A reviewer who sees a confident, well-written recommendation, forty times a day, will approve most of it. That satisfies the checkbox and fails the purpose.
| Weakness | What to do about it |
|---|---|
| Reviewer sees only the conclusion | Show the evidence the agent used and the specific parameters, with links to sources, so checking is quick |
| Approval takes two seconds on average | Track time to decision and flag reviewers or request types where it is implausibly short |
| Approval rate near 100 percent | That may be fine or may signal rubber-stamping. Investigate by sampling and by seeded tests |
| No consequence for a wrong approval | Record who approved and review errors found later. Treat it as a quality loop, not a blame exercise |
| Overloaded queues | Raise thresholds on low-risk items, add reviewers, or slow the agent. Do not let queue pressure silently turn into auto-approval |
| Same reviewers see same patterns | Rotate reviewers and vary request types so attention does not dull |
A useful test is to seed a small number of deliberately flawed requests into the queue, with the knowledge of compliance, and see how many are caught. If reviewers catch few, the process needs to change before it is relied on. Also make rejection cheap: a reviewer who has to write an essay to say no will say yes.
Customer communications and significant decisions
Two categories draw particular attention. For customer communications, FINRA notes that its content standards for communications with the public apply whether a human or a technology tool generated the message. Whether a firm pre-approves every AI-drafted message, samples them, or uses approved templates is a supervisory decision for the firm and its compliance function, not an engineering default.
For decisions with legal or similarly significant effects on a person, such as credit or account decisions in the EU, GDPR Article 22 is the starting question. The text gives people a right not to be subject to solely automated decisions in many cases, and, where permitted exceptions apply, requires safeguards including a route to human intervention and to contest the decision. A design that builds in a genuine human decision point and a way for the customer to ask for review gives you something to work with. Whether a particular approval step is sufficient is a legal question.
The evidence record: what to keep for each request
When an examiner, an auditor or a customer asks 'why did this happen', the answer is a record. Design it before you build the agent, because it is hard to reconstruct later. This list is our suggestion, to be shaped by your retention and recordkeeping obligations.
| Field | Why it matters |
|---|---|
| Request ID and timestamp | Unique identity for the event |
| Agent, prompt, tool and model versions | Shows exactly what produced the proposal, which matters when behaviour changes over time |
| Inputs and retrieved sources | What the agent saw when it decided |
| Proposed action and parameters | The exact thing the reviewer was asked to approve |
| Reviewer identity and role | Who is accountable, and whether they had authority |
| Decision, edits and stated reason | Approve, reject or change, and why |
| Time the request was shown and decided | Evidence of real review and of response times |
| Outcome and idempotency key | What happened afterwards, and proof it happened once |
| Customer-facing text actually sent | The final wording, not only the draft |
Store this in an append-only system you control, separate from the agent's own state, with access limited and retention set by policy. Paused-run state and checkpoints are useful for resuming work but are not a substitute for an audit record.
Monitoring after launch
SR 11-7 stresses ongoing monitoring and outcomes analysis, not just validation before launch. The same attitude suits agents, whose behaviour changes with model updates, prompt edits and new tools.
- Track rejection and edit rates by action type. A sudden change is a signal.
- Sample approved actions after the fact and check them against the system of record.
- Measure time to decision, queue length and expired requests.
- Record every change to prompts, tools and models, and re-run your evaluation set before release. Our guide to evaluating AI agents in production covers how.
- Keep an inventory of agents, their tools, their tiers and their owners, as SR 11-7 recommends for models.
- Review the tiering itself on a schedule, because the agent's reach will grow.
Questions to take to your compliance team
- Which rules and guidance apply to this use case in each jurisdiction we serve?
- Does this agent count as a model under our model risk policy, and who validates it?
- Which actions fall into each tier, and who signs off the tiering?
- Where are pre-approval, sampling and templates acceptable for customer communications?
- Could any decision here be 'solely automated' with significant effect on a person, and what route to human review do we offer?
- What do we have to retain, for how long, and in what form?
- How do we treat vendor and embedded AI features we did not build?
- What would we show a regulator tomorrow if they asked how this works?
Bring working drafts of the tier table and the evidence record. Compliance teams respond better to a concrete proposal than to an open question. For help designing and building approval steps into an agent for a regulated workflow, see our agentic workflow orchestration service.
Frequently asked questions
Is a human in the loop legally required for AI agents in finance?
There is no single rule that requires a human approval for every AI action. Existing rules, such as FINRA's supervision rules, apply to AI use, and specific regimes such as the EU AI Act and GDPR Article 22 have oversight and human intervention provisions in defined cases. What applies to you depends on your jurisdiction and use case, so confirm with your compliance team and counsel.
What is the maker-checker principle for AI agents?
It is the finance control where the party that prepares an action is not the one that approves it. For an agent, the agent proposes and a person with the right authority approves, with higher-risk actions needing two approvers. Approval is bound to the exact parameters, and the approver should not be the requester.
Does a human approval step satisfy GDPR Article 22?
Not automatically. Article 22 concerns decisions based solely on automated processing with legal or similarly significant effects, and the text does not define how much human involvement is enough. A review that is a formality may not change the position. Ask your data protection officer or counsel how your specific design would be assessed.
Does SR 11-7 apply to LLM-based agents?
SR 11-7 defines models as quantitative methods that process input data into quantitative estimates, and it was written in 2011. Whether an LLM agent falls within a firm's model definition is a judgement for the firm and its supervisors. Many firms apply the guidance's ideas, such as effective challenge, independent validation, ongoing monitoring and an inventory, to AI systems regardless.
How do I stop reviewers just clicking approve?
Show the evidence and exact parameters, track time to decision and approval rates, rotate reviewers, keep queues manageable and test with deliberately flawed requests seeded with compliance's knowledge. EU AI Act Article 14 names automation bias as something oversight must account for, so treat rubber-stamping as a design risk, not a people problem.
What should an AI agent audit trail contain?
At least the request ID, versions of the agent, prompt, tools and model, the inputs and sources, the proposed action and parameters, the reviewer's identity and role, the decision with any edits and reason, timestamps, the outcome and an idempotency key. Keep it in an append-only store separate from the agent's working state, with retention set by your recordkeeping obligations.
Need help with Agentic AI Development? Talk to the engineers.
Tell us what you want to build. You'll get a straight answer on scope, approach and cost from the people who do the work.
Keep reading
Related guides
Agentic AI
Pause an AI Agent for Human Approval with LangGraph interrupt()
How to stop an agent before a risky action, wait as long as a person needs, and resume exactly where it left off. Covers interrupt(), checkpointers, the rules that cause duplicate actions, and approval design.
13 min read
Agentic AI
Human-in-the-Loop AI Agent Frameworks Compared: LangGraph, CrewAI, OpenAI and More
Every serious agent framework can pause for a human decision, but they do it differently. This guide compares how six of them pause, store state, resume and handle risk, and what each leaves for you to build.
14 min read
Agentic AI
AI Agent Checkpointing Explained: Durable State, Replay and Recovery
How checkpointing lets an agent survive crashes, wait for people and be replayed for debugging, using LangGraph as the worked example. Covers durability modes, resuming, replay traps, storage, encryption and retention.
13 min read