Last updated:

AAISM preparation guide

AAISM oversight trap: a human in the loop is not oversight by itself

Direct answer

Adding a person to approve AI decisions sounds safe, which is why it is a trap. Oversight only works when reviewers have the information to judge, enough time or a sampling design that fits the risk, the authority to override, and the training to use them. The stronger answer checks those conditions, and measures whether people actually override, rather than counting the reviewer as the control.

ISACA's outline lists, as supporting task 20, risk-based human oversight of AI inputs and outputs, and covers trust and safety controls in 3D.

A reviewer who sees only a score and handles hundreds of cases a day is unlikely to be overseeing in any real sense.

Start AAISM baseline

Real oversight versus a signature

TrapWhy it feels rightWhat the stronger answer does
A reviewer approves every outputEvery decision has a humanGives reviewers the reasons and inputs behind each output
Oversight with no workload limitMore cases reviewed sounds betterSets a workload a person can actually review
Oversight with no measureThe process exists on paperTracks override rates and samples decisions to check them

Original teaching example

A lender's AI flags loan applications for decline, and a credit officer must approve each decline. The officer handles 400 flags a day and sees only the model's score.

Approval of every decline looks like oversight, but under these conditions it is unlikely to be effective. The stronger answer shows officers the reasons and key inputs behind each flag, sets a workload they can review, confirms their authority to override, and tracks override rates.

What oversight needs

Information, time or sampling that fits the risk, authority and training.

Without the reasons behind an output or the evidence of the case, a reviewer can't judge it well. Without time, or a sampling and escalation design that fits the risk, they can't review it. Without authority, they can't change it.

Measure whether people override

Override rates near zero, or rising fast, are both worth investigating.

A very low rate can mean the model is rarely wrong in the cases reviewed, or that reviewers have stopped checking. A rising rate can mean the model or its inputs have changed, or that reviewers' behaviour has. The stronger answer samples decisions to find out which.

When human review is the right answer

When the scenario lacks a human check that the decision's impact or the organization's obligations require.

Then adding review is the gap, but design it with these conditions, not as a signature.

Where this appears in the outline

3D, privacy, ethical, trust and safety controls.

Related outline areas are 1B (AI policy) and 2A (risk thresholds).

Sources and fact check

Source checked: 2026-10-12

  • Study methods and examples are independent CertArc teaching guidance. ISACA's pages are the authority for exam rules and fees, which can change.
  • Practice results do not convert to an official score or guarantee a pass. CertArc is not affiliated with or endorsed by ISACA.

Frequently asked questions

Is human-in-the-loop always required?

No. It depends on the impact of the decision and the organization's policy and obligations.

What is automation bias?

The tendency to accept an automated output without checking it, which is why oversight needs to be measured.

What should reviewers see?

The reasons and key inputs behind an output, not only its score.

Which domain does this trap belong to?

Mainly Domain 3, AI technologies and controls.

How do I spot it in a question?

Look for a reviewer who can't realistically judge, or a process with no measure of whether review changes anything.

CertArc — AAISM Exam Prep

Read the reasoning here. Practise it in CertArc.

Scenario-based AAISM practice on AI governance, AI risk and AI controls. Explanations show why the stronger AI security management answer wins, and three-domain evidence guides the next study step.

  • Coaching for the answer you picked
  • Every option compared, side by side
  • A study plan built from your results
Start AAISM baseline

21-day free access after onboarding. No credit card required.

AAISM review in CertArc: why the chosen answer felt right, why it is not the AAISM answer, and the rule to carry forward
An AAISM question in review · Example learner