Artificial intelligence · Technical definition
Human-in-the-loop.
Also known as HITL · Human in the loop · Human oversight
Definition
A design in which a person intervenes within an AI system's decision flow. Oversight is effective when there is real authority to act, sufficient information and traceability of the intervention.
Nature
Operational definition
Further detail
The presence of a signature or an approval screen does not demonstrate oversight. It is necessary to examine whether the person can stop or modify the outcome, which cases they review, with what information and what record they leave. The suitability of the control depends on the risk and the use.
Applied example
In a credit assessment system, human review is nominal if no one can modify the outcome or if the sample lacks a selection criterion. It is effective when the role, the ability to intervene and the record can be demonstrated.
Related authored pieces