Out-of-the-loop performance problem

The out-of-the-loop performance problem (OOL or OOTL^[1]) arises when an operator suffers from performance decrement as a consequence of automation.^[2]^[3] The potential loss of skills and of situation awareness caused by vigilance and complacency problems might make operators of automated systems unable to operate manually in case of system failure.^[4] Highly automated systems reduce the operator to monitoring role, which diminishes the chances for the operator to understand the system.^[5] It is related to mind wandering.^[5]

^ Merat, Natasha; Seppelt, Bobbie; Louw, Tyron; Engström, Johan; Lee, John D.; Johansson, Emma; Green, Charles A.; Katazaki, Satoshi; Monk, Chris; Itoh, Makoto; McGehee, Daniel; Sunda, Takashi; Unoura, Kiyozumi; Victor, Trent; Schieben, Anna; Keinath, Andreas (1 February 2019). "The "Out-of-the-Loop" concept in automated driving: proposed definition, measures and implications". Cognition, Technology & Work. 21 (1): 87–98. doi:10.1007/s10111-018-0525-8. hdl:10919/93316. ISSN 1435-5566. S2CID 52279007.
^ Endsley, Mica R.; Kiris, Esin O. (June 1995). "The Out-of-the-Loop Performance Problem and Level of Control in Automation". Human Factors: The Journal of the Human Factors and Ergonomics Society. 37 (2): 381–394. doi:10.1518/001872095779064555. ISSN 0018-7208. S2CID 2147200.
^ Kaber, David B.; Endsley, Mica R. (1997). "Out-of-the-loop performance problems and the use of intermediate levels of automation for improved control system functioning and safety". Process Safety Progress. 16 (3): 126–131. doi:10.1002/prs.680160304. ISSN 1066-8527. S2CID 14070085.
^ "DIN SPEC 91516:2025-07, Human performance regarding the dynamic driving task for the specification of AI in ATO" (in German). DIN Media GmbH. doi:10.31030/3625051. Retrieved 28 June 2025.
^ ^a ^b Gouraud, Jonas; Berberian, Bruno; Delorme, Arnaud (1 January 2018). "Chapter 54 - Link Between Out-of-the-Loop Performance Problem and Mind Wandering: How to Keep the Operator in the Loop". Neuroergonomics. Academic Press: 239. doi:10.1016/B978-0-12-811926-6.00054-3. ISBN 9780128119266.

[1] Merat, Natasha; Seppelt, Bobbie; Louw, Tyron; Engström, Johan; Lee, John D.; Johansson, Emma; Green, Charles A.; Katazaki, Satoshi; Monk, Chris; Itoh, Makoto; McGehee, Daniel; Sunda, Takashi; Unoura, Kiyozumi; Victor, Trent; Schieben, Anna; Keinath, Andreas (1 February 2019). "The "Out-of-the-Loop" concept in automated driving: proposed definition, measures and implications". Cognition, Technology & Work. 21 (1): 87–98. doi:10.1007/s10111-018-0525-8. hdl:10919/93316. ISSN 1435-5566. S2CID 52279007.

[2] Endsley, Mica R.; Kiris, Esin O. (June 1995). "The Out-of-the-Loop Performance Problem and Level of Control in Automation". Human Factors: The Journal of the Human Factors and Ergonomics Society. 37 (2): 381–394. doi:10.1518/001872095779064555. ISSN 0018-7208. S2CID 2147200.

[kaber-3] Kaber, David B.; Endsley, Mica R. (1997). "Out-of-the-loop performance problems and the use of intermediate levels of automation for improved control system functioning and safety". Process Safety Progress. 16 (3): 126–131. doi:10.1002/prs.680160304. ISSN 1066-8527. S2CID 14070085.

[4] "DIN SPEC 91516:2025-07, Human performance regarding the dynamic driving task for the specification of AI in ATO" (in German). DIN Media GmbH. doi:10.31030/3625051. Retrieved 28 June 2025.

[mwlink-5] Gouraud, Jonas; Berberian, Bruno; Delorme, Arnaud (1 January 2018). "Chapter 54 - Link Between Out-of-the-Loop Performance Problem and Mind Wandering: How to Keep the Operator in the Loop". Neuroergonomics. Academic Press: 239. doi:10.1016/B978-0-12-811926-6.00054-3. ISBN 9780128119266.

[1]

[2]

[3]

[4]

[5]