IAPSAM Logo

Welcome to the PSAM 18 Abstract Status page.

Abstract YO126Full Paper + Presentation

A Usability Evaluation of the EMBRACE Support Software Using AI-Driven Analysis and Expert Review

Authors

PrimaryYochan Kim— Korea Atomic Energy Research Institute · yochankim@kaeri.re.kr
Co-authordudtj0512@fnctech.com— dudtj0512@fnctech.com Edit Profile
Co-authorjhkim4@kaeri.re.kr— jhkim4@kaeri.re.kr Edit Profile
Co-authorDr. Jinkyun Park— Korea Atomic Energy Research Institute · kshpjk@kaeri.re.kr
Co-authorBuse Tezçi— buse.tezci@re-lab.it
Co-authormarialaura.delvecchio@re-lab.it— marialaura.delvecchio@re-lab.it Edit Profile
Co-authorfrancesco.tesauri@re-lab.it— francesco.tesauri@re-lab.it Edit Profile
The EMBRACE (Empirical data-Based crew Reliability Assessment and Cognitive Error analysis) method was developed to capture potential cognitive errors in procedure-following activities and failure possibilities due to time constraints. Grounded in an empirical foundation derived from full-scope simulator observations, this method aims to provide highly realistic human reliability assessment (HRA) results. However, the inherent complexity of HRA workflows, which require decomposing procedures into primitive tasks, often poses usability challenges that may induce human errors during the analysis process itself. To address this issue, the EMBRACE Support Software (ESS) was developed to assist analysts by automating the linkage between procedure sentences and primitive tasks and by visualizing the timeline and procedural flows of given human failure events (HFEs). This study presents a usability evaluation of the ESS, employing a hybrid approach that integrates AI-driven analysis via an AI-powered design intelligence platform with manual expert evaluations, specifically heuristic evaluation and cognitive walkthrough. By leveraging specialized AI agents for initial screening and human experts for contextual cognitive analysis, we identified critical UI/UX bottlenecks and potential error-forcing contexts within the software. The results demonstrate how a synergistic evaluation between AI and human expertise can enhance the robustness of safety-related software, ensuring that HRA practitioners can perform reliable risk assessments with minimized interface-induced biases.
Status: The abstract has been accepted!
📄Paper Status: Paper has been uploaded and is under review — View submitted paper
← Check another abstract