TY - GEN
T1 - Empowering multimodal learning analytics using agentic AI: A comprehensive platform for simulation-based clinical training with Intelligent Assessment
AU - Nguyen, Duc Hai
AU - Salim, Kinza
AU - Power, David
AU - Connolly, Murray
AU - Hamdy, Ahmed
AU - Contreras, Maya
AU - Mai, Tai Tan
AU - Shorten, George
AU - O’Sullivan, Barry
AU - Nanjappan, Vijayakumar
AU - Nguyen, Hoang D.
N1 - © 2026, the owner/author(s).
PY - 2026/4/26
Y1 - 2026/4/26
N2 - Simulation-based clinical training generates rich multimodal data that remains underused due to fragmented modalities, annotation bottlenecks, weak provenance, and tools misaligned with educator workflows. We introduce ClinVision, an educator-in-the-loop platform that operationalizes end-to-end multimodal learning analytics: synchronized multi-camera review, ISBAR-aligned scoring (a validated clinical communication framework), and templated reports with jump-to-evidence provenance. Agentic AI - systems that act on behalf of users while preserving human authority - assists with phrasing under explicit control (accept/edit/reject) and visible provenance, supporting accountable use rather than prescriptive automation. An in-learning deployment with five educators revealed full ISBAR coverage and time-efficient workflows, though AI suggestions were used selectively. We surface three transferable design tensions (assistance vs. authority, structure vs. flexibility, evidence vs. overload) and demonstrate that workflow integration, temporal primitives, and background AI assistance may better support high-stakes assessment than analytics or automation alone.
AB - Simulation-based clinical training generates rich multimodal data that remains underused due to fragmented modalities, annotation bottlenecks, weak provenance, and tools misaligned with educator workflows. We introduce ClinVision, an educator-in-the-loop platform that operationalizes end-to-end multimodal learning analytics: synchronized multi-camera review, ISBAR-aligned scoring (a validated clinical communication framework), and templated reports with jump-to-evidence provenance. Agentic AI - systems that act on behalf of users while preserving human authority - assists with phrasing under explicit control (accept/edit/reject) and visible provenance, supporting accountable use rather than prescriptive automation. An in-learning deployment with five educators revealed full ISBAR coverage and time-efficient workflows, though AI suggestions were used selectively. We surface three transferable design tensions (assistance vs. authority, structure vs. flexibility, evidence vs. overload) and demonstrate that workflow integration, temporal primitives, and background AI assistance may better support high-stakes assessment than analytics or automation alone.
KW - Agentic AI
KW - Clinical education
KW - Human-AI collaboration
KW - Human-centered design
KW - ISBAR assessment
KW - Multimodal learning analytics
KW - Simulation-based training
KW - Trustworthy AI
KW - Video analytics
KW - [ComputerScience]
U2 - 10.1145/3785022.3785129
DO - 10.1145/3785022.3785129
M3 - Conference proceeding
AN - SCOPUS:105038650064
T3 - 16th International Learning Analytics and Knowledge Conference, LAK 2026
SP - 674
EP - 684
BT - 16th International Learning Analytics and Knowledge Conference, Bergen, Norway, 27 April - 1 May 2026
PB - Association for Computing Machinery, Inc
T2 - 16th International Conference on Learning Analytics and Knowledge, LAK 2026
Y2 - 27 April 2026 through 1 May 2026
ER -