Coordination of European Research on Industrial Safety towards Smart and Sustainable Growth
MASTER
A multimethod system for the assessment and training of teamwork in simulated scenarios
Work in electricity distribution is characterized by high levels of risk, uncertainty, and dynamic coordination demands. While technical procedures are well formalized, non-technical and situated professional skills (SPS)—such as situation awareness, teamwork, communication, decision making, and stress management—are harder to observe, assess, and train in a structured way. Existing training approaches often lack valid tools to evaluate these skills and rarely integrate objective behavioral and physiological indicators. As a result, safety training struggles to fully address human and team factors that critically influence safe performance in complex socio-technical systems
The project addressed the following main research questions:
How can Situated Professional Skills (SPS) of electricity distribution workers be operationally defined and observed during realistic work activities?
Can high-fidelity simulation be used as an effective method to train and assess SPS in the electricity domain?
Is it possible to integrate behavioral observation, self-report measures, expert assessment, and non-verbal cues (NVC) into a unified assessment framework?
Do physiological indicators (e.g., heart rate, breathing rate, heart rate variability) show systematic patterns associated with compliant, partially compliant, and non-compliant behaviors?
How can these data support reflective learning and debriefing focused on safety and teamwork ?
The project was designed to produce:
A conceptual and operational model of Situated Professional Skills (SPS) for electricity distribution operators
A validated SPS Simulation Checklist for peer and expert observation during simulated scenarios
An SPS self-report questionnaire to assess medium- and long-term behavioral transfer
A set of high-fidelity simulation scenarios targeting critical SPS
A sensor-based system for capturing non-verbal and physiological cues during work activities
Empirical evidence on the relationship between behavioral compliance and physiological patterns
A replicable methodology for simulation-based safety training applicable to other high-risk domains
The project followed a structured, multi-phase workplan:
Literature review and conceptual framework
Analysis of non-technical skills, simulation-based training, and resilience engineering
Definition of SPS as an integration of technical, cognitive, and social skills
Development of assessment tools
Design and refinement of the SPS Simulation Checklist
Development and pilot validation of the SPS Questionnaire
Scenario design
Backward design of five high-fidelity simulation scenarios
Identification of SPS targets, behavioral markers, and standardized client roles
Implementation of the NVC tracking system
Setup of wearable sensors, multi-angle video, and audio recording
Integration of data streams in real-time and post-hoc analysis
Data collection and analysis
Training efficacy evaluation (Kirkpatrick Level 1)
Expert video-based performance assessment
Statistical analysis of physiological data (correlations and GLMMs)
Carlo Chiorri
Disfor - Department of Education Sciences, University of Genoa
Italy
Donald Glowinski
Neuroscience of Emotion and Affective Dynamics Lab (NEAD), affiliated to the Swiss Center for Affective Sciences (SCAS), University of Geneva
Switzerland
Didier Grandjean
Neuroscience of Emotion and Affective Dynamics Lab (NEAD), affiliated to the Swiss Center for Affective Sciences (SCAS), University of Geneva
Switzerland
Tommaso Piccinno
Disfor - Department of Education Sciences, University of Genoa
Italy
Michele Masini
Disfor - Department of Education Sciences, University of Genoa
Italy
Simon Schaerlaken
Neuroscience of Emotion and Affective Dynamics Lab (NEAD), affiliated to the Swiss Center for Affective Sciences (SCAS), University of Geneva
Switzerland
Fabrizio Bracco
University of Genova
Italy