Development of a situation awareness measure to evaluate advanced alarm systems in nuclear power plant control rooms

The process controller is required to remain updated regarding developments in the dynamically changing process state, this being referred to as the maintenance of situation awareness. Alarm systems play an important role within this task, and therefore a measure of how effective the system is for enhancing the operator's situation awareness is desirable. One proposed measure is the Situation Awareness Control Room Inventory (SACRI). The methods and results of four simulator studies undertaken to develop and evaluate SACRI are outlined in this paper. It is concluded that SACRI is of use alongside measures such as detection time and diagnostic accuracy in simulator-based evaluations of alarm system design.     

Comparative study of three training methods for enhancing process control performance: Emphasis shift training,situation awareness training,and drill and practice

Three training methods to improve attention management skills in process control were compared. Forty students from technical disciplines participated in a five-hour module of emphasis shift training (EST), EST combined with situation awareness training (EST/SA), and drill and practice (D&P) on a simulated process control task. Participants were then tested three times for 45 min each (immediately after training, two weeks after training, and six weeks after training) for system control performance and diagnostic performance on familiar and nonfamiliar fault states. D&P led to superior diagnostic performance on familiar system faults. EST/SA training supported the diagnosis of novel system faults. EST was less effective than expected for system control performance. Implications for training design in process control are discussed.     

Human performance metrics for the nuclear domain: A tool for evaluating measures of workload,situation awareness and teamwork

The Nuclear Regulatory Commission (NRC) has developed a tool to support the understanding and evaluation of workload (WL), situation awareness (SA), and teamwork (TW) metrics used in human factors engineering (HFE) programs for commercial nuclear power plants (NPPs). This article summarizes the NRC report on the tool, and discusses its potential application to other industries. The operational relevance of WL, SA and TW to the NPP domain is reviewed, and challenges associated with the development of valid metrics for these constructs are identified. The Generic Metrics Catalog (GMC) is a database that compiles information about WL, SA, and TW metrics in a readily accessible and easy to use format. It provides information about the psychometric properties of a metric and the soundness of the methods used to investigate these properties. In the evaluation of a proposed HFE in an NPP license application, the Decision Making Wizard (DMW) uses reviewer input and information found in the GMC to identify areas of concern in applications. Tools of this kind may be especially valuable in other domains for managing challenges of novel technologies such as automation, human-robot teaming and augmented cognition.     

Improving situation awareness in crisis response teams: An experimental analysis of enriched information and centralized coordination

In responding to an emergency, the actions of emergency response teams critically depend upon the situation awareness the team members have acquired. Situation awareness, and the design of systems to support it, has been a focus in recent emergency management research. In this paper, we introduce two interventions to the core processes of information processing and information sharing in emergency response teams to analyze their effect on the teams’ situation awareness: (1) we enrich raw incoming information by adding a summary of the information received, and (2) we channel all incoming information to a central coordinator who then decides upon further distribution within the team. The effect of both interventions is investigated through a controlled experiment with experienced professional responders. Our results show distinctly different effects for information enrichment and centralization, both for the teams and for the coordinators within the team. While the interaction effects of both conditions cannot be discerned, it is apparent that processing non-enriched information and non-centralized information sharing leads to a worse overall team situation awareness. Our work suggests several implications for the design of emergency response management information systems.     

Who benefits from simulator training: Personality and heart rate variability in relation to situation awareness during navigation training

Objective

This study tested the relationship between individual differences and Situation Awareness (SA) during training in a navigation simulator.

Background

Simulators have become an important tool in the training and education of maritime personnel with a view to improving decisions and performance. There are a few, inconclusive empirical studies that have focused on mapping personality characteristics and their link to the ability to generate and maintain SA during simulator training.

Method

Thirty-six first-year students from the Royal Norwegian Navy Officer Candidate School participated in the study. SA was measured using both subjective and observer ratings.

Results

The results indicated that low scores on Neuroticism and high scores on Extraversion and Conscientiousness (resilient personality type) predicted both subjective and observer-rated SA. Furthermore, participants with high SA were able to modulate their Heart Rate Variability (HRV), with suppression of HRV during navigation training as well showing recovery of HRV.

Application

The potential applications of this research include the assessment of personality differences as a tool in selecting navigators, and the use of HRV as an objective index of adaptability to environmental demands.     

Exploring schema-driven differences in situation awareness between road users: an on-road study of driver,cyclist and motorcyclist situation awareness

Collisions between different road users make a substantial contribution to road trauma. Although evidence suggests that different road users interpret the same road situations differently, it is not clear how road users' situation awareness differs, nor is it clear which differences might lead to conflicts. This article presents the findings from an on-road study conducted to examine driver, motorcyclist and cyclist situation awareness in different road environments. The findings suggest that, in addition to minor differences in the structure of different road users' situation awareness (i.e. amount of information and how it is integrated), the actual content of situation awareness in terms of road user schemata, the resulting interaction with the world and the information underpinning situation awareness is markedly different. Further examination indicates that the differences are likely to be compatible along arterial roads, shopping strips and at roundabouts, but that they may create conflicts between different road users at intersections. Interventions designed to support compatible situation awareness and behaviour between different road users are discussed.     

Context enabled decision aids to support the situation awareness and performance of risk engineers carrying out loss prevention surveys

Routine inspection by insurance companies at their clients’ facility, also known as loss prevention survey, help identify the best strategies to minimize damages when there is a high-speed wind event. More specifically, wind vulnerabilities associated with a building are evaluated using a process known as windstorm risk inspection. This routine inspection helps clients reduce the extent of damages caused by high-speed wind events including hurricane and tornado. Risk engineers make use of their subjective and analytical deduction skills to successfully carry out the inspection tasks. In this research the researchers investigated the effect of context-based visualization strategies on situation awareness and their understanding of the situation. The study examined how different types of information contribute towards the three levels of situation awareness. Following a between-subjects study design, 65 participants completed the study. Each session lasted 90–120 min. A checklist based and predictive display-based decision aids were tested and found to be effective in supporting the situation awareness requirements as well as performance of risk engineers. However, the predictive display only helped with certain tasks such as understanding the interaction among different components on the rooftop. For remaining tasks such as perceiving obvious issues like membrane tear, clogged drains and vegetation growth, checklist alone was sufficient. This study helped the understanding of the advantages and disadvantages of the decision aids tested. More specifically, these decision aids can improve the mental model of novice risk engineers. Additionally, this study provided insights that could help design training materials for infrastructure inspectors.     

Use of Highways in the Sky and a virtual pad for landing Head Up Display symbology to enable improved helicopter pilots situation awareness and workload in degraded visual conditions

Abstract

Flight within degraded visual conditions is a great challenge to pilots of rotary-wing craft. Environmental cues typically used to guide interpretation of speed, location and approach can become obscured, forcing the pilots to rely on data available from in-cockpit instrumentation. To ease the task of flight during degraded visual conditions, pilots require easy access to flight critical information. The current study examined the effect of ‘Highways in the Sky’ symbology and a conformal virtual pad for landing presented using a Head Up Display (HUD) on pilots’ workload and situation awareness for both clear and degraded conditions across a series of simulated rotary-wing approach and landings. Results suggest that access to the HUD lead to significant improvements to pilots’ situation awareness, especially within degraded visual conditions. Importantly, access to the HUD facilitated pilot awareness in all conditions. Results are discussed in terms of future HUD development.

Practitioner Summary: This paper explores the use of a novel Heads Up Display, to facilitate rotary-wing pilots’ situation awareness and workload for simulated flights in both clear and degraded visual conditions. Results suggest that access to HUD facilitated pilots’ situation awareness, especially when flying in degraded conditions.