In situ simulation has been accepted as a valuable tool to identify latent hazards and practitioner knowledge gaps.  It is important to conduct scenarios in alignment with best practices to maximize outcomes and ensure participant engagement. Standardized approaches and protocols to conduct in situ simulation include pre-scenario planning, timing, setting, necessary personal, and criteria to cancel the simulation.[18][13][11][19] There can be some degree of variation in the development of in situ programs depending on the stated goals or the conditions challenged. However, the general considerations for executing an in situ simulation program should address patient safety, learner engagement, and record keeping.[13]  

Before beginning any in situ simulation, a supervisor or ward manager should be aware of the plan to ensure proper coverage of patient areas. Often "no-go" criteria are established to minimize risks to active or incoming patients to the unit. Patients and family members in the vicinity should be alerted to on-going training to ensure their psychological safety. Participants should have access to a safe training environment with an introduction to the ground rules of the simulation. Some in situ simulations are “unannounced,” in which case there should be some level of ongoing briefings to potential participants in the days or weeks before the initiation of a one time or longitudinal program. 

The final necessary component intrinsic to almost all medical simulation is a formalized debriefing. It can be a challenge to facilitate a debriefing among an interprofessional group of providers. It can be helpful to have an individual with formal debriefing experience be involved. Adequate time should be allotted to allow participants to identify LSTs and propose subsequent solutions. The seven most common descriptive categories of latent safety threats include staffing, medication, devices/equipment, knowledge-base, workspace/environment, protocols, and communication/teamwork.[6][11] Although these may be subdivided further, especially in regards to teamwork and communication, the broad categorization of potential safety threats allows systems to identify the most common vulnerabilities and direct resources accordingly. 

In collaboration with the clinical operations team, mechanisms should be in place in advance of performing in situ simulation to review and address revealed LSTs. One of the more comprehensive reviews on the role of in situ simulation in addressing latent safety threats advises a model for addressing issues using a Comprehensive Unit-based Safety Program.[1] These programs typically use a bi-directional approach between front line staff and administrative leaders who may have greater capability to address the needs identified during the simulations. These partnerships between staff and administrators help align routine processes with system-level structures. In 2010, the Society for Simulation in Healthcare (SSIH) established accreditation for simulation centers in System Integration for organizations committed to providing “a consistent, planned, collaborative, integrated and iterative application of simulation-based assessment and teaching activities with systems engineering and risk management principles to achieve excellent bedside clinical care, enhanced patient safety, and improved metrics across the healthcare system.” This concept is an important mechanism for providing sustainability and returns on investment for in situ simulation programs geared to exposing LSTs.  

At the time of this writing, a great deal of educational and investigative literature has been developed using in situ simulation for identifying latent safety threats. Some notable in situ simulation environments have included acute care settings, labor and delivery, pediatric care, and low-frequency high-risk scenarios.[19][20][21][22][23][24][25] Organizations with new facilities or new adaptations of their care setting have also used in situ simulation to assess the physical plant before opening their doors to patient care.[26][18] A review of this literature identifies qualitative measurements for the common categories that enumerate patient safety threats (e.g., medications, protocols, environment, staffing, and communication). Reported rates of the average LSTs identified per in situ simulation range from 1 to 7.[19][25] Evidence demonstrates that in situ simulation can be superior at identifying LSTs compared to standard institutional reporting systems.[23] Rosen’s systematic review concluded that effective in situ simulations "should include structured needs analysis and clearly defined assessment and feedback strategies to clarify learning objectives and support training transfer to daily practice."[1]  

To provide some concrete examples of simulation programs geared to exposing LSTs, the authors of this paper draw on individual experience conducting and gathering information from in situ simulations performed in a high volume urban emergency department. In the process of transitioning towards a formal Trauma designation, multiple in situ trauma simulations took place with interprofessional staff.  Simulations activated all levels of the system to mirror a real event (e.g., the use of the overhead hospital-wide paging system after a pre-hospital notification, formal patient registration into the electronic medical record, and involvement of ancillary services such as radiology to ensure our capacity to expedite diagnostic imaging). Debriefs revealed LSTs in various domains, including protocols, equipment, and organization of the clinical environment. The ultimate result was the implementation of multiple solutions. A few examples included codifying the massive transfusion protocol and adjusting the positioning of equipment within the room to make them more readily available for providers performing emergent resuscitative procedures. There was an enhancement of team dynamics by adding sticker role-identifiers for personal responding to the trauma notification, redesigning the trauma bay floor tiles to designate positions of resuscitation team members, and creating an illustration of team roles posted to the trauma bay wall. Regular inter-disciplinary team training exercises were developed to improve the ability of teams assembled on an ad hoc basis were prepared to perform highly reliable resuscitations. As the literature suggests, we found that frequent and goal-directed in situ simulations in coordination with operational, administrative committee meetings created an effective iterative process to diagnose and address LSTs.

Poor communication and teamwork inherently represent latent safety conditions. In situ simulation provides opportunities for the deliberate practice among teams and the opportunity for reflection on areas of improvement. Many validated scales are used to assess team performance for evaluation of in situ training.[27][28][26] Almost all the research evaluating in situ simulation report a positive impact on the non-technical skills of leadership, role clarity, decision-making, communication, and task management.[19][13][29][30] Studies also comment on the less tangible impacts of in situ simulation on organizations in the form of culture change. Frequent in situ simulation normalizes it as a training process and promote a culture of safety by engaging participants to identify LSTs as part of developmental team-based exercises.[18][19] The collaborative approach of in situ simulation can strengthen teamwork, and also empower healthcare providers to improve patient safety via a systems paradigm.