Collaboration Technologies for Wilderness Search and Rescue
In collaboration with Anthony Tang, Carman Neustaedter, Alissa N. Antle, and Elgin-Skye McLaren
When a hiker gets lost in the woods or a skier does not return home from the mountain, a search crew needs to be called to find the missing person and bring them out of the wilderness safely. Wilderness search and rescue (wilderness SAR, or WSAR) involves the search for and extraction of one or more lost people from a wilderness area. WSAR is a carefully planned and organized team operation, requiring collaboration and information sharing between many workers who are spread out across various locations in the outdoors. Workers play a variety of roles, both on the ground and at the command post, and they need information and awareness specific to those roles. WSAR is time critical, in that personnel need to work together to find the missing person as quickly as possible.
For my PhD dissertation work, I focused on advancing understanding of how to design and build technologies to better support distributed collaboration between responders in high-stakes emergency situations such as WSAR in which responders travel large distances over long periods of time over vast geographic areas, where understanding and awareness of conditions 'on the ground' are crucial, and in which realtime communication and awareness are not always possible. WSAR was the main focus of my dissertation, though the findings from my work could also be possibly applied to other emergency domains such as disaster response.
As a first step, I ran an investigative study to understand the work processes of WSAR workers, the procedures they follow, the ways they communicate, the tools they use, and the factors that lead to success or failure in WSAR missions. In this study, I interviewed WSAR workers, including managers, field team leaders, and field team members, and I observed a simulated mock-search activity involving more than 100 WSAR volunteers in Western Canada.
The findings from this study demonstrate that while maintaining the shared mental model of the responding agency as a whole is important for a response, there are many challenges unique to WSAR that make this challenging. Some of these are due to technological factors (i.e., communicating over the radio), others relate to environmental factors, and some relate to current communication and work protocols. Overall, the study findings lead to the following design opportunities:
- Technology can be designed to support a shared mental model among WSAR workers responding to an incident.
- Gaps in radio and cellular reception bring about unique challenges in maintaining shared mental models across scattered locations, and so there is a necessity to support building and maintaining a shared mental model in network-sparse situations.
- There could be benefit to introducing increased awareness between field teams and Command.
In addition, the study also revealed the following design recommendations:
- While shared mental models are important, new technologies should not burden workers with too much irrelevant information and should filter information and messages depending on one’s duties, role, location, time, and cruciality of the information.
- Before introducing more communication channels and information streams (such as videos, pictures, and text), designers should first focus on aggregating the existing channels together and presenting the information in a simplified way to the necessary people.
- Given the mental and physical demands that workers face, WSAR communications should be as simple, minimal, quick, and distraction-free as possible.
I began exploring ideas for design solutions for WSAR personnel working in the command post (i.e., managers, planners, etc.). The first design idea was a tangible tabletop user interface for the command post. Called the WSAR Terrain Table, this interface brings together information from multiple sources and presents them in a single location, and thus is an early attempt at aggregating multiple information streams. The base of this tool is a physical terrain model of the search area. Placed over the terrain are physical props indicating information that remains constant or changes infrequently (e.g., the locations of the command posts). Projected over the terrain are digital representations of information that changes frequently, such as weather information (e.g., wind direction and speed, cloud cover), the makeup of the terrain (e.g., which parts are covered by snow, which parts are water and which are ground), the current locations of the field teams, the paths the teams have taken, and the locations of clues. This tabletop interface is intended to be placed in a convenient, accessible, and easy to see location in the command post. It is meant to support workers at Command in their management and planning duties by allowing them to inspect the statuses of the search environment, the field teams, and the progress of the search through visual observations from multiple viewpoints as well as via inspections through touch and physically handling objects on the terrain.
The second design idea is an improved iteration of the Terrain Table, but instead runs on a desktop computer or a large touch-screen display located in the command post. This system is called RescueCASTR, or Search and Rescue Contextual Awareness Streaming Platform. This interface explores the idea of sending teams out to the field with at least one of their members wearing a wearable camera (e.g., a small camera attached to the member’s helmet, jacket, or backpack strap) that streams live video or sequential photos periodically (e.g., once every five seconds) to Command, allowing them to see the footage live and explore past footage. This is assuming that, even though reception may be spotty, when teams do have a connection with Command, this connection contains at least enough bandwidth to send one low-resolution photo every few seconds. The purpose of this camera footage is to provide Command with extra contextual information of teams’ activities, in addition to their GPS locations and radio/text messages, with the intention of reducing the need for explicit communication requests (e.g., requesting the field teams to respond on the radio, or to a text message), and boosting Command’s awareness and teams’ statuses and the progress of the operation.
Lastly, although not the main focus of my PhD dissertation, drones can also be used to enable video-based remote collaboration between a remote user indoors (e.g., a manager at the command post) and a co-located user in the field (e.g., a ground search team). Drones could provide a unique overhead perspective, which could be useful for both field workers and Command, allowing them to inspect the space from angles that would otherwise be unachievable. This perspective could be especially beneficial for WSAR, as it allows workers to see things they would otherwise not be able to see from the ground; potentially even spotting the lost subject. The use of drones for remote collaboration between a co-located outdoor worker and a remote indoor helper was the topic of my Master's thesis project.
Publications
- Jones, B., Tang, A., and Neustaedter, C. RescueCASTR: Exploring Photos and Live Streaming to Support Contextual Awareness in the Wilderness Search and Rescue Command Post. In Proceedings of the ACM on Human-Computer Interaction, 6 (CSCW1), ACM.
Download PDF | Watch Video | Watch Presentation | Accompanying Source Code | Publication Link - Jones, B., Tang, A., and Neustaedter, C. Remote Communication in Wilderness Search and Rescue: Implications for the Design of Emergency Distributed-Collaboration Tools for Network-Sparse Environments. In Proceedings of the ACM on Human-Computer Interaction, 4 (GROUP), ACM.
Download PDF | Publication Link - Jones, B., Tang, A., Neustaedter, C., Antle, A.N., and McLaren, E.S. Designing a Tangible Interface for Manager Awareness in Wilderness Search and Rescue. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2018), ACM.
Download PDF | Download Poster | Publication Link - Jones, B., Tang, A., Neustaedter, C., Antle, A.N., and McLaren, E.S. Designing Technology for Shared Communication and Awareness in Wilderness Search and Rescue. In HCI Outdoors: Theory, Design, Methods and Applications, Springer.
Publication Link - Jones, B. Designing for Distributed Collaboration in Wilderness Search and Rescue. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2018; Doctoral Colloquium), ACM.
Download PDF | Download Poster | Publication Link - Jones, B., Tang, A., and Neustaedter, C. Drones for Remote Collaboration in Wilderness Search and Rescue. In iHDI: International workshop on Human-Drone Interaction (CHI 2019 Workshop).
Download PDF | Download Poster | Publication Link - Jones, B., Tang, A., and Neustaedter, C. Designing Outdoor Remote-Communication Tools for Serious Collaborative Activities. In HCI Outdoors: A CHI 2018 Workshop on Understanding Human-Computer Interaction in the Outdoors.
Download PDF | Publication Link - Jones, B., Dillman, K., Tang, R., Tang, A., Sharlin, E., Oehlberg, L., Neustaedter, C., and Bateman, S. Elevating Communication, Collaboration, and Shared Experiences in Mobile Video through Drones. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS 2016), ACM.
Download PDF | Watch Video | Accompanying Source Code | Publication Link - Jones, B. Designing Remote Collaboration Technologies for Wilderness Search and Rescue. PhD Dissertation, University of Calgary.
Download PDF | Watch Video | Accompanying Source Code | Publication Link