Humanitarian Data Collection Methods and Tools

Rapid information collection and dissemination are crucial in emergency responses, as responders often operate under immense time pressures and without a comprehensive understanding of the situation (Van de Walle & Comes, 2014). However, the desire for comprehensive data can result in collection practices that may overlook issues of informed consent or the potential risks associated with aggregating and collecting personally identifying information (Crawford & Finn, 2014).
Data availability is a critical issue in humanitarian response, as the lack of appropriate and timely data can significantly impede coordination and, ultimately, the success of humanitarian operations (Lund, 2011). The response to Typhoon Haiyan demonstrated a direct correlation between the efficacy of coordination and the robustness of data infrastructure, highlighting the importance of data quality and accessibility in assessing needs and capacities (Chan & Comes, 2014; Madianou, 2015; van den Homberg et al., 2014).
Another of the primary challenges in humanitarian data collection is the lack of standardization. Data is often collected in different formats, leading to significant data-wrangling efforts. This lack of standards can impede the interoperability of data systems and complicate more comprehensive data analysis and sharing (Qadir et al., 2016). A good example is the collection of demographic data, which frequently presents its own challenges. Age categorization, for example, can be complex and context-specific. Benelli et al. (2012, p. 221) note that “disaggregating data by age requires the creation of categories for analytical purposes. Such categories are in part context-specific, and it is advisable to determine them in consultation with the local populations”. The Sphere Project handbook provides widely accepted age disaggregation standards for humanitarian settings, suggesting groupings such as children (0-5, 6-12, 13-17) and adults in ten-year age brackets (Sphere Association, 2018). The launch of the HDX, the formation of the Humanitarian Exchange Language (HXL), and the work of the Information Management Working Group (IMWG) led by UN OCHA has in recent years, helped tackle many of these issues around data standardization (Telford, 2020).
Joint rapid assessments have become crucial tools in humanitarian response. The Kenya Inter-Agency Rapid Assessment (KIRA) Mechanism was one of the first rapid assessment mechanisms to demonstrate the potential for collaborative tools to support efficient humanitarian action and strategic decision-making. These joint needs assessments provided quick yet comprehensive overviews of emergencies in Kenya, enabling faster and more informed responses (Limbu et al., 2015).
The adoption of mobile data collection technologies in humanitarian response led to a significant shift from the traditional pen-and-paper data collection methods (Lajoie, 2013). Summerville (2014) highlights how mobile applications have streamlined field data collection, analysis, and dissemination, drastically reducing response time and improving operational effectiveness. Chan (2012) further emphasizes the operational efficacy of smartphones and apps, noting that the immediacy of data transfer has significantly improved the coordination of relief efforts. Guha-Sapir and Checchi (2018) highlight how, in Myanmar, mobile data collection tools have streamlined considerably the assessment process, reducing the time required for data analysis and reporting.
Anderson (2015) outlines various tools currently used for mobile data collection in humanitarian settings, ranging from custom-designed applications to off-the-shelf solutions adaptable to multiple scenarios, and how these tools have enabled organizations to gather and analyze data more systematically in real-time, leading to more agile and informed responses. However, this digital shift in data collection efforts raises crucial discussions around data protection and privacy concerns. Kuner et al. (2017) delve into the complexities of safeguarding personal information within international data protection laws. This concern has grown with the rise of mobile data collection. It underscores the imperative for humanitarian agencies to adhere to robust data protection standards to avoid breaches that could jeopardize the safety and privacy of vulnerable populations. Over the past few years, humanitarian organizations have done significant work training humanitarians on data protection, responsible data, and more. This effort has been led by UN OCHA and IFRC, which have partnered on this effort since 2018, and their work has been codified into the Data Playbook Toolkit (IFRC, 2022).
One salient point in the literature is the phenomenon of data abundance resulting from mobile data collection. The ability to capture extensive data often leads to collecting more information than necessary (Morrow et al., 2016). While having a wealth of data can be advantageous, it can pose challenges in data storage and management and the potential for information overload, which can hamper rather than help decision-making processes.
Mobile data collection has changed how data is collected and where it is analyzed. The ability to transmit data instantaneously to headquarters or regional offices means that analysis is no longer confined to the field. Remote analysis allows for a broader range of expertise to be applied to the data, potentially leading to better outcomes (Morrow et al., 2016). However, this remoteness can sometimes detach the analysis from the on-the-ground reality, a challenge that organizations must navigate to ensure that the data is interpreted in the context of where it was collected.
In conclusion, while data collection in humanitarian response has significantly evolved by adopting new technologies, it presents opportunities and challenges. The sector must navigate standardization, privacy, and data management issues while leveraging the benefits of rapid, mobile-enabled data collection to enhance the effectiveness and efficiency of humanitarian operations.
Bibliography:
Anderson, S. R. (2015). Mobile technology in complex emergencies: A study of digital data collection in the Norwegian relief sector University of Stavanger, Norway].
Benelli, P., Mazurana, D., & Walker, P. (2012). Using sex and age disaggregated data to improve humanitarian response in emergencies. Gender & Development, 20(2), 219-232. https://www.tandfonline.com/doi/pdf/10.1080/13552074.2012.687219
Chan, J. C. (2012). The Role of Social Media in Crisis Preparedness, Response and Recovery. OECD. https://www.oecd.org/governance/risk/The%20role%20of%20Social%20media%20in%20crisis%20preparedness,%20response%20and%20recovery.pdf
Chan, J. L., & Comes, T. (2014). Innovative Research Design – A Journey into the Information Typhoon. Procedia Engineering, 78, 52-58. https://www.sciencedirect.com/science/article/pii/S187770581401025X
Crawford, K., & Finn, M. (2014). The limits of crisis data: analytical and ethical challenges of using social and mobile data to understand disasters. GeoJournal, 80(4), 491-502. https://doi.org/10.1007/s10708-014-9597-z
Guha-Sapir, D., & Checchi, F. (2018). Science and politics of disaster death tolls. BMJ, 362, k4005. https://doi.org/10.1136/bmj.k4005
IFRC. (2022). Data Playbook (1 ed.). Solferino Academy.
Kuner, C., Svantesson, D. J. B., Cate, F. H., Lynskey, O., & Millard, C. (2017). Data protection and humanitarian emergencies. International Data Privacy Law, 7(3), 147-148. https://www.repository.law.indiana.edu/cgi/viewcontent.cgi?article=3644&context=facpub
Lajoie, E. (2013). Going Mobile: Information Sharing and the Changing Face of Digital Data Collection. Journal of Conventional Weapons Destruction, 17(2), 14.
Limbu, M., Wanyagi, L., Ondiek, B., Munsch, B., & Kiilu, K. (2015). Kenya Inter-agency Rapid Assessment Mechanism (KIRA): A Bottom-up Humanitarian Innovation from Africa. Procedia Engineering, 107, 59-72. https://doi.org/10.1016/j.proeng.2015.06.059
Lund, J. (2011). Humanitarian Coordination in Multi-Organizational Emergency Response Operations [Master, University of Copenhagen & University of Lund]. Copenhagen.
Madianou, M. (2015). Digital inequality and second-order disasters: Social media in the Typhoon Haiyan recovery. Social Media + Society, 1(2). https://journals.sagepub.com/doi/full/10.1177/2056305115603386
Morrow, N., Mock, N., Bauer, J.-M., & Browning, J. (2016). Knowing Just in Time: Use Cases for Mobile Surveys in the Humanitarian World. Procedia Engineering, 159, 210-216. https://doi.org/10.1016/j.proeng.2016.08.163
Qadir, J., Ali, A., ur Rasool, R., Zwitter, A., Sathiaseelan, A., & Crowcroft, J. (2016). Crisis analytics: big data-driven crisis response. Journal of International Humanitarian Action, 1(1), 12. https://doi.org/10.1186/s41018-016-0013-9
Sphere Association. (2018). Sphere handbook: humanitarian charter and minimum standards in humanitarian response. Sphere Assocation. https://www.spherestandards.org/handbook/
Summerville, C. B. (2014). Operationalizing mobile applications for humanitarian assistance/disaster relief missions [Master, Naval Post Graduate School]. Monterey, CA, USA. https://apps.dtic.mil/sti/citations/ADA607901
Telford, S. (2020). The Humanitarian Data Exchange: Critical Decisions, Key Results and The Road Ahead.
Van de Walle, B., & Comes, T. (2014). Risk accelerators in disasters: insights from the Typhoon Haiyan response on humanitarian information management and decision support CAiSE, Thessaloniki, Greece.
van den Homberg, M., Meesters, K., & Van de Walle, B. (2014). Coordination and information management in the Haiyan response: Observations from the field. Procedia Engineering, 78, 49-51.
First published in the Humanitarian Technology newsletter on LinkedIn.