Using Twitter Data to Monitor Natural Disaster Social Dynamics: A Recurrent Neural Network Approach with Word Embeddings and Kernel Density Estimation



Downloads per month over past year

Hernández-Suárez, Aldo and Sánchez-Pérez, Gabriel and Toscano-Medina, Karina and Pérez-Meana, Hector and Portillo-Portillo, Jose and Sánchez, Victor and García Villalba, Luis Javier (2019) Using Twitter Data to Monitor Natural Disaster Social Dynamics: A Recurrent Neural Network Approach with Word Embeddings and Kernel Density Estimation. Sensors, 19 (7). p. 1746. ISSN 1424-8220

[thumbnail of Using_Twitter_Data_to_Monitor_Natural_Disaster_Soc.pdf]
Creative Commons Attribution.


Official URL:


In recent years, Online Social Networks (OSNs) have received a great deal of attention for their potential use in the spatial and temporal modeling of events owing to the information that can be extracted from these platforms. Within this context, one of the most latent applications is the monitoring of natural disasters. Vital information posted by OSN users can contribute to relief efforts during and after a catastrophe. Although it is possible to retrieve data from OSNs using embedded geographic information provided by GPS systems, this feature is disabled by default in most cases. An alternative solution is to geoparse specific locations using language models based on Named Entity Recognition (NER) techniques. In this work, a sensor that uses Twitter is proposed to monitor natural disasters. The approach is intended to sense data by detecting toponyms (named places written within the text) in tweets with event-related information, e.g., a collapsed building on a specific avenue or the location at which a person was last seen. The proposed approach is carried out by transforming tokenized tweets into word embeddings: a rich linguistic and contextual vector representation of textual corpora. Pre-labeled word embeddings are employed to train a Recurrent Neural Network variant, known as a Bidirectional Long Short-Term Memory (biLSTM) network, that is capable of dealing with sequential data by analyzing information in both directions of a word (past and future entries). Moreover, a Conditional Random Field (CRF) output layer, which aims to maximize the transition from one NER tag to another, is used to increase the classification accuracy. The resulting labeled words are joined to coherently form a toponym, which is geocoded and scored by a Kernel Density Estimation function. At the end of the process, the scored data are presented graphically to depict areas in which the majority of tweets reporting topics related to a natural disaster are concentrated. A case study on Mexico’s 2017 Earthquake is presented, and the data extracted during and after the event are reported.

Item Type:Article
Uncontrolled Keywords:twitter; data mining; word2vec; CRF; LSTM; geocoding; geoparsing
Subjects:Sciences > Computer science > Internet
Sciences > Computer science > Computer networks
ID Code:67660
Deposited On:06 Sep 2021 15:05
Last Modified:06 Sep 2021 15:11

Origin of downloads

Repository Staff Only: item control page