Dengue is a common and growing problem worldwide, with an estimated 70–140 million cases per year. Traditional, healthcare-based, government-implemented dengue surveillance is resource intensive and slow. As global Internet use has increased, novel, Internet-based disease monitoring tools have emerged. Google Dengue Trends (GDT) uses near real-time search query data to create an index of dengue incidence that is a linear proxy for traditional surveillance. Studies have shown that GDT correlates highly with dengue incidence in multiple countries on a large spatial scale. This study addresses the heterogeneity of GDT at smaller spatial scales, assessing its accuracy at the state-level in Mexico and identifying factors that are associated with its accuracy. We used Pearson correlation to estimate the association between GDT and traditional dengue surveillance data for Mexico at the national level and for 17 Mexican states. Nationally, GDT captured approximately 83% of the variability in reported cases over the 9 study years. The correlation between GDT and reported cases varied from state to state, capturing anywhere from 1% of the variability in Baja California to 88% in Chiapas, with higher accuracy in states with higher dengue average annual incidence. A model including annual average maximum temperature, precipitation, and their interaction accounted for 81% of the variability in GDT accuracy between states. This climate model was the best indicator of GDT accuracy, suggesting that GDT works best in areas with intense transmission, particularly where local climate is well suited for transmission. Internet accessibility (average ~36%) did not appear to affect GDT accuracy. While GDT seems to be a less robust indicator of local transmission in areas of low incidence and unfavorable climate, it may indicate cases among travelers in those areas. Identifying the strengths and limitations of novel surveillance is critical for these types of data to be used to make public health decisions and forecasting models.
Dengue is a common and growing problem worldwide. Delays in traditional surveillance systems limit the ability of public health agencies to identify and respond to dengue outbreaks efficiently. Internet search queries provide near real-time indicators of infectious disease activity and have proven effective for monitoring disease activity in some countries, but have not been assessed on smaller geographic areas. We compared Google Dengue Trends data for 17 states in Mexico to traditional surveillance data from those states. We found that the utility of Google Dengue Trends at the state-level is highly variable and depends on climatic conditions supporting dengue virus transmission. Novel surveillance tools like Google Dengue Trends can provide timely information to public health agencies, but to be useful on a local scale, they must be considered within the local context of dengue transmissibility.
Citation: Gluskin RT, Johansson MA, Santillana M, Brownstein JS (2014) Evaluation of Internet-Based Dengue Query Data: Google Dengue Trends. PLoS Negl Trop Dis 8(2): e2713. doi:10.1371/journal.pntd.0002713
Editor: Justin V. Remais, Emory University, United States of America
Received: August 9, 2013; Accepted: January 8, 2014; Published: February 27, 2014
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: This research was fully supported by the following grant: NIH- A Platform for Modeling the Global Impact of Climate Change on Infectious Disease 5R01LM010812-02. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The global incidence of dengue has increased 30-fold between 1960 and 2010 , with a recent study estimating that there are now 70–140 million cases per year . Dengue is caused by infection with any of the four dengue virus (DENV) serotypes; the symptoms often include high fever, intense joint and muscle pain, headaches, and skin rash. Some infections result in more serious illness including hemorrhagic symptoms and death . Endemic in many Asian and Latin American countries, dengue has become a leading cause of hospitalization and death among children in these regions  and contributes to substantial economic loss for governments and households . Despite the health and economic impacts of dengue, population-level control methods are limited, resource intensive, and largely ineffective to date. Real-time dengue surveillance, therefore, is critical for identifying areas where transmission is ongoing or likely to occur so that interventions can be optimized.
Traditional, healthcare-based, government-implemented dengue surveillance has several shortcomings. Often, it takes weeks to aggregate surveillance data and publish related reports. This lag in part reflects the time needed to collect and aggregate data at different scales, from practitioners up to the Ministry of Health level, but it can also be delayed or interrupted due to lack of resources and bureaucratic or political changes , . Meanwhile, as global Internet use has increased, novel disease monitoring tools based on health-related search queries have emerged. Google Dengue Trends (GDT) was developed by aggregating historical logs of anonymous online Google search queries associated with dengue using the methods developed for Google Flu Trends, a tool created to estimate influenza rates . Google queries have shown to be a close proxy for national-level dengue surveillance in multiple countries , . And because data are collected and processed in near real-time, these tools produce surveillance data much faster than traditional systems , , . While GDT has this significant advantage and well-demonstrated large-scale accuracy, it remains unclear how well it works at smaller scales where dengue transmission may be more heterogeneous.
Dengue transmission dynamics are sensitive to the environmental factors that affect the vector mosquitoes . Temperature increases can decrease the length of the gonotrophic cycle , increase the feeding frequency , increase the rate of mosquito development, and reduce the length of the DENV incubation period within the mosquito , . Mosquito survival also increases with temperature, but at a certain point, high temperatures can also lead to high mosquito mortality , , . Precipitation is also important to the spatial and temporal spread of the mosquito vector –. Lastly, human behavior and habitat modification can contribute to DENV transmission dynamics: the use of screens or air conditioning can reduce human-vector contact ; water storage and trash disposal practices are important determinants of larval habitat availability ; and a high human population density provides more transmission opportunities . Therefore, information about relevant environmental conditions can contribute to identifying the dengue risk.
Mexico provides a unique setting to assess the value of GDT data; the climate varies widely across the country, dengue is endemic in many areas yet largely absent in others, and approximately 36% of the population has Internet access . Here, we explore the relationship between GDT data and traditional surveillance data for 17 states in Mexico and use climate and socio-demographic data to investigate geographic variation in GDT accuracy.
The GDT index was developed as a linear model to predict reported dengue incidence from dengue-related Internet search patterns . Specifically, it incorporates weekly query volume for key terms (normalized to overall search volume) and uses the historical relationship between those terms and reported cases to linearly predict (nowcast) dengue activity. We downloaded weekly GDT data for 2003–2011 for Mexico as a country and for the available years in that time range (2–8 years) for the 17 individual states with available data: Baja California, Chiapas, Colima, Distrito Federal, Estado de Mexico, Jalisco, Morelos, Nayarit, Nuevo LeÓn, Oaxaca, Quintana Roo, Sinaloa, Sonora, Tabasco, Tamaulipas, Veracruz and Yucatan  . To create a monthly GDT variable, we averaged GDT across all weeks beginning in each month.
Traditional monthly dengue surveillance data for the same time period - 2003–2011 - were obtained from the Mexican Secretariat of Health (http://www.epidemiologia.salud.gob.mx/anuario/html/anuarios.html) , Long-term (1941–2005) mean annual precipitation (millimeters per year) and mean, minimum, and maximum temperature (°C) data were obtained for each state from the Mexican Secretariat of the Environment and Natural Resources (SEMARNAT) (smn.conagua.gob.mx). State-level socio-demographic data were obtained from the Mexican National Institute of Statistics and Geography (INEGI) (www.inegi.org.mx/). The socio-demographic data included the most recent data available for the following variables: the population size and density per kilometer (2010), the percentage of the population under the age of 15 (2010), the number of doctors per 100,000 residents (2008), the percentage of the population with access to drinking water (2006), the percentage of the population with municipal sewage (2008), the percentage of the population with Internet access (2008), and the average household income in pesos (2010). The data for precipitation, population size, population density, and average yearly dengue cases were log transformed to reduce skewing.
To quantify the accuracy of GDT relative to reported dengue cases, we used Pearson correlation to assess linear correlation because GDT was designed as a linear predictor of dengue incidence. We estimated the association between GDT and the traditional surveillance data at the national level and for each state, and calculated coefficients of determination (R2) to assess the proportion of dengue incidence variance captured by the GDT data. We then logit-transformed R2 and used Gaussian regression to assess the association between each climate and socio-demographic variable and the variability in state-level correlations between GDT and traditional surveillance data. The Akaike's Information Criterion (AIC) was applied to compare the fit for each of the different models. All calculations were performed in R version 2.14 (http://www.r-project.org/).
A total of 352,093 dengue cases were reported in all of Mexico from 2003–2011. Figure 1 shows the national-level monthly GDT index compared to the monthly reported cases. These data show a pattern of seasonal outbreaks, generally peaking between August and November, and substantial variation in incidence between seasons. The Pearson's correlation coefficient between GDT and reported dengue cases was 0.91 over the 9 years, indicating that GDT captured approximately 83% of the variability in the national surveillance data.
Figure 1. Time Series of monthly reported cases and Google Dengue Trends, Mexico.
2003–2011. The number of cases reported by the Secretariat of Health is shown on the left axis (black) and the GDT index on the right (blue). The correlation coefficient between reported dengue cases and GDT was 0.91 over the 9 years, indicating that GDT captured approximately 83% of the variability in the national surveillance data.doi:10.1371/journal.pntd.0002713.g001
Correlation between monthly GDT and traditional surveillance data, however, varied between states. The coefficient of determination, R2, varied from 0.01 in Baja California to 0.88 in Chiapas. Despite the presence of GDT data for the Distrito Federal, the biggest metropolitan area of the country, R2 could not be calculated because there were no reported cases during the study period. Figure 2A shows the coefficients of determination for this relationship in each state. In general, there was a stronger correlation in the southern and western coastal states, with the exception of Baja California.
Figure 2. Observed and model-estimated R2 for GDT and reported dengue cases.
Darker shading indicates a higher coefficient of determination between GDT and traditional surveillance data from observed data (A) and for predictions from the model using maximum temperature, precipitation and the interaction of those two variables (B).doi:10.1371/journal.pntd.0002713.g002
State-level correlation between GDT and case data was strongest in the states with high annual dengue incidence (Table 1, Figure 3A). States with higher average mean temperature, maximum temperature, and precipitation had significantly higher correlation between GDT and dengue case numbers (Figure 3B–D, Table 1). States with lower average household income, a greater proportion of youths in the population, and less internet access tended to have higher correlations, but these associations were not statistically significant (Table 1). We investigated models incorporating combinations of these variables. A model incorporating maximum temperature, logged precipitation, and the interaction of those two variables described 81% of the variance compared to 67% for the model with only dengue incidence and reduced the AIC from 43 to 39 (Table 1, Table 2). Adding socio-demographic factors to this model did not improve the fit.
Figure 3. Geographic variation of state-level covariates.
The covariates most highly associated with GDT accuracy (Table 1) were average annual dengue cases (A), average annual precipitation (B), mean temperature (C) and maximum temperature (D).doi:10.1371/journal.pntd.0002713.g003
Table 1. Determinants of logit-transformed R2 between Google Dengue Trends and government reported dengue cases: single covariate models.doi:10.1371/journal.pntd.0002713.t001
Table 2. Determinants of logit-transformed R2 between GDT and reported dengue cases: Multiple covariate model.doi:10.1371/journal.pntd.0002713.t002
Next, we used this climate-based model to predict the correlation between GDT and case data for all the states, including those where GDT data are not available (Figure 2B). There was general agreement between observed (Figure 2A) and estimated correlation (Figure 2B). Furthermore, the model predicts that for states with higher incidence such as Guerrero, where GDT is not available, GDT may in fact be a good indicator of dengue. However, in states with lower dengue incidence and cooler temperatures, like Chihuahua, GDT may not be an accurate indicator of dengue incidence. Overall, the results show that GDT is a better indicator of real-time incidence in states with high incidence and climate conditions that favor transmission.
At the national level, we found that the official case reports correlated well with GDT. Yet, the correlation between GDT and reported cases varied substantially from state to state, with stronger correlation in states with higher dengue incidence. Climate plays a key role in determining the geographic range and activity of the mosquitoes that transmit DENV. We found that in states with warmer temperatures and greater precipitation, such as Chiapas and Jalisco, GDT was strongly correlated with reported dengue incidence.
The role of climate in DENV transmission, however, is complicated by other biological and socio-demographic factors . Here, however, we did not find that socio-economic factors had a strong influence on the accuracy of GDT. This is particularly important because GDT relies on internet searches, and internet access can vary widely in different settings. We found that Internet access from home was not associated with GDT accuracy, suggesting that even with Internet access in the 30% range, search query data may be robust enough to capture population-level disease dynamics. Internet access will likely only increase in the future, leading to the possibility that greater data flow will improve the accuracy of measures such as GDT. While it is possible that income or internet access do affect GDT accuracy in Mexico, their importance may be overshadowed and confounded by climate, the strongest determinant in our analysis. Our intention was to identify relatively static characteristics that relate to the potential utility of tools like GDT. As such, we used covariate data from the single, most recent year or long-term averages. Future work will build on these findings to determine how temporal variation in relevant covariates may be combined with GDT to improve dengue prediction.
Using the climate-based model, we predicted the utility of GDT for the states where the GDT data are not available. For example, in Guerrero, where GDT is currently not available, our model suggests that it would provide a robust estimate of dengue incidence. Yet, for states where dengue cases are rarer, such as in Chihuahua, the predicted utility of GDT is low. In these areas, where GDT appears to be a poor indicator of local transmission levels, it may nonetheless be a good indicator of some level of health-related activity such as travelers becoming sick in endemic areas, returning home, and searching for dengue information on the Internet. This information would be useful for those interested in estimating local disease burden if not local transmission intensity. Thus, GDT may provide different value in distinct climatic or socio-economic contexts.
Dengue transmission patterns are highly variable and difficult to predict; timely dengue surveillance methods like GDT are needed to keep pace with the spread of the disease. We found that GDT is accurate in areas of high incidence and favorable vector climate conditions. While it appears to be a less robust gauge of local transmission in areas of low incidence and unfavorable climate, it may indicate infections among travelers. As the burden of dengue increases and traditional surveillance efforts struggle to keep pace, novel surveillance tools like GDT can provide timely information to public health officials and contribute to real-time predictive models.
Conceived and designed the experiments: JSB MS MAJ RTG. Performed the experiments: RTG MAJ. Analyzed the data: JSB MAJ MS RTG. Contributed reagents/materials/analysis tools: JSB MAJ MS RTG. Wrote the paper: JSB MAJ MS RTG.
- 1. WHO (2010) Dengue and severe dengue. World Health Organization.
- 2. Bhatt S, Gething PW, Brady OJ, Messina JP, Farlow AW, et al. (2013) The global distribution and burden of dengue. Nature 496: 504–507. doi: 10.1038/nature12060
- 3. Prevention CfDCa (2012) Dengue. In: CDC, editor.
- 4. WHO (2009) Dengue: Guidelines for Diagnosis, Treatment, Prevention and Control World Health Organization and Research on Disease of Poverty.
- 5. Beatty ME, Beutels P, Meltzer MI, Shepard DS, Hombach J, et al. (2011) Health economics of dengue: a systematic literature review and expert panel's assessment. Am J Trop Med Hyg 84: 473–488. doi: 10.4269/ajtmh.2011.10-0521
- 6. Runge-Ranzinger S, Horstick O, Marx M, Kroeger A (2008) What does dengue disease surveillance contribute to predicting and detecting outbreaks and describing trends? Trop Med Int Health 13: 1022–1041. doi: 10.1111/j.1365-3156.2008.02112.x
- 7. Madoff LC, Fisman DN, Kass-Hout T (2011) A new approach to monitoring dengue activity. PLoS Negl Trop Dis 5: e1215. doi: 10.1371/journal.pntd.0001215
- 8. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, et al. (2009) Detecting influenza epidemics using search engine query data. Nature 457: 1012–1014. doi: 10.1038/nature07634
- 9. Chan EH, Sahai V, Conrad C, Brownstein JS (2011) Using web search query data to monitor dengue epidemics: a new model for neglected tropical disease surveillance. PLoS Negl Trop Dis 5: e1206. doi: 10.1371/journal.pntd.0001206
- 10. Althouse BM, Ng YY, Cummings DA (2011) Prediction of dengue incidence using search query surveillance. PLoS Negl Trop Dis 5: e1258. doi: 10.1371/journal.pntd.0001258
- 11. Chunara R, Andrews JR, Brownstein JS (2012) Social and news media enable estimation of epidemiological patterns early in the 2010 Haitian cholera outbreak. Am J Trop Med Hyg 86: 39–45. doi: 10.4269/ajtmh.2012.11-0597
- 12. Chan EH, Brewer TF, Madoff LC, Pollack MP, Sonricker AL, et al. (2010) Global capacity for emerging infectious disease detection. Proc Natl Acad Sci U S A 107: 21701–21706. doi: 10.1073/pnas.1006219107
- 13. Reiter P (2001) Climate change and mosquito-borne disease. Environ Health Perspect 109 Suppl 1: 141–161. doi: 10.1289/ehp.01109s1141
- 14. Yang HM, Macoris ML, Galvani KC, Andrighetti MT, Wanderley DM (2009) Assessing the effects of temperature on the population of Aedes aegypti, the vector of dengue. Epidemiol Infect 137: 1188–1202. doi: 10.1017/s0950268809002040
- 15. Halstead SB (2008) Dengue virus-mosquito interactions. Annu Rev Entomol 53: 273–291. doi: 10.1146/annurev.ento.53.103106.093326
- 16. Chan M, Johansson M (2012) The Incubation Periods of Dengue Viruses. PLoS One 7: e50972. doi: 10.1371/journal.pone.0050972
- 17. Watts DM, Burke DS, Harrison BA, Whitmire RE, Nisalak A (1987) Effect of temperature on the vector efficiency of Aedes aegypti for dengue 2 virus. Am J Trop Med Hyg 36: 143–152.
- 18. Tun-Lin W, Burkot TR, Kay BH (2000) Effects of temperature and larval diet on development rates and survival of the dengue vector Aedes aegypti in north Queensland, Australia. Med Vet Entomol 14: 31–37. doi: 10.1046/j.1365-2915.2000.00207.x
- 19. Focks DA (1993) Dynamic Life Table Model for Aedes aegypti (Diptera: Culicidae): Analysis of the Literature and Model Development. Jl of Med Entomology 30: 1003–1017(1015).
- 20. Thai KT, Anders KL (2011) The role of climate variability and change in the transmission dynamics and geographic distribution of dengue. Exp Biol Med (Maywood) 236: 944–954. doi: 10.1258/ebm.2011.010402
- 21. Gubler DJ, Reiter P, Ebi KL, Yap W, Nasci R, et al. (2001) Climate variability and change in the United States: potential impacts on vector- and rodent-borne diseases. Environ Health Perspect 109 Suppl 2: 223–233. doi: 10.2307/3435012
- 22. Hales S, de Wet N, Maindonald J, Woodward A (2002) Potential effect of population and climate changes on global distribution of dengue fever: an empirical model. Lancet 360: 830–834. doi: 10.1016/s0140-6736(02)09964-6
- 23. Yang HM, Macoris ML, Galvani KC, Andrighetti MT, Wanderley DM (2009) Assessing the effects of temperature on dengue transmission. Epidemiol Infect 137: 1179–1187. doi: 10.1017/s0950268809002052
- 24. Chowell G, Sanchez F (2006) Climate-based descriptive models of dengue fever: the 2002 epidemic in Colima, Mexico. J Environ Health 68: 40–44.
- 25. Thammapalo S, Chongsuvivatwong V, Geater A, Dueravee M (2008) Environmental factors and incidence of dengue fever and dengue haemorrhagic fever in an urban area, Southern Thailand. Epidemiol Infect 136: 135–143. doi: 10.1017/s0950268807008126
- 26. Padmanabha H, Durham D, Correa F, Diuk-Wasser M, Galvani A (2012) The interactive roles of Aedes aegypti super-production and human density in dengue transmission. PLoS Negl Trop Dis 6: e1799. doi: 10.1371/journal.pntd.0001799
- 27. Union IT (2012) Percentage of Individuals using the Internet 2000–2011.
- 28. Trends GD (2012) Google Dengue Trends: Mexico. doi: 10.5210/ojphi.v5i1.4584
- 29. Epidemiologica EUDMDGD (2012) Anuarios De Morbilidad http://www.epidemiologia.salud.gob.mx/anuario/html/anuarios.html Accessed August 29, 2012.