Citation: Wolbers M, Kleinschmidt I, Simmons CP, Donnelly CA (2012) Considerations in the Design of Clinical Trials to Test Novel Entomological Approaches to Dengue Control. PLoS Negl Trop Dis 6(11): e1937. doi:10.1371/journal.pntd.0001937
Editor: Pattamaporn Kittayapong, Mahidol University, Thailand
Published: November 29, 2012
Copyright: © 2012 Wolbers et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Funded by a grant from the Foundation for the National Institutes of Health through the Vector-Based Transmission of Control: Discovery Research (VCTR) program of the Grand Challenges in Global Health initiative of the Bill & Melinda Gates Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Cameron Simmons is an investigator in the Eliminate Dengue Project, which aims to use Wolbachia-infected Aedes aegypti mosquitoes to reduce dengue transmission.
Dengue is the most important arboviral infection of humans. In endemic countries the scale of the dengue disease burden imparts an economic cost  and strains fragile health care systems. There are no licensed vaccines for prevention of dengue, and the public health response in endemic countries relies mostly on combating the principal mosquito vector, Aedes aegypti, via insecticides and breeding site removal. The sustained transmission of dengue in endemic settings together with its increasing global footprint indicates existing disease control strategies have been unsuccessful .
Novel vector control approaches to limit dengue virus (DENV) transmission include release of Ae. aegypti that carry transgenes that result in highly penetrant, dominant, late-acting, female-specific lethality . In field cage experiments, the release of such mosquitoes in sufficient numbers results in eradication of the mosquito population . Another strategy involves embryonic introduction of the obligate intracellular insect bacterium, Wolbachia, into strains of Ae. aegypti . Strikingly, Wolbachia-infected Ae. aegypti are partially resistant to infection with DENV , and by virtue of the intrinsic capacity of some strains of Wolbachia to invade insect populations , , there is the prospect of achieving widespread biological resistance to DENV amongst Ae. aegypti populations. The life-shortening impact of some Wolbachia strains could also contribute to reductions in disease transmission . The first entomological field trials of mosquitoes infected with Wolbachia (wMel and wMelPop strains) have now been successfully carried out in Cairns, Australia and have demonstrated that Wolbachia can establish itself at very high prevalence in field populations of Ae. aegypti . However, the prospects of demonstrating reduction in DENV transmission in Cairns are slim given the episodic, imported nature of dengue outbreaks in this region.
A critical challenge for all entomological approaches to control of vector-borne disease is how best to demonstrate efficacy in reducing disease transmission . In principal, the high force of infection in dengue endemic countries should assist an evidence-gathering approach to this challenge. However, a feature of dengue epidemiology is that it is spatially and temporally heterogeneous –. Thus oscillations in disease incidence over time are common for a given region of transmission, and within each region it is common for focal “hot spots” of transmission to exist . This heterogeneity in transmission means that uncontrolled observational studies of dengue transmission in a community where, for example, Wolbachia-infected Ae. aegypti have been released could take many years or decades to yield evidence that is suggestive of a benefit. Equally, the heterogeneity of dengue transmission poses challenges to traditional clinical trial approaches, as does the non-stationary nature of mosquito populations . Here we review design and statistical considerations relevant to the conduct of clinical trials of these novel interventions and the practical challenges posed by the epidemiology of dengue in endemic settings. Whilst our discussion of trial design is focused on Wolbachia-infected Ae. aegypti, it is also relevant to other vector control interventions, such as genetically engineered male mosquitoes carrying a dominant lethal gene , insecticide-impregnated nets , or larvacides .
Cluster randomised trials (CRTs) are the gold standard design to provide evidence on the efficacy of an intervention that has community-wide impact . Cluster formation is a crucial aspect of the design of a CRT and requires prior mapping of the study area with respect to dengue sero-prevalence, demographics, and information on movement of individuals. Experience from the Cairns (Australia) release shows that it is feasible to achieve a prevalence of Wolbachia infection in A. aegypti mosquitoes of nearly 100% in treatment clusters within 6 months after first release . Clusters need to be sufficiently geographically separated to ensure that A. aegypti mosquitoes present in control clusters remain virtually free of Wolbachia for the entire study period.
We consider the incidence of DENV-seroconversions during a trial as a suitable primary endpoint and DENV-naïve children aged 2–5 years living in each cluster as an optimal “sentinel” cohort for serological surveillance. Young children are less likely to spend substantial periods of time outside of their residence and local community (and hence outside of the “treatment umbrella”) than more mobile older children and adults. In addition, DENV-prevalence in older children is higher and those remaining naïve and hence eligible for the study are potentially less representative of the full population (for example, for socio-economic reasons).
Two alternative designs are considered. The first is the classical parallel two-armed cluster randomised trial (PCRT) in which each recruited cluster is randomised to intervention or control, and the intervention is implemented simultaneously across the relevant clusters. Thus the control clusters provide contemporaneous controls for the intervention clusters. The other design considered is a stepped wedge cluster randomised trial (SWCRT) in which each cluster is assigned to the control treatment initially and clusters are subsequently crossed-over to the intervention in a random selection at fixed time points until eventually all clusters are under treatment , . As dengue is a seasonal disease, selected cross-over time points should reflect this. As an example, for a 3-year study period, the SWCRT has: all clusters as controls for year 1; half of the clusters as controls and half as intervention, randomly selected, for year 2; and all clusters on intervention in year 3. Diagrams of both designs are provided in Text S1.
SWCRTs have been most frequently used for evaluating interventions during routine implementation such as the evaluation of a vaccine on the community level following a successful individual randomised trial. From a logistic perspective, they are attractive, because the intervention can be rolled out in a step-wise fashion and evaluated. As clusters are their own controls, SWCRTs are less sensitive to between-cluster variation and thus might require a lower sample size compared to parallel designs . However, strong temporal effects may greatly reduce the precision of estimates as all clusters start out in the control arm and end as intervention clusters. Secular trends of dengue during the study period could confound the treatment effect causing bias. SWCRTs are less flexible for trial adaptations such as an extension of the follow-up period if the observed DENV-incidence is lower than expected, as all clusters have already crossed-over to the intervention at this time point.
Cluster size and cluster separation are important considerations in the design of all CRTs, but they require particular attention in trials of vector control interventions, for which entomological and community considerations need be taken into account. Entomological considerations include the dispersal of Wolbachia-infected mosquitoes to ensure a persistent and homogenous effect in treatment clusters without undue contamination into untreated clusters that serve as controls. For dengue trials community considerations include the extent of daily movement within and between clusters that the surveillance cohorts are likely to undertake; if the clusters are too small this movement may be excessive, and cause further reduction in any treatment effect. Thus, data on movement patterns of children eligible to join the surveillance cohort together with more information on the limits of spatial dispersal of Wolbachia-infected mosquitoes are essential before the cluster formation stage of any trial. An approach that is widely adopted in CRTs is the so-called “fried-egg” design , in which the whole cluster receives the allocated treatment but only the inner area of the cluster (the “egg-yolk”) is used for surveillance since the treatment effect in this inner area is less affected by spill-over from neighbouring clusters that may be in the opposite treatment arm. We would therefore suggest that the surveillance cohort in each cluster be drawn from this inner area of each cluster.
Sample Size Requirements of a CRT
Sample size requirements for CRTs of a Wolbachia intervention (or other community-based intervention) depend critically on the size of the intervention effect and on both the magnitude and the variability (temporal and spatial) of seroconversion rates between clusters. To assess this variability in an example, we used published data from 12 primary schools in Kamphaeng Phet, Thailand, followed over a 3-year period  where the overall yearly DENV infection incidences were 7.9%, 6.5%, and 2.2%.
A mixed-effects Poisson-regression model fitted to these data gave coefficients of variation (cv, i.e., SD/mean) for yearly DENV infection incidence of 0.27 for between-school variation, 0.57 for annual variation, and 0.85 for residual variation (i.e., variation that cannot be explained by systematic spatial or temporal variation, respectively, and corresponds to localized school and year specific variation). A detailed description of the model used to derive these coefficients of variation can be found in Text S1. The overall between-school coefficient of variation over the 3-year period was 0.52. The same model fit to data from 43 villages in Cambodia , also showed that temporal and residual variation are more pronounced than spatial variation (unpublished data).
We then used the incidence and variability data reported above to simulate hypothetical PCRT and SWCRT trials. Additional assumptions for the trial simulations were a study duration of 3 years and a surveillance cohort of 100 children in each cluster. We varied the intervention effect between a 40% and an 80% decrease of DENV seroconversion in intervention clusters compared to controls. Allowing for the fact that some children in intervention clusters will experience infections outside of the intervention area, we regard an effect of a 50%–60% reduction as realistic in our target population. Details regarding the set-up of the simulation study and the statistical analysis of simulated trials are provided in Text S1.
Sample size requirements for the two designs and for varying treatment effects are shown in Figure 1 and requirements for several alternative scenarios are given in Text S1. The required total sample sizes to detect a 60% or 50% reduction of dengue in the intervention arm with 80% power were 20 or 32 clusters, respectively, for a PCRT compared to 40 or 72 clusters for a SWCRT. The SWCRT design generally required substantially higher sample sizes except in the unrealistic situation of spatial but no temporal or residual variation.
Figure 1. Sample size estimates for a PCRT or a SWCRT.
Total number of clusters required for a PCRT (black lines) or a SWCRT (blue lines) depending on the size of the intervention effect. Solid lines correspond to 90% power, dashed lines to 80% power. Simulations are based on parameters determined from the Kamphaeng Phet dengue cohort (Thailand) (described in ) with three time periods each of 1-year duration, a surveillance cohort of 100 children in each cluster, and a two-sided significance level of 5%.doi:10.1371/journal.pntd.0001937.g001
A parallel cluster-randomised trial is the design of choice for testing novel entomological methods of dengue control. Under realistic assumptions we show it to require a substantially lower sample size than a stepped wedge design. Sample size requirements for a parallel design are relatively modest; our example gave a minimum sample size of 20 clusters (ten per study arm) with each cluster providing 100 person-years of follow-up per year and a follow-up duration of 3 years. Although careful planning and substantial funding are required to run such a trial, the benefits of having a robust evidence-base from which to promote programmatic roll-out and/or further optimisation of the strategy should prove invaluable.
Statistical appendix containing: (1) a diagram of a parallel two-arm cluster randomised trial (PCRT) and a stepped wedge cluster randomised trial (SWCRT), (2) details regarding the determination of coefficients of variation for the Thailand data, and (3) details regarding the simulation study to compare PCRT versus SWCRT designs.
- 1. Suaya JA, Shepard DS, Siqueira JB, Martelli CT, Lum LC, et al. (2009) Cost of Dengue cases in eight countries in the Americas and Asia: a prospective study. Am J Trop Med Hyg 80: 846–855.
- 2. Simmons CP, Farrar JJ, Nguyen vV, Wills B (2012) Dengue. New Engl J Med 366: 1423–1432. doi: 10.1056/nejmra1110265
- 3. Balmaseda A, Standish K, Mercado JC, Matute JC, Tellez Y, et al. (2010) Trends in patterns of dengue transmission over 4 years in a pediatric cohort study in Nicaragua. J Infect Dis 201: 5–14. doi: 10.1086/648592
- 4. Wise de Valdez MR, Nimmo D, Betz J, Gong HF, James AA, et al. (2011) Genetic elimination of dengue vector mosquitoes. Proc Natl Acad Sci U S A 108: 4772–4775. doi: 10.1073/pnas.1019295108
- 5. McMeniman CJ, Lane RV, Cass BN, Fong AW, Sidhu M, et al. (2009) Stable introduction of a life-shortening Wolbachia infection into the mosquito Aedes aegypti. Science 323: 141–144. doi: 10.1126/science.1165326
- 6. Walker T, Johnson PH, Moreira LA, Iturbe-Ormaetxe I, Frentiu FD, et al. (2011) The wMel Wolbachia strain blocks dengue and invades caged Aedes aegypti populations. Nature 476: 450–453. doi: 10.1038/nature10355
- 7. Hoffmann AA, Montgomery BL, Popovici J, Iturbe-Ormaetxe I, Johnson PH, et al. (2011) Successful establishment of Wolbachia in Aedes populations to suppress dengue transmission. Nature 476: 454–457. doi: 10.1038/nature10356
- 8. James S, Simmons CP, James AA (2011) Ecology. Mosquito trials. Science 334: 771–772. doi: 10.1126/science.1213798
- 9. Vong S, Khieu V, Glass O, Ly S, Duong V, et al. (2010) Dengue incidence in urban and rural Cambodia: results from population-based active fever surveillance, 2006–2008. PLoS Negl Trop Dis 4: e903 doi:10.1371/journal.pntd.0000903.
- 10. Endy TP, Chunsuttiwat S, Nisalak A, Libraty DH, Green S, et al. (2002) Epidemiology of inapparent and symptomatic acute dengue virus infection: a prospective study of primary school children in Kamphaeng Phet, Thailand. Am J Epidemiol 156: 40–51. doi: 10.1093/aje/kwf005
- 11. Liebman KA, Stoddard ST, Morrison AC, Rocha C, Minnick S, et al. (2012) Spatial dimensions of dengue virus transmission across interepidemic and epidemic periods in Iquitos, Peru (1999–2003). PLoS Negl Trop Dis 6: e1472 doi:10.1371/journal.pntd.0001472.
- 12. Lenhart A, Orelus N, Maskill R, Alexander N, Streit T, et al. (2008) Insecticide-treated bednets to control dengue vectors: preliminary evidence from a controlled trial in Haiti. Trop Med Int Health 13: 56–67. doi: 10.1111/j.1365-3156.2007.01966.x
- 13. Marcombe S, Darriet F, Agnew P, Etienne M, Yp-Tcha MM, et al. (2011) Field efficacy of new larvicide products for control of multi-resistant Aedes aegypti populations in Martinique (French West Indies). Am J Trop Med Hyg 84: 118–126. doi: 10.4269/ajtmh.2011.10-0335
- 14. Richard J Hayes and Lawrence H Moulton (2009) Cluster randomised trials. Boca Raton (FL): CRC Press.
- 15. Hussey MA, Hughes JP (2007) Design and analysis of stepped wedge cluster randomized trials. Contemp Clinical Trials 28: 182–191. doi: 10.1016/j.cct.2006.05.007
- 16. Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ (2011) Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol 64: 936–948. doi: 10.1016/j.jclinepi.2010.12.003