Advertisement
Research Article

Accuracy of a Dual Path Platform (DPP) Assay for the Rapid Point-of-Care Diagnosis of Human Leptospirosis

  • Scott A. Nabity,

    Affiliations: Duke University School of Medicine, Durham, North Carolina, United States of America, Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil

    X
  • Guilherme S. Ribeiro mail,

    gsribeiro@ufba.br

    Affiliations: Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil, Instituto de Saúde Coletiva, Universidade Federal da Bahia, Salvador, Brazil

    X
  • Carolina Lessa Aquino,

    Affiliation: Bio-Manguinhos, Fundação Oswaldo Cruz, Rio de Janeiro, Brazil

    X
  • Daniele Takahashi,

    Affiliation: Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil

    X
  • Alcinéia Oliveira Damião,

    Affiliation: Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil

    X
  • André H. O. Gonçalves,

    Affiliation: Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil

    X
  • Demócrito B. Miranda-Filho,

    Affiliation: Departamento de Medicina Clínica, Universidade de Pernambuco, Recife, Brazil

    X
  • Rena Greenwald,

    Affiliation: Chembio Diagnostic Systems, Medford, New York, United States of America

    X
  • Javan Esfandiari,

    Affiliation: Chembio Diagnostic Systems, Medford, New York, United States of America

    X
  • Konstantin P. Lyashchenko,

    Affiliation: Chembio Diagnostic Systems, Medford, New York, United States of America

    X
  • Mitermayer G. Reis,

    Affiliation: Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil

    X
  • Marco A. Medeiros,

    Affiliation: Bio-Manguinhos, Fundação Oswaldo Cruz, Rio de Janeiro, Brazil

    X
  • Albert I. Ko

    Affiliations: Centro de Pesquisa de Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil, Yale University Schools of Public Health and Medicine, New Haven, Connecticut, United States of America

    X
  • Published: November 01, 2012
  • DOI: 10.1371/journal.pntd.0001878

Abstract

Background

Diagnosis of leptospirosis by the gold standard serologic assay, the microscopic agglutination test (MAT), requires paired sera and is not widely available. We developed a rapid assay using immunodominant Leptospira immunoglobulin-like (Lig) proteins in a Dual Path Platform (DPP). This study aimed to evaluate the assay's diagnostic performance in the setting of urban transmission.

Methodology

We determined test sensitivity using 446 acute and convalescent sera from MAT-confirmed case-patients with severe or mild leptospirosis in Brazil. We assessed test specificity using 677 sera from the following groups: healthy residents of a Brazilian slum with endemic transmission, febrile outpatients from the same slum, healthy blood donors, and patients with dengue, hepatitis A, and syphilis. Three operators independently interpreted visual results without knowing specimen status.

Results

The overall sensitivity for paired sera was 100% and 73% for severe and mild disease, respectively. In the acute phase, the assay achieved a sensitivity of 85% and 64% for severe and mild leptospirosis, respectively. Within seven days of illness onset, the assay achieved a sensitivity of 77% for severe disease and 60% for mild leptospirosis. Sensitivity of the DPP assay was similar to that for IgM-ELISA and increased with both duration of symptoms (chi-square regression P = 0.002) and agglutinating titer (Spearman ρ = 0.24, P<0.001). Specificity was ≥93% for dengue, hepatitis A, syphilis, febrile outpatients, and blood donors, while it was 86% for healthy slum residents. Inter-operator agreement ranged from very good to excellent (kappa: 0.82–0.94) and test-to-test reproducibility was also high (kappa: 0.89).

Conclusions

The DPP assay performed acceptably well for diagnosis of severe acute clinical leptospirosis and can be easily implemented in hospitals and health posts where leptospirosis is a major public health problem. However, test accuracy may need improvement for mild disease and early stage leptospirosis, particularly in regions with high transmission.

Author Summary

Leptospirosis is an important cause of acute fever in the tropics and the mortality rate may exceed 15% in patients with severe disease manifestations. The gold standard serological test for diagnosing leptospirosis, the microagglutination test or MAT, requires significant laboratory resources and results are not timely. Improved diagnostics are therefore critically needed to identify patients and outbreaks earlier and to thereby prevent unnecessary deaths. The need for a rapid diagnostic test is particularly acute in resource-poor settings where leptospirosis is a major public health problem and sophisticated laboratories are unavailable. In this study, we measured the diagnostic accuracy of the novel Dual Path Platform (DPP) for leptospirosis using serum from patients with mild and severe disease. The DPP assay detected up to 85% of severe leptospirosis and 64% of mild leptospirosis patients using the initial clinical specimen collected at hospital presentation and its diagnostic performance was comparable to a commonly used IgM-ELISA. Furthermore, the DPP assay produces a result in 20 minutes and can be more easily implemented in field settings than existing diagnostic technologies. The commercially available DPP kit offers the simple, accurate, and quick diagnosis of leptospirosis and, consequently, more timely clinical and public health decision-making.

Introduction

Leptospirosis, caused by >200 pathogenic serovars of Leptospira interrogans, is an increasingly important cause of morbidity worldwide with >500,000 cases annually [1], [2]. Most urban infections in Brazil and other emerging economy countries occur in densely populated, resource-poor slums that lack adequate sanitation, cultivate rodent reservoirs, and foster the environmental persistence of Leptospira 3[6]. Although few (5–10%) infections progress to severe disease, typified by jaundice, acute renal failure, and hemorrhage (Weil's disease) and/or respiratory compromise, the case fatality may exceed 15% when severe disease develops [7], [8]. Early antimicrobial therapy reduces illness duration and severity [9], [10]. However, leptospirosis is often clinically confused with other acute febrile illnesses [11], [12]. Accurate early detection therefore remains urgently needed to avert the significant consequences of leptospirosis.

Culturing Leptospira is difficult and growth success is diminished in patients already initiated on antimicrobial therapy. The gold standard diagnostic assay for leptospirosis, the microscopic agglutination test (MAT), requires skilled technicians, maintenance of live cultures, and paired sera for confirmation. Application of these standard confirmatory techniques is limited and prolonged [13], [14], thus hindering patient management, community-based surveillance, and outbreak response. Polymerase chain reaction (PCR) is ≤60% sensitive in the acute phase and is consistently outperformed by serological tests [15], [16]. Current PCR and enzyme-linked immunoassay (ELISA) systems further require sophisticated equipment. Agglutination, dipstick, and lateral flow assays are among other diagnostic technologies for leptospirosis whose performance has been described [17][24]. Collectively, these assays demonstrated insufficient sensitivity in early acute disease and some require basic laboratory support.

Most rapid serological tests to date relied on genus-wide cross-reactivity to detect antigenically diverse pathogens, most commonly utilizing whole-cell antigen from the saprophytic serovar Patoc I [7]. The novel Dual Path Platform (DPP) (Chembio Diagnostic Systems, Medford, New York, USA) assay for leptospirosis incorporates high concentrations of recombinant leptospiral immunoglobulin-like (rLig) proteins as antigens. It thereby avoids the cross-reactivity observed in whole-cell assays with nonspecific cell surface components, such as lipopolysaccharides, that are common to other pathogens. Lig proteins are key markers for the serodiagnosis of acute-phase leptospirosis because they elicit a robust humoral immune response [25], [26], are conserved among pathogenic species [27], [28], and are active in natural infection as they are preferentially expressed at physiological osmolarity [29][31] and contribute to cell adhesion [32][34]. We rationally selected the most seroreactive combination of rLig proteins for use as antigens in the DPP assay for leptospirosis using a multi-antigen print immunoassay (MAPIA) (unpublished data). The DPP has been successfully applied to the diagnosis of other human diseases, including syphilis [35], and utilizes a variation of lateral flow technology, whereby the biological sample and the colorimetric marker are delivered on separate, perpendicular nitrocellulose membranes. This design increases assay sensitivity by circumventing non-specific interference between the assay's embedded marker proteins and immunoglobulin in the patient sample.

In this study, we assessed the diagnostic performance of the DPP assay in the setting of urban leptospirosis transmission using the MAT as the gold standard to determine the primary outcomes of sensitivity, specificity, and reproducibility. Secondarily, we compared its diagnostic accuracy with a commonly used IgM-ELISA and correlated DPP performance with severity and duration of illness.

Methods

Ethics statement

We adhered to comprehensive diagnostic accuracy evaluation standards (Table S1) [36] and received IRB approval from FIOCRUZ, New York Presbyterian Hospital, and Yale University. Leptospirosis case-patients, non-leptospirosis febrile outpatients and healthy slum residents provided written consent and blood donors consented to its use in biomedical research. We procured sera for hepatitis A, dengue, and syphilis as anonymous reference specimens.

Participants

We measured sensitivity using 446 serum samples from 378 individuals with either mild or severe leptospirosis from two urban Brazilian populations. We collected acute sera at enrollment and convalescent samples after approximately 15 days. Case-patient sera from all sites were well characterized according to clinical presentation, clinical and diagnostic laboratory results, epidemiological risk factors, and clinical outcomes using standardized data collection tools based on active case detection protocols [37]. We designated hospitalized case-patients as having severe leptospirosis, regardless of clinical syndrome, and non-hospitalized case-patients as mild leptospirosis. Both mild and severe leptospirosis case-patients were included solely on the basis of serological confirmation by the following MAT criteria: i) seroconversion (undetectable acute titer and convalescent titer ≥1:200), ii) ≥four-fold rise in acute to convalescent titers, or iii) single sample titer ≥1:800. We calculated specificity from 677 control sera.

Severe disease from Salvador.

We randomly selected 259 (18%) of 1,435 acute and 110 (11%) of 1,026 convalescent sera from a serum bank of hospitalized case-patients ≥5 years of age with confirmed leptospirosis. Acute and convalescent specimens were independently sampled and resultant individual case-patient serum pairs were matched thereafter. The serum bank was created between 1996–2010 while conducting active surveillance at the state reference infectious disease hospital in Salvador, Brazil (4.0 cases per 100,000 residents in 2009 [38]), which receives 90% of the region's severe cases. Active surveillance inclusion criteria were: i) strong clinical suspicion for leptospirosis or ii) at least one of the following: acute undifferentiated fever associated with either bleeding, acute renal insufficiency, jaundice, or acute liver injury with transaminases <1,000 U/L.

Severe disease from Recife.

We also included acute-phase sera from all 23 confirmed case-patients that we recruited at a teaching hospital from June–August 2010 in Recife, Brazil (4.7 per 100,000 in 2009 [38]) using the same active surveillance inclusion criteria. The hospital is one of the two reference centers in Recife for the management of leptospirosis and it reports about 40% of the city's severe cases. Only five of these 23 cases had convalescent sera available. While we used these convalescent specimens for confirming patient status by MAT, we did not include this small group of samples in testing with the DPP assay.

Mild disease.

Mild cases were identified during community-based sentinel surveillance for acute febrile illness requiring medical attention in the only public outpatient emergency unit serving the community of Pau da Lima within the city of Salvador. As we previously reported, this slum community lacks sanitation infrastructure and is endemic for leptospirosis; 15% of its inhabitants have agglutinating antibodies to Leptospira [5]. From 2009–2010, the surveillance team identified 12,198 community residents ≥5 years of age seeking care due to an acute febrile illness. Of these, 23% were recruited and their sera tested for leptospirosis. Available sera (28 acute-phase and 26 convalescent-phase samples) from all 28 mild case-patients with confirmed leptospirosis identified during surveillance were included in this evaluation.

Controls.

Healthy control sera were derived from: 1) 162 randomly selected Salvador slum residents from a Pau da Lima community survey in 2003–2004, 2) 150 Salvador blood donors, and 3) 100 blood donors from the U.S. where leptospirosis is rare [39]. We selected the aforementioned samples without regard for MAT status. We also included 65 sera each from cases of dengue confirmed by IgM-ELISA or NS1 antigen detection assays and acute hepatitis A confirmed with an IgM chemiluminescent assay at the state reference laboratory in Salvador. Both diseases are in the differential diagnosis for acute clinical leptospirosis. We additionally included 70 acute-phase sera from febrile outpatients randomly selected from the same serum bank used for selecting mild cases, which was created as previously described during slum community-based surveillance for acute febrile illness in 2009–2010. All 70 cases had negative results by MAT (titer <1:100) for both acute and convalescent sera. Finally, we tested 65 sera from syphilis cases confirmed by VDRL at the state reference laboratory to assess for cross-reacting antibodies [40].

Laboratory procedures

IgM-ELISA and MAT.

We assayed sera from all case-patients, healthy slum residents, and Brazilian blood donors using whole-Leptospira IgM-ELISA at the Oswaldo Cruz Foundation (FIOCRUZ, Salvador, Brazil) according to manufacturer instructions (Bio-Manguinhos, Rio de Janeiro, Brazil [41]; or PanBio Ltd., Brisbane, Australia [42]). We performed the MAT at the leptospirosis reference laboratory at FIOCRUZ as previously described [14]. Table S2 displays the strains of Leptospira used for the MAT. For severe leptospirosis from Salvador, we used a panel of 10 reference and locally isolated strains representing nine serovars and nine serogroups. This panel effectively identified most locally circulating Leptospira, 90% of which are L. interrogans Icterohaemorrhagiae serovar copenhageni [37]. For mild disease specimens, we screened sera from acute febrile illness patients for leptospirosis infection with an IgM-ELISA [41] and with an MAT panel of seven strains representing five serovars and six serogroups. We then applied an extended battery of 26 strains (23 serogroups and 25 serovars) if the sera were IgM-ELISA positive or reacted with any strain in the initial MAT panel with a titer ≥1:200. For Recife specimens, we used the extended battery of 26 strains. We tested a sample of 53% of control sera from healthy slum residents using a reduced MAT panel of seven strains.

Dual Path Platform (DPP) assay.

The DPP assay for leptospirosis was developed by Chembio Diagnostic Systems (Medford, New York, USA) and is manufactured by Bio-Manguinhos (Rio de Janeiro, Brazil) through a technology transfer agreement with the Brazilian Ministry of Health. We assayed the DPP at FIOCRUZ (92.5% of all assays) or Chembio Diagnostic Systems (7.5% of all assays) laboratories from March–June 2011 with the same stored sera as were used for IgM-ELISA and MAT. We performed the assay according to manufacturer instructions using 5 µl of undiluted serum. Three independent operators visually interpreted results after 20 minutes as either positive or negative. We defined the final assay result according to the equivalent subjective visual interpretations (i.e., positive or negative) of ≥2 of the 3 operators. Weak reactions were classified according to the same criterion. Interpreters were blinded to case-patient status.

Statistical analyses

We ordered all samples in random sequence and assigned a blinded unique numerical code prior to testing. We double entered and cross-validated all data elements and analyzed the data with SAS v9.2 (SAS Inst.; Cary, NC, USA) using α = 0.05.

Comparison across case-patient groups.

We compared demographic, clinical, and laboratory characteristics across case-patient sampling groups using frequencies and means with standard deviations. We used the chi-square test (with continuity correction when ≥1 cell had an expected count <5 units) for comparisons involving categorical variables, and the ANOVA test for comparisons of continuous variables. We presumed the infecting serogroup to be that with the highest MAT titer among both acute and convalescent samples.

DPP sensitivity and specificity.

We calculated the overall sensitivity for case-patients with paired sera whereby a reactive DPP result in either the acute or convalescent sample was counted as positive. We further reported sensitivity independently for acute and convalescent samples and defined specificity separately within control groups. Exact 95% confidence limits were calculated for sensitivities and specificities, and DPP performance was compared to IgM-ELISA and the geometric mean reciprocal MAT titer. Lastly, we performed chi-square regression by prevalence trend analysis of DPP sensitivity as a function of days of illness [43].

DPP predictive values.

We estimated the positive predictive value (PPV) and negative predictive value (NPV) of the DPP for severe disease based on empirical data from ongoing active surveillance in Salvador, where pre-test probability was 90% among hospitalized cases suspected of severe leptospirosis meeting surveillance inclusion criteria [37]. Because the prevalence of mild leptospirosis was 1% in the indiscriminate febrile outpatient population (unpublished data), we estimated PPV and NPV for mild disease using a 50% pre-test probability of leptospirosis. We believe this more plausibly reflects the clinical scenario under which physicians will solicit rapid testing for leptospirosis in the outpatient setting. By logistic regression, we assessed whether severe disease clinical characteristics generally known at initial evaluation were able to predict DPP positivity, assessed global model diagnostics, and calculated odds ratios (OR).

Reproducibility.

We interpreted inter-operator reproducibility (the pairwise concordance of the dichotomized visual result for the same assay) among three operators and test-to-test reproducibility (the concordance of the dichotomized visual result for repeated assay of the same sample) for the DPP assay with kappa. For test-to-test reproducibility, we randomly selected 98 (9%) of the 1,123 originally assayed sera.

Results

Case-patient characteristics

Severe disease case-patients providing acute-phase sera from Salvador were older and more frequently male than those with mild disease, whereas demographics between severe disease groups were similar (Table S3). In comparison to those providing acute-phase sera (Table S3), the 110 severe leptospirosis cases-patients from Salvador providing convalescent-phase sera less frequently died (0%; chi-square P<0.001).

Acute sera for mild case-patients were collected earlier than for severe disease (Table S3); mild disease sera were collected within two days of symptoms onset for 70% compared to <4% for severe disease from Salvador (chi-square P<0.001). Case-patients designated as mild leptospirosis had objectively less severe disease than those designated as severe leptospirosis per several clinical indicators (Table S3), which correlated with mild disease less frequently diagnosed clinically as leptospirosis (95% for severe vs. 7% for mild; chi-square P<0.001). Among those with severe disease, Salvador case-patients were sicker according to clinical jaundice, oliguria, tachypnea, elevated serum creatinine (≥4 mg/dL), and total serum bilirubin (>1.5 mg/dL) (Table S3).

Most case-patients from Salvador (96% of severe and 93% of mild) had infections presumptively caused by the locally dominant serogroup, L. interrogans Icterohaemorrhagiae, compared with 70% from Recife (chi-square P<0.001). Finally, case-patient groups differed by MAT confirmation criteria. Few Recife case-patients had convalescent specimens available and consequently a significantly greater proportion was confirmed with a single titer ≥1:800 (Table S3).

Sensitivity and specificity

The overall sensitivity for the 42 severe disease and 26 mild disease patients with paired sera evaluated by DPP was 100% (95% CI 92–100%) and 73% (52–88%), respectively. Sensitivity did not differ significantly between laboratories (data not shown). We measured higher DPP sensitivity in the acute phase for severe disease from Salvador (85%) and Recife (78%) compared to mild disease (64%) (Table 1). Sensitivity was lower for sera collected <7 days after disease onset: 77% for severe disease from Salvador, 43% from Recife, and 60% for mild disease. For severe case-patients from Salvador collected <7 days of onset, the acute-phase sensitivity for DPP (77%, 66–85%) was superior to the 1:00 MAT screening titer (46%, 35–58%; P<0.001) and showed a trend toward superiority over the IgM-ELISA (65%, 54–76%; P = 0.12). In convalescence, the sensitivity was 98% for severe disease from Salvador and 50% for mild disease. Of 18 DPP-positive mild acute sera, seven (39%) were negative in convalescence, despite an increase in MAT titer from the acute phase for six (data not shown).

thumbnail

Table 1. Sensitivity of the DPP assay and IgM-ELISA for diagnosing human leptospirosis.

doi:10.1371/journal.pntd.0001878.t001

DPP specificity was >95% except among Brazilian blood donors (93%) and slum residents (86%), for which IgM-ELISA outperformed DPP (chi-square P = 0.001) (Table 2). Among the 86 slum residents for whom MAT titers were known, DPP specificity (87%, 78–93%) was also inferior to the MAT screening titer 1:100 (97%, 90–99%; P = 0.05); rather, it was equivalent to the titer 1:50 (86%, 77–93%).

thumbnail

Table 2. Specificity of the DPP assay and IgM-ELISA for diagnosing human leptospirosis.

doi:10.1371/journal.pntd.0001878.t002

Factors influencing DPP sensitivity

Sensitivity for both DPP and IgM-ELISA was positively correlated with duration of symptoms in both severe disease from Salvador and Recife (combined in Figure 1A) and mild disease (Figure 1B). In the 14 days after onset for severe leptospirosis, regression on prevalence analysis (chi-square = 10.1, P = 0.002) estimated a daily increase in DPP sensitivity of 2.7%. Notably, the DPP assay outperformed IgM-ELISA early in both severe and mild disease, when treatment initiation is critical. We similarly found a positive relationship between symptom duration and MAT titer for the combined cases of severe disease from Salvador and Recife, and for the mild disease cases (Spearman ρ = 0.24, P<0.001). The proportion of all severe disease acute specimens with high MAT titers (≥1:800) was 17% on days 2–3 after onset and then rose to 98% after day 11 (data not shown).

thumbnail

Figure 1. DPP, IgM-ELISA, and 1:100 MAT sensitivity and mean MAT titer for acute-phase sera of human leptospirosis.

Acute-phase sera from (A) 282 MAT-confirmed severe leptospirosis case-patients (259 from Salvador and 23 from Recife, Brazil) and from (B) 28 MAT-confirmed mild leptospirosis case-patients from Salvador. 95% confidence intervals calculated for point estimates of sensitivity and the geometric mean (± geometric standard deviation) calculated for reciprocal MAT titers. DPP = Dual Path Platform; MAT = microagglutination test; ELISA = enzyme-linked immunosorbant assay; ND = not determined because no case-patients were identified within the corresponding time interval.

doi:10.1371/journal.pntd.0001878.g001

Severe leptospirosis case-patients with more serious clinical manifestations had an increased likelihood of a positive DPP result (data not shown). Sensitivity varied according to higher serum creatinine (91% for creatinine ≥4 mg/dL vs. 79% for creatinine <4 mg/dL, chi-square P = 0.03) and clinical jaundice (88% for jaundiced vs. 60% for not jaundiced, chi-square P<0.001), but we found no difference by presumptive infecting serogroup (85% for each Icterohaemorrhagiae and other serogroups; chi-square P = 0.95). A logistic regression model incorporating days of illness (OR 1.25, 95% CI 1.06–1.47), jaundice (OR 2.94, 95% CI 1.10–7.84), and serum creatinine ≥4 mg/dL (OR 1.24, 95% CI 1.01–1.54) (global Wald chi-square = 19.1, P<0.001) suggested that duration of illness and disease severity independently influenced DPP performance.

Based on the pre-test probability of 90%, we estimated PPV and NPV of the DPP assay for severe acute clinical leptospirosis to be 98% and 39%, respectively. Using the pre-test probability of 50% for mild disease in the outpatient setting, the estimated PPV and NPV were 81% and 69%, respectively.

Reproducibility

Inter-operator reproducibility across three operators was very good to excellent (kappa 0.82, 95% CI 0.76–0.89 to kappa 0.94, 95% CI 0.92–0.96) and test-to-test reproducibility was very good (kappa 0.89, 0.80–0.98). Upon repeat testing, 92% of originally positive and 97% of originally negative assays were interpreted concordantly. Diagnostic performance correlated with the intensity of the assay's reaction. When no colored band was visualized at the test line (Figure 2A), the probability of a properly assigned negative result was 89–91%. Similarly, the probability of correctly identified case-patient status was 95–100% for assays with moderate to strong reactivity (Figure 2B). The probability of an accurate classification was lower, however, with weakly reactive (Figure 2C) interpretations (71–83%).

thumbnail

Figure 2. Representative non-reactive, strongly reactive, and weakly reactive DPP assay results.

Demonstration of (A) non-reactive, (B) strongly reactive, and (C) weakly reactive visual interpretations for the DPP assay. Coloration of the test line (“T” on rapid test cartridge) indicates the presence of anti-rLig antibodies in the biological sample while coloration of the control line (“C” on rapid test cartridge) indicates the presence of non-specific antibodies and denotes a valid test result. DPP = Dual Path Platform.

doi:10.1371/journal.pntd.0001878.g002

Discussion

We measured the diagnostic performance of a novel point-of-care immunoassay for leptospirosis developed from rLig protein fragments. The DPP assay, which detects both IgM and IgG, is sensitive for acute-phase severe leptospirosis and was superior to IgM-ELISA in the first week of illness. We previously reported the superior immunoblot IgM detection against recombinant Lig proteins compared with whole-cell IgM-ELISA and other recombinant proteins [25]. The DPP assay further improves on existing technology by independently delivering the biological sample and the antibody-detecting conjugates to the test line. This method thereby reduces interference between the immunoglobulins in the biological sample and their conjugate proteins that may occur with conventional, single path lateral-flow assays.

Lower sensitivity for mild illness was observed for both DPP and IgM-ELISA, perhaps due to earlier patient presentation in the outpatient setting when immunoglobulin development is underway. Alternatively, an altogether weaker antibody response to mild leptospirosis may occur [44]. Similarly low sensitivity in mild disease convalescence was noted for other rapid serological tests [45] and in our previous work using an rLig membrane-based assay among febrile outpatients from Thailand. Like mild case-patients in the present study, we found that those from Thailand did not require hospitalization, presented earlier, and had lower MAT titers (unpublished data). Lastly, mild case-patients had nondistinctive clinical presentations, were more frequently confirmed with a single MAT titer ≥1:800, and resided in a high-risk area for previous exposures. Some of the mild case-patients included in this study therefore may have presented with other diseases erroneously attributed to acute clinical leptospirosis.

The sensitivities for severe leptospirosis from Salvador (85%) and Recife (78%) were not statistically different, a comparison limited in power by the small sample of confirmed case-patients from Recife. However the trend toward lower sensitivity in Recife may be explained by disease severity. Both recruitment sites for severe leptospirosis used the same inclusion criteria and both serve as state reference hospitals for severe leptospirosis, yet severe leptospirosis case-patients from Recife were less acutely ill than those from Salvador.

The DPP assay specificity was good in both sick (i.e., illnesses other than leptospirosis) and healthy populations. The DPP assay satisfactorily excluded diseases that may exhibit clinical presentations similar to leptospirosis and cross-reacting antibodies, establishing its suitability for the acute care setting. It also performed well in at-risk Brazilian blood donors. Specificity was relatively low in samples from healthy residents of a slum population highly exposed to Leptospira [5] compared with that for samples from residents of the same slum that presented to clinic with acute febrile illnesses. We included sera from healthy slum residents without regard to MAT status, whereas sera from residents with acute fever were screened for negative MAT titers in both the acute and convalescent phases. These observations suggest that the presence of low-level agglutinating antibody titers, which may persist for months to years [4], [46], even after mild disease [47], affected test performance in this group.

In the hospital setting, a positive DPP result predicted disease status with high probability. However, a negative result did not effectively exclude leptospirosis among severe disease suspects. Further diagnostic evaluation for leptospirosis should be pursued in hospitalized patients with high suspicion for leptospirosis, particularly at early stages of infection. In outpatient settings where the prevalence of leptospirosis is typically low, clinicians should use clinical and epidemiological reasoning in selecting patients for DPP testing and thereby enhance pre-test probability for leptospirosis. We showed that stratifying severe disease case-patients by end organ injury, manifested as jaundice and elevated serum creatinine, correlated with DPP positivity. Even though the model was biased toward the sickest patients, these findings suggest a potential means for stratifying PPV on clinical criteria.

Ours is the first evaluation of a field-ready rapid assay for leptospirosis to stratify test performance simultaneously by both disease severity and duration of symptoms. The results suggest that performance of serological assays for leptospirosis should ideally be evaluated in the context of both. The DPP assay was developed principally for earlier diagnosis of acute clinical leptospirosis and we established its utility in that respect. We expect the assay to also provide more timely diagnostic information for public health surveillance. Nonetheless, our study has limitations. The DPP assay relies on subjective visual interpretation for diagnosis and weakly reactive assays may be ambiguous. Further, we included some case-patients in this study without paired sera and, although we conservatively confirmed them with a high single-titer MAT threshold (≥1:800), therefore we did not observe a rise in titers in these individuals. The lack of convalescent samples may have also contributed to the wider variation in presumptive infecting serogroup for Recife cases. The referral process for specialty care of severe leptospirosis was more centralized in Salvador than in Recife during the study period, thereby possibly making Recife case-patients less representative of the regional severe leptospirosis patient population. Lastly, we defined leptospirosis cases using an imperfect gold standard test, probably resulting in an underestimate of the DPP assay's diagnostic performance [48].

In summary, the field-ready DPP assay displayed acceptable diagnostic performance for severe leptospirosis, was highly reproducible, and can be easily implemented in hospitals where leptospirosis is a major public health problem. The next generation assay must improve detection of mild and early-phase illness, and previous work suggests that increased accuracy may be achieved with independent measurement of IgM and IgG antibodies in areas of high endemic transmission [25], [49]. The results from this study may be generalizable throughout urban Brazil where the epidemiology of leptospirosis is similar [37], [50], yet the diagnostic value of the DPP assay should be evaluated in other epidemiological settings and in serial patients with clinical syndromes consistent with leptospirosis to validate its point-of-care efficacy using whole blood.

Supporting Information

Table S1.

STARD checklist for reporting studies of diagnostic accuracy. From: Nabity SA, Ribeiro GS, Aquino CL, et. al. Accuracy of a Dual Path Platform (DPP) Assay for the Rapid Point-of-Care Diagnosis of Human Leptospirosis. PLoS NTD 2012

doi:10.1371/journal.pntd.0001878.s001

(DOC)

Table S2.

Serogroup, serovar, and strain of reference Leptospira used for the microagglutination test (MAT). * Strain isolated at the Oswaldo Cruz Foundation (FIOCRUZ) laboratory in Salvador, Brazil from a locally identified case-patient. From: Nabity SA, Ribeiro GS, Aquino CL, et. al. Accuracy of a Dual Path Platform (DPP) Assay for the Rapid Point-of-Care Diagnosis of Human Leptospirosis. PLoS NTD 2012.

doi:10.1371/journal.pntd.0001878.s002

(DOCX)

Table S3.

Characteristics of confirmed human leptospirosis cases for which acute-phase samples were evaluated. NOTE. SD = standard deviation; ND = not determined; NA = not applicable; MAT = microagglutination test. * Difference between severe cases from Salvador was statistically significant (chi-square or ANOVA P<0.05). Defined as reported fever prior to clinical presentation and/or measured (≥38°C) fever by clinician at presentation. Defined as respiratory rate ≥30 breaths per second. § Defined by the presence of hemoptysis. Defined as an undetectable acute-phase MAT titer followed by a convalescent-phase titer of ≥1:200. Defined by the serogroup with the highest MAT titer among both acute and convalescent specimens, where available. Approximate normal values: total leukocyte count (3,800–9,800/µL); creatinine (0.5–1.2 mg/dL); total bilirubin (0.2–1.3 mg/dL); respiratory rate (12–20 breaths per second). From: Nabity SA, Ribeiro GS, Aquino CL, et. al. Accuracy of a Dual Path Platform (DPP) Assay for the Rapid Point-of-Care Diagnosis of Human Leptospirosis. PLoS NTD 2012.

doi:10.1371/journal.pntd.0001878.s003

(DOCX)

Acknowledgments

This work required the collaboration of numerous parties. Renan Rosa, Amy Dang, Claudia Quinn, and Martha Cavallos participated in the laboratory evaluation. Nivison Nery, Jaqueline Silva, Andréia Santos, Ubiratan Rios, Francisco Alves, and Mayara Carvalho confirmed case-patient sera, blinded selected specimens, and managed the data. Control samples were provided by the Laboratório Central de Saúde Pública of Bahia and the Fundação Hemoba of Bahia. We also thank all research participants, especially the leptospirosis patients and the residents of the community of Pau da Lima in Salvador, Brazil.

Author Contributions

Conceived and designed the experiments: SAN GSR CLA DT KPL MAM AIK. Performed the experiments: SAN CLA DT AOD AHOG. Analyzed the data: SAN GSR KPL AIK. Contributed reagents/materials/analysis tools: DBMF RG JE KPL MGR MAM AIK. Wrote the paper: SAN GSR KPL. Reviewed and approved the final version of the manuscript: SAN GSR CLA DT AOD AHOG DBMF RG JE KPL MGR MAM AIK.

References

  1. 1. WHO (1999) Leptospirosis worldwide. Weekly Epidemiological Record 74: 237–242.
  2. 2. Pappas G, Papadimitriou P, Siozopoulou V, Christou L, Akritidis N (2008) The globalization of leptospirosis: worldwide incidence trends. Int J Infect Dis 12: 351–357. doi: 10.1016/j.ijid.2007.09.011
  3. 3. Sarkar U, Nascimento SF, Barbosa R, Martins R, Nuevo H, et al. (2002) Population-based case-control investigation of risk factors for leptospirosis during an urban epidemic. Am J Trop Med Hyg 66: 605–610.
  4. 4. de Faria MT, Calderwood MS, Athanazio DA, McBride AJ, Hartskeerl RA, et al. (2008) Carriage of Leptospira interrogans among domestic rats from an urban setting highly endemic for leptospirosis in Brazil. Acta Trop 108: 1–5. doi: 10.1016/j.actatropica.2008.07.005
  5. 5. Reis RB, Ribeiro GS, Felzemburgh RD, Santana FS, Mohr S, et al. (2008) Impact of environment and social gradient on Leptospira infection in urban slums. PLoS Negl Trop Dis 2: e228. doi: 10.1371/journal.pntd.0000228
  6. 6. Dias JP, Teixeira MG, Costa MC, Mendes CM, Guimaraes P, et al. (2007) Factors associated with Leptospira sp infection in a large urban center in northeastern Brazil. Rev Soc Bras Med Trop 40: 499–504. doi: 10.1590/s0037-86822007000500002
  7. 7. Levett PN (2001) Leptospirosis. Clin Microbiol Rev 14: 296–326. doi: 10.1128/cmr.14.2.296-326.2001
  8. 8. Gouveia EL, Metcalfe J, de Carvalho AL, Aires TS, Villasboas-Bisneto JC, et al. (2008) Leptospirosis-associated severe pulmonary hemorrhagic syndrome, Salvador, Brazil. Emerg Infect Dis 14: 505–508. doi: 10.3201/eid1403.071064
  9. 9. McClain JB, Ballou WR, Harrison SM, Steinweg DL (1984) Doxycycline therapy for leptospirosis. Annals of internal medicine 100: 696–698. doi: 10.7326/0003-4819-100-5-696
  10. 10. Watt G, Padre LP, Tuazon ML, Calubaquib C, Santiago E, et al. (1988) Placebo-controlled trial of intravenous penicillin for severe and late leptospirosis. Lancet 1: 433–435. doi: 10.1016/s0140-6736(88)91230-5
  11. 11. Flannery B, Pereira MM, Velloso LdF, Carvalho CdC, De Codes LG, et al. (2001) Referral pattern of leptospirosis cases during a large urban epidemic of dengue. Am J Trop Med Hyg 65: 657–663.
  12. 12. Ellis T, Imrie A, Katz AR, Effler PV (2008) Underrecognition of leptospirosis during a dengue fever outbreak in Hawaii, 2001–2002. Vector Borne Zoonotic Dis 8: 541–547. doi: 10.1089/vbz.2007.0241
  13. 13. WHO (2003) Human leptospirosis: guidance for diagnosis, surveillance and control. Geneva, Switzerland: WHO.
  14. 14. Faine S, Adler B, Bolin C, Perolat P editor (1999) Leptospira and Leptospirosis. 2nd ed. Melbourne, Australia: MediSci.
  15. 15. Thaipadungpanit J, Chierakul W, Wuthiekanun V, Limmathurotsakul D, Amornchai P, et al. (2011) Diagnostic accuracy of real-time PCR assays targeting 16S rRNA and lipL32 genes for human leptospirosis in Thailand: a case-control study. PLoS One 6: e16236. doi: 10.1371/journal.pone.0016236
  16. 16. Ooteman MC, Vago AR, Koury MC (2006) Evaluation of MAT, IgM ELISA and PCR methods for the diagnosis of human leptospirosis. Journal of microbiological methods 65: 247–257. doi: 10.1016/j.mimet.2005.07.015
  17. 17. McBride AJ, Santos BL, Queiroz A, Santos AC, Hartskeerl RA, et al. (2007) Evaluation of four whole-cell Leptospira-based serological tests for diagnosis of urban leptospirosis. Clin Vaccine Immunol 14: 1245–1248. doi: 10.1128/cvi.00217-07
  18. 18. Smits HL, Hartskeerl RA, Terpstra WJ (2000) International multi-centre evaluation of a dipstick assay for human leptospirosis. Tropical medicine & international health : TM & IH 5: 124–128. doi: 10.1046/j.1365-3156.2000.00525.x
  19. 19. Effler PV, Bogard AK, Domen HY, Katz AR, Higa HY, et al. (2002) Evaluation of eight rapid screening tests for acute leptospirosis in Hawaii. Journal of clinical microbiology 40: 1464–1469. doi: 10.1128/jcm.40.4.1464-1469.2002
  20. 20. Bajani MD, Ashford DA, Bragg SL, Woods CW, Aye T, et al. (2003) Evaluation of four commercially available rapid serologic tests for diagnosis of leptospirosis. Journal of clinical microbiology 41: 803–809. doi: 10.1128/jcm.41.2.803-809.2003
  21. 21. Smits HL, Eapen CK, Sugathan S, Kuriakose M, Gasem MH, et al. (2001) Lateral-flow assay for rapid serodiagnosis of human leptospirosis. Clinical and diagnostic laboratory immunology 8: 166–169. doi: 10.1128/cdli.8.1.166-169.2001
  22. 22. Brandao AP, Camargo ED, da Silva ED, Silva MV, Abrao RV (1998) Macroscopic agglutination test for rapid diagnosis of human leptospirosis. Journal of clinical microbiology 36: 3138–3142.
  23. 23. Arimitsu Y, Kmety E, Ananyina Y, Baranton G, Ferguson IR, et al. (1994) Evaluation of the one-point microcapsule agglutination test for diagnosis of leptospirosis. Bulletin of the World Health Organization 72: 395–399.
  24. 24. Hull-Jackson C, Glass MB, Ari MD, Bragg SL, Branch SL, et al. (2006) Evaluation of a commercial latex agglutination assay for serological diagnosis of leptospirosis. J Clin Microbiol 44: 1853–1855. doi: 10.1128/jcm.44.5.1853-1855.2006
  25. 25. Croda J, Ramos JG, Matsunaga J, Queiroz A, Homma A, et al. (2007) Leptospira immunoglobulin-like proteins as a serodiagnostic marker for acute leptospirosis. J Clin Microbiol 45: 1528–1534. doi: 10.1128/jcm.02344-06
  26. 26. Silva EF, Medeiros MA, McBride AJ, Matsunaga J, Esteves GS, et al. (2007) The terminal portion of leptospiral immunoglobulin-like protein LigA confers protective immunity against lethal infection in the hamster model of leptospirosis. Vaccine 25: 6277–6286. doi: 10.1016/j.vaccine.2007.05.053
  27. 27. Matsunaga J, Barocchi MA, Croda J, Young TA, Sanchez Y, et al. (2003) Pathogenic Leptospira species express surface-exposed proteins belonging to the bacterial immunoglobulin superfamily. Molecular microbiology 49: 929–945. doi: 10.1046/j.1365-2958.2003.03619.x
  28. 28. McBride AJ, Cerqueira GM, Suchard MA, Moreira AN, Zuerner RL, et al. (2009) Genetic diversity of the Leptospiral immunoglobulin-like (Lig) genes in pathogenic Leptospira spp. Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases 9: 196–205. doi: 10.1016/j.meegid.2008.10.012
  29. 29. Matsunaga J, Sanchez Y, Xu X, Haake DA (2005) Osmolarity, a key environmental signal controlling expression of leptospiral proteins LigA and LigB and the extracellular release of LigA. Infection and immunity 73: 70–78. doi: 10.1128/iai.73.1.70-78.2005
  30. 30. Matsunaga J, Medeiros MA, Sanchez Y, Werneid KF, Ko AI (2007) Osmotic regulation of expression of two extracellular matrix-binding proteins and a haemolysin of Leptospira interrogans: differential effects on LigA and Sph2 extracellular release. Microbiology 153: 3390–3398. doi: 10.1099/mic.0.2007/007948-0
  31. 31. Choy HA, Kelley MM, Chen TL, Moller AK, Matsunaga J, et al. (2007) Physiological osmotic induction of Leptospira interrogans adhesion: LigA and LigB bind extracellular matrix proteins and fibrinogen. Infection and immunity 75: 2441–2450. doi: 10.1128/iai.01635-06
  32. 32. Figueira CP, Croda J, Choy HA, Haake DA, Reis MG, et al. (2011) Heterologous expression of pathogen-specific genes ligA and ligB in the saprophyte Leptospira biflexa confers enhanced adhesion to cultured cells and fibronectin. BMC microbiology 11: 129. doi: 10.1186/1471-2180-11-129
  33. 33. Choy HA, Kelley MM, Croda J, Matsunaga J, Babbitt JT, et al. (2011) The multifunctional LigB adhesin binds homeostatic proteins with potential roles in cutaneous infection by pathogenic Leptospira interrogans. PLoS One 6: e16879. doi: 10.1371/journal.pone.0016879
  34. 34. Lin YP, McDonough SP, Sharma Y, Chang YF (2010) The terminal immunoglobulin-like repeats of LigA and LigB of Leptospira enhance their binding to gelatin binding domain of fibronectin and host cells. PLoS One 5: e11301. doi: 10.1371/journal.pone.0011301
  35. 35. Castro AR, Esfandiari J, Kumar S, Ashton M, Kikkert SE, et al. (2010) Novel point-of-care test for simultaneous detection of nontreponemal and treponemal antibodies in patients with syphilis. Journal of clinical microbiology 48: 4615–4619. doi: 10.1128/jcm.00624-10
  36. 36. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, et al. (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Ann Intern Med 138: 40–44. doi: 10.7326/0003-4819-138-1-200301070-00010
  37. 37. Ko AI, Galvao Reis M, Ribeiro Dourado CM, Johnson WD Jr, Riley LW (1999) Urban epidemic of severe leptospirosis in Brazil. Salvador Leptospirosis Study Group. Lancet 354: 820–825. doi: 10.1016/s0140-6736(99)80012-9
  38. 38. Brasil Ministério da Saúde (2010) Indicadores e Dados Básicos para a Saúde - Brasil. Brasília, Brasil: Brasil Ministério da Saúde.
  39. 39. CDC (1995) Summary of notifiable diseases, United States,1994. MMWR Morbidity and mortality weekly report 43: 1.
  40. 40. Paster BJ, Dewhirst FE (2000) Phylogenetic foundation of spirochetes. J Mol Microbiol Biotechnol 2: 341–344.
  41. 41. McBride AJ, Pereira FA, da Silva ED, de Matos RB, Ferreira AG, et al. (2007) Evaluation of the EIE-IgM-Leptospirose assay for the serodiagnosis of leptospirosis. Acta Trop 102: 206–211. doi: 10.1016/j.actatropica.2007.05.002
  42. 42. Winslow WE, Merry DJ, Pirc ML, Devine PL (1997) Evaluation of a commercial enzyme-linked immunosorbent assay for detection of immunoglobulin M antibody in diagnosis of human leptospiral infection. Journal of clinical microbiology 35: 1938–1942.
  43. 43. Steel RGD, Torrie JH, Dickey DA (1997) Principles and procedures of statistics : a biometrical approach. New York: McGraw-Hill. 666 p.
  44. 44. Abdulkader RC, Daher EF, Camargo ED, Spinosa C, da Silva MV (2002) Leptospirosis severity may be associated with the intensity of humoral immune response. Rev Inst Med Trop Sao Paulo 44: 79–83. doi: 10.1590/s0036-46652002000200005
  45. 45. Yersin C, Bovet P, Smits HL, Perolat P (1999) Field evaluation of a one-step dipstick assay for the diagnosis of human leptospirosis in the Seychelles. Tropical medicine & international health : TM & IH 4: 38–45. doi: 10.1046/j.1365-3156.1999.00352.x
  46. 46. Adler B, Faine S (1978) The antibodies involved in the human immune response to leptospiral infection. J Med Microbiol 11: 387–400. doi: 10.1099/00222615-11-4-387
  47. 47. Finsterer J, Stollberger C, Sehnal E, Stanek G (2005) Mild leptospirosis with three-year persistence of IgG- and IgM-antibodies, initially manifesting as carpal tunnel syndrome. The Journal of infection 51: E67–70. doi: 10.1016/j.jinf.2004.08.019
  48. 48. Limmathurotsakul D, Turner EL, Wuthiekanun V, Thaipadungpanit J, Suputtamongkol Y, et al. (2012) Fool's gold: why imperfect reference tests are undermining the evaluation of novel diagnostics. A re-evaluation of five diagnostic tests for leptospirosis. Clinical infectious diseases : an official publication of the Infectious Diseases Society of America doi: 10.1093/cid/cis403
  49. 49. Terpstra WJ, Ligthart GS, Schoone GJ (1985) ELISA for the detection of specific IgM and IgG in human leptospirosis. Journal of general microbiology 131: 377–385. doi: 10.1099/00221287-131-2-377
  50. 50. Pereira MM, Matsuo MG, Bauab AR, Vasconcelos SA, Moraes ZM, et al. (2000) A clonal subpopulation of Leptospira interrogans sensu stricto is the major cause of leptospirosis outbreaks in Brazil. Journal of clinical microbiology 38: 450–452.