Schistosomiasis remains a global public health challenge, with 93% of the ~237 million infections occurring in sub-Saharan Africa. Though rarely fatal, its recurring nature makes it a lifetime disorder with significant chronic health burdens. Much of its negative health impact is due to non-specific conditions such as anemia, undernutrition, pain, exercise intolerance, poor school performance, and decreased work capacity. This makes it difficult to estimate the disease burden specific to schistosomiasis using the standard DALY metric.
In our study, we used Pediatric Quality of Life Inventory (PedsQL), a modular instrument available for ages 2–18 years, to assess health-related quality of life (HrQoL) among children living in a Schistosoma haematobium-endemic area in coastal Kenya. The PedsQL questionnaires were administered by interview to children aged 5–18 years (and their parents) in five villages spread across three districts. HrQoL (total score) was significantly lower in villages with high prevalence of S. haematobium (−4.0%, p<0.001) and among the lower socioeconomic quartiles (−2.0%, p<0.05). A greater effect was seen in the psychosocial scales as compared to the physical function scale. In moderate prevalence villages, detection of any parasite eggs in the urine was associated with a significant 2.1% (p<0.05) reduction in total score. The PedsQL reliabilities were generally high (Cronbach alphas ≥0.70), floor effects were acceptable, and identification of children from low socioeconomic standing was valid.
We conclude that exposure to urogenital schistosomiasis is associated with a 2–4% reduction in HrQoL. Further research is warranted to determine the reproducibility and responsiveness properties of QoL testing in relation to schistosomiasis. We anticipate that a case definition based on more sensitive parasitological diagnosis among younger children will better define the immediate and long-term HrQoL impact of Schistosoma infection.
Because urogenital schistosomiasis is a multi-decadal chronic disease that begins in early childhood, and because it is a disease that may affect nearly everyone in endemic communities, its impact on personal health-related quality of life (HrQoL) has been difficult to gauge accurately. In order to provide a more precise estimate of schistosomiasis' impact on overall health status, we used a standardized questionnaire, the PedsQL SF15 Inventory, to interview children, aged 5–18 years, and their parents, to quantify their reported physical, social, emotional, and scholastic performance status. Scores were significantly lower in villages having high Schistosoma prevalence, as compared those having moderate prevalence. In adjusting for age, sex, socioeconomic standing, undernutrition, anemia, and hookworm parasites, we found that relative poverty, stunting, wasting, and S. haematobium infection were significant correlates of HrQoL scores, with differential effects in high- and moderate-prevalence communities. The greatest differences were noted in the psychosocial domains of performance. We conclude that exposure to urogenital schistosomiasis has an overall detrimental effect on HrQoL at a level of 2–4% impairment. New implementation of better diagnostics for children is expected to refine our estimates of this association, as will follow-up studies of HrQoL following effective individual and community deworming.
Citation: Terer CC, Bustinduy AL, Magtanong RV, Muhoho N, Mungai PL, et al. (2013) Evaluation of the Health-related Quality of Life of Children in Schistosoma haematobium-endemic Communities in Kenya: A Cross-sectional Study. PLoS Negl Trop Dis 7(3): e2106. doi:10.1371/journal.pntd.0002106
Editor: Amadou Garba, Ministère de la Santé Publique et de la Lutte contre les Endémies, Niger
Received: August 10, 2012; Accepted: January 29, 2013; Published: March 7, 2013
Copyright: © 2013 Terer et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by National Institutes of Health Research Grant R01TW008067 funded by the Ecology of Infectious Diseases Program of the Fogarty International Center. Funding support was also provided to ALB through an NIH T32 Ruth L. Kirschstein-National Service Research Award-Training Grant. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Schistosomiasis remains a public challenge globally with 93% of the estimated 237 million infections occurring in Africa . Its transmission is mainly influenced by exposures to environmental factors (contact with infested water, distance to infected water bodies), individual characteristics (treatment history, sex, and age) and socioeconomic factors (occupation and education) –. Schistosomiasis is rarely fatal but due to its recurring nature is manifested as a persistent chronic disorder in endemic areas, resulting in significant health burden –. It is estimated that people living in Schistosoma -endemic areas carry the infection one-third to one-half of their lives , yet they may only rarely exhibit the advanced morbidities that are classically associated with schistosomiasis, such as advanced hepatic fibrosis with portal hypertension (for S. mansoni), or bladder and kidney deformity, bladder cancer, or infertility (for S. haematobium) . In reality, much of the negative health impact is due to less obvious or specific conditions such as anemia, undernutrition, abdominal pain, exercise intolerance, poor school performance, and lowered work capacity , , . The non-specificity of chronic infection symptoms, manifested as these subtle morbidities, makes it difficult to accurately estimate the specific disease burden due to schistosomiasis. As pointed out by King and Bertino , the present disability-adjusted life year (DALY) system of the World Bank and the World Health Organization (WHO)  not only ignores these morbidities, but also disregards the pervasiveness of co-morbidities, including polyparasitism, in Schistosoma-endemic areas.
While the debate on DALY estimates of disease burden persists, attention is turning to the use of patient-reported outcomes, such as health-related quality of life (HrQoL) , , , . Use of quality of life (QoL) assessment tools in evaluating schistosomiasis and other neglected tropical disease (NTD) burden is gaining greater standing –. Quality of Life is defined as an individual's perception of one's position in life in the context of culture and value systems, as well as in relation to one's goals, expectations, standards and concerns . The World Health Organization defines health as being “not only the absence of disease and infirmity but also the presence of physical, mental, and social well-being” . HrQoL therefore refers to the physical, psychological, and social scales of health seen in functional areas influenced by a person's experiences, beliefs, expectations, and perceptions. Measuring HrQoL is an important outcomes indicator in evaluating health-care interventions and treatments, in understanding the burden of disease, in identifying health inequalities, in allocating health resources, and in epidemiological studies and health surveys . Unlike in other chronic conditions such cancer and sickle cell disease where HrQoL tools have been widely used, for NTDs these tools have only been used to assess the burden of advanced schistosomiasis (using EQ-5D plus or WHO QoL-bref questionnaires) , , , soil-transmitted helminthes (using both EQ-5D and SF-12) , and echinococcosis (using SF-12) , and to assess the burden of polyparasitism in Cote d'Ivoire (using SF-36v2 questionnaire but only the physical scale) . SF-12 has also been used to describe the impact of acute schistosomiasis on quality of life in a group of travelers returning from a luxury safari trip in Tanzania . Results of most of these studies suggest that the burden of schistosomiasis has been consistently underestimated , , . Moreover, in two of these studies by Jia and colleagues, by only targeting people with chronic schistosomiasis  or advanced schistosomiasis  it was not possible to contrast HrQoL findings among schistosomiasis patients to people living in same localities without schistosomiasis. Additionally all these studies used QoL tools that do not capture the changes in QoL that occur in different developmental stages of children, the most important epidemiological demographic for active Schistosoma infection .
The choice of the HrQoL tool depends mainly on the purpose (the health conditions being investigated) and the target population (the general population, adults only or children only) , . Measurement of HrQoL in children is particularly difficult because of the need for different instruments in different age groups, and the need for instruments that accommodate the different cultures. Two types of HrQoL measures have been developed, generic and condition-specific instruments. Generic or non-categorical instruments typically include global or summary ratings of multiple scales or health profile approaches. In contrast, condition-specific measures of HrQoL address the challenges associated with a particular illness, such as cancer. Since our target population in this study was children aged 5–18 years, we decided to use the Pediatric Quality of Life Inventory (PedsQL). PedsQL is available in two generic instruments; one that comprises 23 items (PedsQL) with forms for adult (over 26 years), young adult (18–25 years), adolescent (13–18 years), child (8–12 years), young child (5–7 years) and toddler (2–4 years) and a shorter instrument with 15 items (PedsQL 4.0 SF15) which has forms for adolescent, child, young child, and toddler. Furthermore, there are PedsQL disease-specific modules including modules for arthritis, asthma, cerebral palsy, cardiac, diabetes, family impact, family information, oral health and transplant among others (http://www.pedsql.org/ ). The validity and reliability of the instrument have been confirmed as a population health measurement tool and in different child populations with chronic illnesses in descriptive and evaluative studies –. The PedsQL has been used in children with different debilitating conditions such as those associated with asthma, transplant recipients, attention-deficit hyperactivity disorder (ADHD) and neuromuscular disorders –.
The present study evaluated health related quality of life (HrQoL) in children living in a S. haematobium endemic area in coastal Kenya, and determined the utility of the pediatric quality of life inventory short form (PedsQL 4.0 SF15) in assessing HrQoL. Additionally, we determined the impact of local transmission features and socioeconomic standing, which are considered potentially important modifiers of S. haematobium–related disease burden.
Ethics statement and eligibility criteria
Ethical clearance was obtained by the Institutional Review Board at the University Hospital Case Medical Center of Cleveland and the Ethical Review Committee of the Kenya Medical Research Institute (KEMRI). Children were eligible if they were residents of the area for at least two years, were between 5–18 years old, and had provided child assent and written parental consent.
Study area and population
The study population comprised children aged 5–18 years old. who participated in both parasitological and nutritional studies in the five selected endemic rural villages (Milalani, Magadzoni, Gwadu, Dzitenge and Kinango A) in the three districts (Msambweni, Kinango, and Kwale) of Kwale County in Coast Province, Kenya , – (Figure 1). This sub-study was embedded in a larger study of the ecology of transmission of vector-borne parasitic infections (the ‘Polyparasitism Project’). This project enrolled participants through house-to-house demographic surveys in May–June 2009 for Milalani and in June, July, August and August–September 2010 for Gwadu, Dzitenge, Kinango A, and Magadzoni, respectively. Parasitological testing and anthropometric measurements were conducted simultaneously in July–August 2009 for Milalani, in October–November 2010 for Gwadu, Dzitenge, and Kinango A, and in April–May 2011 for Magadzoni. Treatment for any parasite infections detected during survey testing was provided immediately after the completion of each village survey. Due to logistical constraints, the PedsQL 4.0 SF15 questionnaires (see below) were administered at varying (3–16 month) intervals afterwards: in December 2010 for Milalani, in April–May 2011 for Gwadu, Dzitenge, and Kinango A, and in July 2011 for Magadzoni.
Figure 1. Map of the study area showing location of study villages in Coast Province, Kenya.doi:10.1371/journal.pntd.0002106.g001
The numbers of participants per village at enrolment, at parasitological testing/anthropometric assessment, and at HrQoL assessment are detailed in Figure 2. All children with full parasitological and anthropometric results were eligible for inclusion in the study. For Milalani and Magadzoni villages, we randomly selected 92 children who had been S. haematobium egg-positive and 91 who had been S. haematobium egg-negative in each community for PedsQL 4.0 SF15 tool administration. For the other villages, we targeted all eligible children, irrespective of their initial egg-output status, for PedsQL 4.0 SF15 administration.
Figure 2. Flow chart of study participation.
Numbers of children by village at enrolment, at parasitological and anthropometric testing, and at HrQoL assessment.doi:10.1371/journal.pntd.0002106.g002
Subjects submitted one midday sample for examination for S. haematobium infection. Ten-milliliter aliquots from well-mixed urine samples were subjected to standard Nucleopore filtration . A single stool examination by Kato-Katz method  was used to identify infection by hookworm and other soil-transmitted helminths. All children included in this analysis provided finger prick blood for hemoglobin (Hb) measurement (Hemocue, Ängelholm, Sweden) . Anemia was categorized according to WHO criteria by age and sex – for ages <12 years, Hb<11.5 g/dL; for ages ≥12 years, Hb<12 g/dL; but for males ≥15 years, Hb<13 g/dL.
Our standardization and measurement procedures used for anthropometric assessments have been detailed elsewhere (Bustinduy, et al., ). The nutritional indicators; height-for-age (HAZ) and body-mass index (BMI)-for-age (BAZ) were computed using the World Health Organization's Anthro-Plus software for ages 5–19 years (WHO, Geneva, Switzerland) based on reference growth standards from the year 2006 , . Stunting and wasting were defined for values≤−2 for HAZ and BAZ, respectively, according to WHO standards .
The PedsQL 4.0 SF 15 used in this study includes parallel child self-reports (age range 5–18 years) and parent proxy-reports. It differs from PedsQL 4.0 generic core scales instrument by the number of items in the total scale and in the various subscales. The PedsQL 4.0 SF15 consists of 5, 4, 3, and 3 for physical, emotional, social and school functioning respectively, making a total scale of 15 items whereas the PedsQL 4.0 generic core scale comprises of 8, 5, 5, and 5 for physical, emotional, social and school functioning, respectively, for a total of 23 items. Details are available at http://www.pedsql.org/about_pedsql.html.
The survey's preliminary instructions indicate to the subject that survey questions ask how much of a problem each item has been during the past one month. A five-point Likert-like response scale is used. The response scale for each item was “never” (0), “almost never” (1), “sometimes” (2), “often” (3), and “almost always” (4). Responses were transformed to 100, 75, 50, 25, and 0, respectively, resulting in a scale range of 0–100, with the higher number scores indicating better HrQoL.
Overall scores and sub-scale scores were computed as the sum of the items divided by the number of items answered (this accounts for missing data). If more than 50% of the items in the scale were missing, the scale score was not computed . Two summaries and one overall score were computed. Of note, the physical health summary score (5 items) is the same as the physical functioning subscale. The psychosocial health summary score (10 items) is computed as the sum of items divided by the number of items answered in the emotional, social, and school functioning subscales. Total Scale Scores for child self-report and parent proxy-report are also presented.
In preparation for the study, two forward translations (English-Swahili) and one backward translation (Swahili-English) translations were done for the PedsQL 4.0 SF15. The approved final Swahili translations of the PedsQL 4.0 SF15 were first pre-tested on 23 young children (5–7 years old), 39 children (8–12 years old) and 36 teens and their parents from a neighboring village. These were all non-participants in the present study but similar to those included in this study. The illiteracy levels in the study area were estimated at about 60% and thus the PedsQL 4.0 SF15 instrument was interview administered ,  for both children and their parents. All the PedsQL 4.0 SF15 questionnaires in this study were administered by two well-trained research assistants who were native speakers of Swahili, under the supervision of the first author.
Biological, demographic, parasitological, anthropometric and socioeconomic data.
Statistical analyses were conducted using both SPSS for Windows, version 19.0 (SPSS, Inc., Chicago, IL) and SAS for Windows, version 9 (SAS Institute Inc., Cary, North Carolina). For estimation of socioeconomic standing (SES) we used housing conditions and household ownership of selected assets to construct an asset index based on principal component analysis (PCA) . Participating households were divided into two equal sized groups (low and higher socioeconomic standing) according to their scores from the principal components analysis. The assets included in the PCA were radio, bicycle, television, telephone, and land. Other indicators of SES included available household source(s) of cooking fuel, lighting, and drinking water, type of latrine owned and its distance from the house, and level of education of the household head.
Chi-square tests were used to test for differences in proportions, and the Mann-Whitney U test was used to assess differences in intensities of infection, age, and Hb. Analysis of variance (ANOVA) was used to compare infection intensity among villages.
Analysis of HrQoL data
Feasibility of the PedsQL 4.0 SF15 generic version was determined from the average percentage of missing responses. The percentage of all possible item responses left unanswered was calculated for each subject on each single and summary scale and averaged over subjects.
Utility of the instruments in terms of distributional coverage overall and by subscale was evaluated by calculating the percentage of subscale-level average responses reaching the minimum (floor) or the maximum (ceiling) of the scoring scale. In QoL studies, floor and ceilings effects are used to evaluate the depth of a health problem being measured. If floor effects exist, it means the QoL tool is showing a lower than actual HrQoL, and if ceiling effects exist, QoL tools may be underestimating QoL or the magnitude of the problem being measured. Studies with small floor or ceiling effects (1–15%) are considered to meet acceptable measurement standards, whereas studies with moderate floor or ceiling effects (>15%) are considered less precise in measuring latent constructs at the extremes of the scale , .
Internal consistency is a measure of the extent to which items in a questionnaire (subscale or scale) are correlated (homogeneous), thus measuring the same concept. It is an important measurement property for questionnaires that intend to measure a single underlying concept (construct) by using multiple items such as PedsQL questionnaire. Cronbach's alpha coefficient was utilized to determine scale internal consistency reliability . Scales with reliabilities of 0.70 or greater are recommended for comparing patient groups, while a reliability criterion of 0.90 is recommended for analyzing individual patient scores . A low Cronbach's alpha indicates a lack of correlation between the items in a scale, which makes summarizing the items unjustified. A very high Cronbach's alpha (>0.95) indicates high correlations among the items in the scale, i.e., redundancy of one or more items . Construct validity was determined utilizing the known-groups method, which compares scale scores across groups known to differ in the health construct being investigated. In our study the known groups are the children who tested positive and negative for S. haematobium egg output, who will henceforth be referred to as ‘Sh egg-positive’ and ‘Sh egg-negative’, respectively. Known groups validity was examined through a comparison of these egg-positive and egg-negative groups, of children from families of lower versus higher SES, of stunted versus non-stunted children, and those from high prevalence (high risk) villages versus moderate prevalence (lower risk) villages, using independent t-tests.
To complement statistical testing, effect sizes are presented to assist in the interpretation of the relative degree of between-group score differences by indexing these differences to within-group score variation , with lesser import if the between-group score difference is small relative to the within-group variation in scores. Effect size utilized in these analyses was calculated by taking the difference between the score means for either cases vs. controls, stunted vs. non-stunted children, children from low SES vs. high SES, or children from high-risk vs. moderate risk villages, divided by the pooled standard deviation of the egg-negative/high SES/not stunted/lower-risk village categories, as appropriate . Effect sizes for differences in means are designated as small (0.20–0.49), medium (0.50–0.79), and large (≥0.80) in magnitude . Agreement between child self-report and parent proxy-report was determined through 2-way mixed-effect model (absolute agreement, single measure) intraclass correlations . Intraclass correlation results are generally interpreted as follows: ≤0.40, poor to fair agreement; 0.41–0.60, moderate agreement; 0.61–0.80, good agreement; and 0.81–1.00, excellent agreement .
Multivariable modeling of HrQoL outcomes
Following our observation of significant differences in group-wise mean HrQoL scores in the analyses described above, our next objective was to determine the independent contributions of age, sex, village risk for schistosomiasis (high vs. moderate), S. haematobium infection, hookworm infection, anemia, SES, stunting, and wasting in nested models of HrQoL outcomes, for both total and psychosocial sub-scale scores. To do this, we used generalized multivariable linear modeling, adjusted for covariance at the village level using generalized estimating equation (GEE) technique (SPSS). Stepwise backward removal of non-significant variables was used to create ‘best fit’ parsimonious models based on Akaike information criteria (AIC) retaining explanatory variables with P-values<0.1. Significant multiply-adjusted parameter estimates are reported (with 95% CI and corresponding p-values) for covariates remaining in the final models.
Study group characteristics
In total, 1580 children, aged 5–18 years old, from five villages participated in parasitological and anthropometric testing. Their mean age was 10.6±3.5 and 51% were female. The majority of the children in Milalani, Magadzoni, and Gwadu (the more rural villages) came from families of low SES while most children in Kinango A and Dzitenge (the more urban villages) came from families of higher SES (Table 1, Figure 1).
Table 1. Population demographic, anthropometric, and socioeconomic features, and distribution of S. haematobium egg positivity by village.doi:10.1371/journal.pntd.0002106.t001
The overall S. haematobium infection prevalence was 42.2% (766/1580), similar for males and females, but significantly different by village (Table 1) and by age group (Table 2). School-age infection prevalence was significantly greater in Milalani, and Gwadu villages (here referred to as high-prevalence villages, according to WHO guidelines ) compared to Magadzoni, Dzitenge, and Kinango A villages (here referred to as moderate prevalence villages). S. haematobium infection intensity was highest in 8–12 year olds and lowest in 5–7 year olds (P<0.01, Table 2), and varied significantly by village (Table 1) with an overall geometric mean intensity of infection of 37.8 eggs/10 mL of urine. Males had significantly heavier infection than females (P<0.02). There were also significant inter-village and across-age group differences in the proportion of anemic children and in mean Hb levels (Tables 1 and 2).
Table 2. Characteristics of the study population by age group.doi:10.1371/journal.pntd.0002106.t002
Many study children had either acute undernutrition, as measured by wasting (BAZ score ≤−2), chronic undernutrition, as measured by stunting prevalence (HAZ score ≤−2), or both. The highest malnutrition levels were recorded in villages closer to the coastline (Milalani, Magadzoni, and Gwadu) compared to the more inland villages (Dzitenge and Kinango A) (Table 1). Wasting and stunting were lowest in the 5–7 year age group compared to older age groups (Table 2). Significantly more males were stunted (56% vs. 44%, Χ2 = 9.2, P<0.01) or wasted (60% vs. 40%%, Χ2 = 14.8, P<0.001) as compared to females.
The PedsQL SF15 tool was administered to 835 children and 800 of their parents. Overall, missing responses were found for 33 children (4.0%) and 35 parents (4.4%), yielding 802 and 765 children and parents with complete HrQoL data, respectively (Table 3). The distribution of 802 children who had complete HrQoL data by village and age groups is shown in Figure 2.
Table 3. Feasibility and utility of PedsQL SF15 for children initially S. haematobium egg-positive or egg-negativea.doi:10.1371/journal.pntd.0002106.t003
Table 3 shows the missing responses, and the floor and ceiling effects noted in the PedsQL 4.0 SF15 administration in our study area. Missing values were found in both child self-report (range: 0.0–5.4%) and parent proxy-reports (range: 0.2–4.4%). The school function scale had the highest missing values for both self and parent proxy-reports (Table 3). Floor effects were found in both self and parent-proxy reports (range: 0.0–1.3). Influential ceiling effects (i.e., >15%) were found in the physical, social, and school function scales in self report, with highest values noted for the school function scale. Relevant ceiling effects were found in all scales in the parent proxy report except for the total scores (Table 3).
Internal consistency of the questionnaire.
The internal consistency/reliability alpha coefficients are presented for the PedsQL SF15 in Table 4. All the parent proxy-report scales exceeded the minimum internal consistency reliability standard (0.70) required for group comparisons for all ages. In child self-reports, reliability coefficients for most PedsQL SF15 scales approached or exceeded the recommended standard of 0.70 for group comparison (Table 4).
Table 4. Internal consistency reliability in self-report and parent proxy-report– Cronbach alpha statisticsa within different survey domains.doi:10.1371/journal.pntd.0002106.t004
Table 5 presents the intraclass correlations (ICCs) between child self-reports and parent proxy-reports of the PedsQL SF15 scales. Fair to good agreement was found in the generic core scales of both the S. haematobium egg-positive and egg-negative (control) groups. ICCs were generally higher in the control group. Lower correlation values were obtained in the social function scales across all age groups, and in the physical scale in 5–7 year olds. Children and their parent proxies consistently showed good to excellent agreement for school and psychosocial scales across all age groups.
Table 5. Agreement between self-report and parent proxy-report PedsQL SF15 score scales.doi:10.1371/journal.pntd.0002106.t005
HrQoL outcomes according to location, infection status, SES, and known morbidities.
To assess the impact of exposure to urogenital schistosomiasis, we examined differences in observed PedsQL SF15 outcomes on several levels—high-prevalence vs. moderate-prevalence villages, S. haematobium egg-positive vs. egg-negative individuals, and according to cofactors likely to influence HrQoL (presence or absence of lower SES, anemia, or undernutrition). The most striking finding was the significantly higher HrQoL scores reported by both children and parent residing in moderate risk villages as compared to those from high risk villages (Figure 3). Furthermore, within the moderate risk villages, when comparing PedsQL SF15 scores, egg-negative children had significantly higher HrQoL in all scales except physical and school scales (for both child-self and parent-proxy reports), with effect sizes mostly in the medium range (Table 6). Of note, the PedsQL SF15 egg-positive vs. egg-negative score differences within the high risk villages were small and not significant, and mostly in the opposite direction for most scales (Table 6).
Figure 3. PedsQL SF15 score scales contrasting high and moderate risk villages for self and proxy reports.
Abbreviations: Phy-Physical; Emo-Emotional; Soc-Social; Sch-School; Psy-Psychosocial, Tot-Total. NS-Not significant; **P<0.001; ***P<0.0001.doi:10.1371/journal.pntd.0002106.g003
Table 6. PedsQL SF15 score scales for children and parents within high and moderate prevalence villages.doi:10.1371/journal.pntd.0002106.t006
For all PedsQL SF15 scales (except physical functioning in parent proxy-report) children who tested negative for S. haematobium egg output and their parents reported better HrQoL than those who tested egg-positive during parasitological examination (Table 7). However, for the overall combined village data, where the largest effect size observed for the social subscale (0.21), none of these group-wise differences in child self-report was statistically significant. Parents of egg-negative children reported better HrQoL scores for their children compared to parents of egg-positive cases for all subscales, except in the physical subscales. These parental HrQoL scores were only statistically different for the social scale, and effect sizes were generally of small magnitude.
Table 7. PedsQL SF15 scores for study participants stratified according to S. haematobium egg-positive vs. egg-negative status.doi:10.1371/journal.pntd.0002106.t007
For stunting, all scales reported lower quality of life in stunted children, with significant differences in psychosocial and total scales in self-reports, and in the school functioning scale in the proxy-report (see Supporting Information, Table S1). In both child self and parent proxy reports, lower SES was significantly associated with lower HrQoL in all scales except the physical functioning, with effect sizes mostly in medium to high range (see Supporting Information, Table S2). Within the low SES group, when comparisons were made between egg-positive and egg-negative children, egg-positives reported lower HrQoL compared to controls. However, when similar comparisons were made within the higher SES group, the differences were very small and inconsistent, with some scales reporting higher HrQoL among egg-positive children (data not shown).
Given the group-wise differences observed above, we next used a Generalized Estimating Equation (GEE) multivariable analysis to account for possible confounding and/or effect modification of score outcomes caused by varied distribution of subject classes across villages and infection status groups. As noted in Tables 8 and 9, HrQoL total scores and psychosocial sub-scores were significantly lower in high-prevalence villages, even with adjustment for SES, sex, and/or age. Not shown, hookworm infection or intensity did not have a significant effect on Peds QL scores when adjusted for other factors in the model. Variable interaction terms for village type were highly significant, leading to a stratified village type analysis also presented in Tables 8 and 9. In high-prevalence villages, lower SES, and stunting were significantly associated with lower total and psychosocial scores, whereas wasting and S. haematobium egg-positivity were associated with higher scores. In moderate-prevalence villages, S. haematobium egg positivity was the sole significant correlate of total HrQoL score, reducing it by an estimated 2.1%. For the psychosocial sub-scale, egg-positivity contributed on a similar level (−2.4%) to a lower score, while being in the 8–12 year old age group was associated with a significantly slightly better score (+0.8%).
Table 8. Multivariable GEE modeling of self-reported total HrQoL scores adjusting for measured covariatesa.doi:10.1371/journal.pntd.0002106.t008
This is a first attempt to measure self-rated multidimensional HrQoL related to urogenital schistosomiasis in children. In our initial analysis, we observed a clear trend toward lower HrQoL in all measurement scales (except physical scale) among children with S. haematobium egg-positive status, but the differences were not significant. This trend was confirmed in parent-proxy reports, which indicated the same trend in all performance scales, and for the social scale, parents of egg-positive children did report significantly lower HrQoL scores than parents of egg-negative children. Significant differences were observed in other group-wise analysis, indicating lower HrQoL for children resident in high-S. haematobium prevalence villages as compared to those living in moderate-prevalence villages, and significantly lower HrQoL for children with growth stunting.
Previous investigations described strong associations between growth stunting and low intensity Schistosoma infections , –; thus the joint association of lower HrQoL with local prevalence and stunting was an expected finding. Our results are in contrast to recent studies of other NTDs that suggest no clear differences in HrQoL between infected and non-infected health states , . Increasing severity of intestinal schistosomiasis, whether caused by S. japonicum in P.R. China ,  or by S. mansoni in Egypt , has been associated with significantly greater reductions in self-reported quality of life scores. It is possible that inclusion of a larger range of age-groups, and patients with more advanced complications of S. haematobium would have resulted in more pronounced differences in our observed outcomes. We found significant associations between either i) lower socio-economic status, or ii) residence in high risk villages, with lower PedsQL 4.0 SF15 scores across all scales, except for physical and school functional scales. Socio-economic status is known to affect the risk of Schistosoma infection by either limiting water-use options and/or access to health care, or through other poverty-related factors , , , .
In our study, the initial lack of significant differences in HrQoL between children with and without egg output could be attributed to confounding by the distribution of low SES and undernutrition across the village levels. Our multivariable analysis indicated a strong village-type effect (with high-prevalence status having significantly lower HrQoL scores), but with significant interaction between village type and all other covariates tested. A further stratified analysis indicated that S. haematobium egg positivity was significantly associated with reduced HrQoL in moderate prevalence villages, whereas in high-prevalence villages, it was associated with higher HrQoL. This difference is likely to reflect issues with the imperfect sensitivity of our standard parasitological diagnosis of urogenital schistosomiasis (urine egg output ), and covariation between age- and SES-related infection risk. In addition, for schistosomiasis and other neglected tropical diseases, the time from the onset of active infection to the onset of clinical disease may be protracted. Also, a single urine exam may miss 20–30% of active infections that would be found by repeated urine exams . Serological testing indicates that among children in high-prevalence villages, active or recent Schistosoma infection prevalence is close to 100% . Light intensity infections are more easily missed in parasitological testing. However, these can still result in significant inflammation-mediated morbidity. We believe that in high-prevalence villages, infection status is already saturated, so that egg-positivity reflects mainly those with heavier infections. In the high-prevalence setting, this sub-group includes older children with greater mobility , who may therefore have better scores on the PedsQL scales. In moderate prevalence villages, where egg testing is more likely to reliably distinguish infected and uninfected children, S. haematobium egg-positivity was significantly associated with lower HrQoL scores. Overall, uncertainty (negative study bias) about the status of egg-negative controls may explain why we observed significant ‘infection-related’ differences in moderate-risk villages but not in high-risk villages. Finally, because PedsQL 4.0 SF15 questionnaire administration was not administered at the same time as the parasitological assessment, some of the ‘controls’ identified during parasitological assessment may have turned into ‘cases’ (i.e., those who were now or formerly S. haematobium infected) by the time HrQoL assessment was done. Because treatment was given before administration of the Peds QL survey, acute impacts of active infection may have gone missed, and these may have had an impact on our study findings. We recommend that similar studies in future carry both assessments concurrently, and include supplemental serologies (circulating antigen testing, anti-Schistosoma IgG4), in order to minimize the misidentification of the true infection status of ‘cases’ and ‘controls’.
The mode of administration of the PedsQL 4.0 SF15 questionnaire was interviewer-based; thus, the high response rate was not surprising. However, it may have contributed to the lack clear differences between the cases and controls, because interviewer-based modes of questionnaire administration suffer from a well- recognized problem of limited willingness to acknowledge a problem . Since all interviews across all villages were conducted by two trained research assistants using one-to-one administration, we believe the interviewer effect was not significant. For the study children, inclusion of a parent-proxy survey, in addition to the direct patient survey, was considered to add external evidence of the validity of the answers we obtained from the children.
Floor effects were largely absent in the study population, except in the school scale where negligible (<1.3%) floor effects were observed, especially among controls. On the other hand, substantial ceiling effects were evident in almost all scales, and were more prominent in physical and school scales particularly among controls (Sh egg - negative). This means that the PedsQL 4.0 SF15 questionnaire likely underestimated HrQoL, especially for children who tested negative for S. haematobium egg output. While ceiling effects are a common phenomenon, they restrict the ability of the HrQoL tool to detect change or describe health above the average in more healthy populations , –
We consider the PedsQL to be a suitable tool for assessing quality of life in children with schistosomiasis. There is evidence that its reliabilities were high (alphas generally ≥0.70), floor effects were acceptable and identification of children from both low SES and ‘high risk’ villages was valid. PedsQL 4.0 SF15 was an effective tool for measuring quality of life in children living in schistosomiasis- (and likely other neglected tropical disease-) endemic areas. The clear capability of PedsQL 4.0 SF15 tool to identify geographical areas with different transmission intensities and SES groups is particularly important in schistosomiasis control. In large scale schistosomiasis control programs, its practicability (administered within 5 minutes) means it can appropriately be used to rapidly tease out high transmission localities for further adjustment. However, further research is needed, especially on its reproducibility and responsiveness (ability to detect clinically important changes over time) in relation to schistosomiasis. The difficulties in measuring physical and school health illustrated here also point to the need for further research and the development of a schistosomiasis specific PedsQL tool to enhance assessment of Schistosoma infection-related health impact.
PedsQL SF15 score scales for stunted children and non-stunted children.
PedsQL SF15 score scales for children from lower and higher socioeconomic standing.
The authors want to specially acknowledge our energetic field workers, Omar Kallam, Joyce Bongo, Phyllis Mutemi, and Nancy Halloway, for their dedication and meticulous anthropometric measurements. We also thank the many DVBND laboratory technicians who provided the parasitology results. We warmly thank the many children and parents of Milalani, Magadzoni, Gwadu, Dzitenge and Kinango who willingly participated in the study.
Conceived and designed the experiments: CCT ALB RVM UK CHK. Performed the experiments: CCT ALB RVM FMM. Analyzed the data: CCT UK CHK FMM. Contributed reagents/materials/analysis tools: CCT ALM RVM NM PLM EMM UK CHK FMM. Wrote the paper: CCT ALB RVM EMM UK CHK FMM.
- 1. WHO (2012) Schistosomiasis: population requiring preventive chemotherapy and number of people treated in 2010. Weekly Epidemiological Record 87: 37–44.
- 2. El-Khoby T, Galal N, Fenwick A, Barakat R, El-Hawey A, et al. (2000) The epidemiology of schistosomiasis in Egypt: summary findings in nine governorates. American Journal of Tropical Medicine and Hygiene 62: 88–99.
- 3. Kapito-Tembo AP, Mwapasa V, Meshnick SR, Samanyika Y, Banda D, et al. (2009) Prevalence distribution and risk factors for Schistosoma hematobium infection among school children in Blantyre, Malawi. PloS Neglected Tropical Diseases 3: e361. doi: 10.1371/journal.pntd.0000361
- 4. Matthys B, Tschannen AB, Tian-Bi NT, Comoe H, Diabate S, et al. (2007) Risk factors for Schistosoma mansoni and hookworm in urban farming communities in western Cote d'Ivoire. Tropical Medicine and International Health 12: 709–723. doi: 10.1111/j.1365-3156.2007.01841.x
- 5. Satayathum SA, Muchiri EM, Ouma JH, Whalen CC, King CH (2006) Factors affecting infection or reinfection with Schistosoma haematobium in coastal Kenya: Survival analysis during a nine-year, school-based treatment program. American Journal of Tropical Medicine and Hygiene 75: 83–92.
- 6. King CH, Dangerfield-Cha M (2008) The unacknowledged impact of chronic schistosomiasis. Chronic Illness 4: 65–79. doi: 10.1177/1742395307084407
- 7. King CH, Dickman K, Tisch DJ (2005) Reassessment of the cost of chronic helmintic infection: a meta-analysis of disability-related outcomes in endemic schistosomiasis. Lancet 365: 1561–1569. doi: 10.1016/S0140-6736(05)66457-4
- 8. King CH, Sturrock RF, Kariuki HC, Hamburger J (2006) Transmission control for schistosomiasis—why it matters now. Trends in Parasitology 22: 575–582. doi: 10.1016/j.pt.2006.09.006
- 9. King CH, Olbrych SK, Soon M, Singer ME, Carter J, et al. (2011) Utility of repeated praziquantel dosing in the treatment of schistosomiasis in high-risk communities in Africa: a systematic review. PLoS Negl Trop Dis 5: e1321. doi: 10.1371/journal.pntd.0001321
- 10. Bustinduy AL, Thomas CL, Fiutem JJ, Parraga I, Mungai P, et al. (2011) Measuring fitness of Kenyan children with polyparasitic infections using the 20-Meter Shuttle Run Test as a morbidity metric. PloS Neglected Tropical Diseases 5: e1213. doi: 10.1371/journal.pntd.0001213
- 11. King CH, Bertino A-M (2008) Asymmetries of poverty: why global burden of disease valuations significantly underestimate the burden of neglected tropical diseases. PloS Neglected Tropical Diseases 2: e209. doi: 10.1371/journal.pntd.0000209
- 12. Murray CJL, Lopez AD (1996) The Global Burden of Disease: A Comprehensive Assessment of Mortality and Disability from Diseases, Injuries, and Risk Factors in 1990 and Projected to 2020. Cambridge MA: Harvard School of Public Health/World Bank. 990 p.
- 13. Jia T-W, Zhou X-N, Wang X-H, Utzinger J, Steinmann P, et al. (2007) Assessment of the age-specific disability weight of chronic schistosomiasis japonica. Bulletin of the World Health Organization 85: 458–465. doi: 10.2471/BLT.06.033035
- 14. Fürst T, Müller I, Coulibaly JT, Yao AK, Utzinger J, et al. (2011) Questionnaire-based approach to assess schoolchildren's physical fitness and its potential role in exploring the putative impact of helminth and Plasmodium spp. infections in Côte d'Ivoire. Parasites and Vectors 4: 116. doi: 10.1186/1756-3305-4-116
- 15. Jia T-W, Utzinger J, Deng Y, Yang K, Li Y-Y, et al. (2011) Quantifying quality of life and disability of patients with advanced schistosomiasis japonica. PloS Neglected Tropical Diseases 5: e966. doi: 10.1371/journal.pntd.0000966
- 16. Ziegelbauer K, Steinmann P, Zhou H, Du Z-W, Jiang J-Y, et al. (2010) Self-rated quality of life and school performance in relation to helminth infections: case study from Yunnan, People's Republic of China. Parasites and Vectors 3: 61. doi: 10.1186/1756-3305-3-61
- 17. WHOQOL Group (1995) The World Health Organization Quality of Life Assessment (WHOQOL). Position paper from the Word Health Organization. Social Science and Medicine 41: 1403–1409. doi: 10.1016/0277-9536(95)00112-K
- 18. WHO (1946) WHO definition of Health. Preamble to the Constitution of the World Health Organization. In: International Health Conference NY, 19–22 June, 1946, editor: Official Records of the World Health Organization.
- 19. Eiser C, Morse R (2001) Quality-of-life measures in chronic diseases of childhood. Health Technology Assessment 5: 1–157.
- 20. Kamel MI, Ghafar YA, Foda N, Khashab S (2001) Impact of type and stage of schistosomiasis on quality of life and productivity of infected workers. J Egypt Soc Parasitol 31: 153–167.
- 21. Budke CM, Jiamin Q, Zinsstag J, Qian W, Torgerson PR (2004) Use of disability adjusted life years in the estimation of the disease burden of echinococcosis for a high endemic region of the Tibetan plateau. American Journal of Tropical Medicine and Hygiene 71: 56–64.
- 22. Leshem E, Maor Y, Meltzer E, Assous M, Schwartz E (2008) Acute schistosomiasis outbreak: Clinical features and economic impact. Clinical Infectious Diseases 47: 1499–1506. doi: 10.1086/593191
- 23. Verani JR, Abudho B, Montgomery SP, Mwinzi PN, Shane HL, et al. (2011) Schistosomiasis among young children in Usoma, Kenya. American Journal of Tropical Medicine and Hygiene 84: 787–791. doi: 10.4269/ajtmh.2011.10-0685
- 24. Guyatt GH, Feeny DH, Patrick DL (1993) Measuring health-related quality of life. Annals of Internal Medicine 118: 622–629. doi: 10.7326/0003-4819-118-8-199304150-00009
- 25. Terwee CB, Bot SD, de Boer MR, van der Windt DAWM, Knol DL, et al. (2007) Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology 60: 34–42. doi: 10.1016/j.jclinepi.2006.03.012
- 26. Varni JW, Seid M, Rode CA (1999) The PedsQL™: Measurement model for the Pediatric Quality of Life Inventory. Medical Care 37: 126–139. doi: 10.1097/00005650-199902000-00003
- 27. Varni JW, Seid M, Kurtin PS (2001) PedsQL™ 4.0: Reliability and validity of the Pediatric Quality of Life Inventory™ version 4.0 generic core scales in healthy and patient populations. Medical Care 39: 800–812. doi: 10.1097/00005650-200108000-00006
- 28. Varni JW, Burwinkle TM, Seid M, Skarr D (2003) The PedsQL™ 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambulatory Pediatrics 3: 329–341. doi: 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2
- 29. Varni JW, Burwinkle TM, Jacobs JR, Gottschalk M, Kaufman F, et al. (2003) The PedsQL™ in Type 1 and Type 2 diabetes: Reliability and validity of the Pediatric Quality of Life Inventory™ generic core scales and Type 1 diabetes module. Diabetes Care 26: 631–637. doi: 10.2337/diacare.26.3.631
- 30. Goldstein SL, Graham N, Warady BA, Seikaly M, McDonald R, et al. (2008) Measuring health-related quality of life in children with ESRD: Performance of the Generic and ESRD-Specific Instrument of the Pediatric Quality of Life Inventory™ (PedsQL™). American Journal of Kidney Diseases 51: 285–297. doi: 10.1053/j.ajkd.2007.09.021
- 31. Weissberg-Benchell J, Zielinski TE, Rodgers S, Greenley RN, Askenazi D, et al. (2010) Pediatric health-related quality of life: Feasibility, reliability and validity of the PedsQL™ Transplant Module. American Journal of Transplantation 10: 1686–1694. doi: 10.1111/j.1600-6143.2010.03141.x
- 32. Limbers CA, Ripperger-Suhler J, Boutton K, Ransom D, Varni JW (2011) A comparative analysis of health-related quality of life and family impact between children with ADHD treated in a general pediatric clinic and a psychiatric clinic utilizing the PedsQL™. Journal of Attention Disorders 15: 392–402. doi: 10.1177/1087054709356191
- 33. Davis SE, Hynan LS, Limbers CA, Andersen CM, Greene MC, et al. (2010) The PedsQL™ in pediatric patients with Duchenne Muscular Dystrophy: Feasibility, reliability, and validity of the Pediatric Quality of Life Inventory™ Neuromuscular Module and Generic Core Scales. Journal of Clinical Neuromuscular Disease 11: 97–109. doi: 10.1097/CND.0b013e3181c5053b
- 34. Seid M, Limbers CA, Driscoll KA, Opipari-Arrigan LA, Gelhard LR, et al. (2010) Reliability, validity, and responsiveness of the Pediatric Quality of Life Inventory™ (PedsQL™) Generic Core Scales and Asthma Symptoms Scale in vulnerable children with asthma. Journal of Asthma 47: 170–177. doi: 10.3109/02770900903533966
- 35. King CH (2006) Long-term outcomes of school-based treatment for control of urinary schistosomiasis: a review of experience in Coast Province, Kenya. Memórias do Instituto Oswaldo Cruz 101: 299–306. doi: 10.1590/S0074-02762006000900047
- 36. Mutuku FM, King CH, Bustinduy AL, Mungai P, Muchiri EM, et al. (2011) Impact of drought on the spatial pattern of transmission of Schistosoma haematobium in Coastal Kenya. American Journal of Tropical Medicine and Hygiene 85: 1065–1070. doi: 10.4269/ajtmh.2011.11-0186
- 37. Mutuku FM, King CH, Mungai P, Mbogo CM, Mwangangi JM, et al. (2011) Impact of insecticide treated bednets on malaria transmission indices on the south coast of Kenya. Malaria Journal 10: 356. doi: 10.1186/1475-2875-10-356
- 38. Peters PA, Warren KS, Mahmoud AA (1976) Rapid, accurate quantification of schistosome eggs via nuclepore filters. J Parasitol 62: 154–155. doi: 10.2307/3279081
- 39. Katz N, Chaves A, Pellegrino J (1972) A simple device for quantitative stool thick-smear technique in schistosomiasis mansoni. Rev Inst Med Trop Sao Paulo 14: 397–400.
- 40. WHO/CDC (2007) Assessing the iron status of populations: report of a Joint World Health Organization/Centers for Disease Control and Prevention. Technical consultation on the assessment of iron status at the population level. 2nd ed. Geneva, Switzerland, 6–8 April 2004. -.
- 41. WHO (2009) WHO Multicentre Growth Reference Study Group. WHO Child Growth Standards:Growth velocity based on weight, length and head circumference: Methods and development Geneva: World Health Organization.
- 42. de Onis M (2009) Growth curves for school age children and adolescents. Indian Pediatrics 46: 463–465.
- 43. WHO/UNICEF (2009) WHO child growth standards and the identification of severe acute malnutrition in infants and children. Geneva, Switzerland. 1–12 p.
- 44. Fairclough DL (2002) Design and Analysis of Quality of Life Studies in Clinical Trials: Interdisciplinary Statistics. New York: Chapman & Hall/CRC.
- 45. Varni JW, Limbers CA, Burwinkle TM (2007) How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8,591 children across age subgroups with the PedsQL™ 4.0 Generic Core Scales. Health and Quality of Life Outcomes 5: 1. doi: 10.1186/1477-7525-5-1
- 46. Gwatkin DR, Rustein S, Johnson K, Pande R, Wagstaff A (2000) Socio-economic Differences in Health, Nutrition, and Population in Kenya. Washington, DC: World Bank. 28 p.
- 47. McHorney CA, Tarlov AR (1995) Individual-patient monitoring in clinical practice: Are available health status surveys adequate? Quality of Life Research 4: 293–307. doi: 10.1007/BF01593882
- 48. Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16: 297–334. doi: 10.1007/bf02310555
- 49. Nunnally JC, Bernstein IR (1994) Psychometric Theory. 3rd edition; New York: McGraw-Hill.
- 50. Cohen J (1988) Statisical Power Analysis for the Behavioral Sciences. 2nd edition. Hillsdale: Erlbaum.
- 51. Kazis LE, Anderson JJ, Meenan RF (1989) Effect sizes for interpreting changes in health status. Medical Care 27: 178–189.
- 52. Fowler FJ (1995) Improving Survey Questions: Design and Evaluation: Thousand Oaks, CA: Sage.
- 53. McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychological Methods 1: 30–46.
- 54. Bartko JJ (1966) The intraclass correlation coefficient as a measure of reliability. Psychological Reports 19: 3–11. doi: 10.2466/pr0.19220.127.116.11
- 55. WHO (2002) Prevention and control of schistosomiasis and soil-transmitted helminthiasis: report of a WHO expert committee. WHO Tech Rep Ser 912: 1–57.
- 56. Friedman JF, Kanzaria HK, Acosta LP, Langdon GC, Manalo DL, et al. (2005) Relationship between Schistosoma japonicum and nutritional status among children and young adults in Leyte, the Philippines. American Journal of Tropical Medicine and Hygiene 72: 527–533.
- 57. King CH (2010) Parasites and poverty: the case of schistosomiasis. Acta Tropica 113: 95–104. doi: 10.1016/j.actatropica.2009.11.012
- 58. Zhou H, Ohtsuka R, He Y, Yuan L, Yamauchi T, et al. (2005) Impact of parasitic infections and dietary intake on child growth in the schistosomiasis-endemic Dongting region, China. American Journal of Tropical Medicine and Hygiene 72: 534–539.
- 59. Bethony J, Williams JT, Kloos H, Blangero J, Alves-Fraga L, et al. (2001) Exposure to Schistosoma mansoni infection in a rural area in Brazil. II: Household risk factors. Tropical Medicine and International Health 6: 136–145. doi: 10.1046/j.1365-3156.2001.00685.x
- 60. Raso G, Utzinger J, Silué KD, Ouattara M, Yapi A, et al. (2005) Disparities in parasitic infections, perceived ill health and access to health care among poorer and less poor schoolchildren of rural Côte d'Ivoire. Tropical Medicine and International Health 10: 42–57. doi: 10.1111/j.1365-3156.2004.01352.x
- 61. Savioli L, Hatz C, Dixon H, Kisumku UM, Mott KE (1990) Control of morbidity due to Schistosoma haematobium on Pemba Island: egg excretion and hematuria as indicators of infection. American Journal of Tropical Medicine and Hygiene 43: 289–295.
- 62. Kvalsvig JD (1981) The effects of schistosomiasis on spontaneous play activity in black schoolchildren in the endemic areas. An ethological study. S Afr Med J 60: 61–64.
- 63. Chan KS, Mangione-Smith R, Burwinkle TM, Rosen M, Varni JW (2005) The PedsQL™: reliability and validity of the short-form generic core scales and asthma module. Medical Care 43: 256–265. doi: 10.1097/00005650-200503000-00008
- 64. Chen X, Origasa H, Ichida F, Kamibeppu K, Varni JW (2007) Reliability and validity of the Pediatric Quality of Life Inventory™ (PedsQL™) Short Form 15 generic core scales in Japan. Quality of Life Research 17: 1239–1249. doi: 10.1007/s11136-007-9230-4
- 65. Raat H, Landgraf JM, Oostenbrink R, Moll HA, Essink-Bot M-L (2007) Reliability and validity of the Infant and Toddler Quality of Life Questionnaire (ITQOL) in a general population and respiratory disease sample. Quality of Life Research 16: 445–460. doi: 10.1007/s11136-006-9134-8