Cognitive and Emotional Well-Being of Preschoolers Before and … – JAMA Network
November 17, 2023
Key Points
Question What is the association between exposure to the COVID-19 pandemic and preschool-aged childrens cognitive and emotional development?
Findings In this cross-sectional study including data from the Ontario Birth Study, pandemic-exposed children had significantly higher problem solving and fine motor skills at 24 months of age but lower personal-social skills compared with nonexposed children. At 54 months of age, pandemic-exposed children had significantly higher vocabulary, visual memory, and overall cognitive performance compared with nonexposed children.
Meaning These findings suggest that health care practitioners and educators may encounter a mix of pandemic-related outcomes among young children as they plan recovery efforts following the pandemic.
Importance The association between COVID-19 social disruption and young childrens development is largely unknown.
Objective To examine associations of pandemic exposure with neurocognitive and socioemotional development at 24 and 54 months of age.
Design, Setting, and Participants This cross-sectional study evaluated associations between pandemic exposure vs nonexposure and developmental outcomes with covariate adjustment using data from the Ontario Birth Study collected between February 2018 and June 2022. Eligible participants were children aged 24 and 54 months. Data were analyzed from June to November 2022.
Exposure COVID-19 pandemic exposure defined as assessment after March 11, 2020.
Main Outcome and Measures Neurodevelopmental assessment using the ASQ-3 (Ages and Stages Questionnaire, Third Edition) and MCHAT-R (Modified Checklist for Autism in Toddlers, Revised) at 24 months of age, and neurocognitive and socioemotional assessment using the National Institutes of Health Toolbox at 54 months of age.
Results A total of 718 children at age 24 months (mean [SD] age, 25.6 [1.7] months; 342 female [47.6%]; 461 White [64.2%]) and 703 at age 54 months (mean [SD] age, 55.4 [2.6] months; 331 female [47.1%]; 487 White [69.3%]) were included. At 24 months of age, 460 participants (232 female [50.4%]) were assessed during the pandemic (March 17, 2020, to May 17, 2022) and 258 (110 female [42.6%]) were assessed prepandemic (April 17, 2018, to March 10, 2020). At 54 months of age, 286 participants (129 female [45.1%]) were assessed from March 14, 2020, to June 6, 2022, and 417 (202 female [48.4%]) were assessed from February 8, 2018, to March 10, 2020. At 24 months of age, pandemic-exposed children had reduced risk of problem-solving difficulties using cutoff scores (odds ratio [OR], 0.33; 95% CI, 0.18-0.62; P=.005) and higher problem-solving (B, 3.93; 95% CI, 2.48 to 5.38; P<.001) compared with nonexposed children. In contrast, pandemic-exposed children had greater risk for personal-social difficulties using cutoff scores (OR, 1.67; 95% CI, 1.09-2.56; P=.02) and continuous scores (B, 1.70; 95% CI, 3.21 to 0.20; P=.02) compared with nonexposed children. At 54 months of age, pandemic-exposed children had higher receptive vocabulary (B, 3.16; 95% CI, 0.13 to 6.19; P=.04), visual memory (B, 5.95; 95% CI, 1.11 to 10.79; P=.02), and overall cognitive performance (B, 3.89; 95% CI, 0.73 to 7.04; P=.02) compared with nonexposed children, with no differences in socioemotional development.
Conclusions and Relevance This cross-sectional study found both positive and negative associations between pandemic exposure and preschool childrens cognitive and emotional well-being within a relatively socioeconomically advantaged sample.
The COVID-19 pandemic produced pervasive social disruption, widely believed to have affected the well-being of children and families.1-3 In Toronto, Ontario, families experienced 4 provincial lockdowns and partially coinciding periods of school closure. However, long-term consequences of the pandemic on developmental outcomes in children are not fully understood, particularly for preschool-aged children who may be highly sensitive to pandemic stress given the heightened plasticity of the brain during this period.4-6 Understanding how the pandemic may have affected preschool childrens development is important for practitioners who provide care to children and families, and to acquire evidence to increase preparedness for future disasters.
Most studies in children and adolescents during the pandemic focused on socioemotional outcomes with longitudinal studies and meta-analyses suggesting that the prevalence of mental health problems increased during the pandemic compared with prepandemic levels.7-11 In contrast, few studies have examined the effects of the pandemic on childrens neurocognitive functioning. A 2022 meta-analysis12 found limited evidence for significant neurodevelopmental difficulties among infants and young children born or assessed during the pandemic compared with prepandemic children, with marginal evidence of communication problems among those assessed during the pandemic. The small number of studies in this area make it unclear whether, and to what degree, the pandemic may have adversely affected childrens neurocognitive development.
Existing studies examining pandemic effects on children have several limitations.9,13-17 These include the fact that most studies: (1) have been conducted with small and highly selected samples; (2) rely on parental reports of outcomes, which are prone to reporting biases; and (3) lack a prepandemic comparison sample or use data from historical samples that differ on key sociodemographic characteristics from the pandemic-exposed group. The current study addresses these limitations by combining assessments of socioemotional and neurocognitive development during the pandemic using both parent-report and performance-based measures with comparisons to a prepandemic cohort from the same study using matched methods and measures. Specifically, we leverage data from the Ontario Birth Study (OBS), a prospective pregnancy cohort. The OBS began prior to the pandemic and continued recruitment and follow-up during the pandemic. In the current study, we examined cross-sectional associations between general pandemic exposure vs nonexposure with child neurodevelopment at 24 months of age and neurocognitive and socioemotional functioning at 54 months of age. We hypothesized that children assessed during the pandemic would demonstrate less optimal neurodevelopmental, neurocognitive, and socioemotional outcomes at both ages compared with children assessed prepandemic.
Study Design and Participants
This cross-sectional study used data from the OBS, a prospective pregnancy study with continuous recruitment since 2013. Women receiving prenatal care at Mount Sinai Hospital in Toronto, Ontario, were recruited before 17 weeks gestation. Participants were asked to complete questionnaires that included sociodemographic and health information and to consent to the collection of clinical information.18 This study was approved by the research ethics board at Mount Sinai Hospital and followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for cross-sectional studies.
In 2018, a companion protocol, OBS Kids, was initiated to follow participating mothers and their liveborn children to age 54 months. Telephone follow-up was conducted at 8 and 36 months, and in-person visits were conducted at 24 and 54 months of age, when development was assessed. As of June 29, 2022, there were 2501 mother-child dyads eligible for OBS Kids. For 1545 of these, the child had reached 48 months of age; 1258 were invited to complete the 54-month follow-up, with 753 total completions and 724 completed by June 29, 2022. Twenty-one twins were excluded (1 twin of each twin pair was selected for analyses using a random number generator), leaving 703 for analyses at age 54 months. For 1346 of the eligible mother-child dyads, the child had reached age 24 months; 1140 were invited to complete the 24-month follow-up, with 762 total completions and 738 completed by June 29, 2022. Twenty twins were excluded, leaving 718 for analyses at 24 months.
The exposure was any early childhood exposure to the COVID-19 pandemic. Participants were considered part of the pandemic-exposed group if they completed assessments after March 11, 2020, the date the World Health Organization declared COVID-19 a global pandemic.19 Participants in the nonexposed group were assessed before this date, meaning they had no exposure to the pandemic at assessment. The groups were compared independently at ages 24 and 54 months with little overlap.
Developmental Assessment at 24 Months
The Ages and Stages Questionnaire, Third Edition (ASQ-3) was used to assess neurodevelopment at 24 months. The ASQ-3 is a psychometrically sound screening tool measuring communication, gross motor, fine motor, problem solving, and personal-social skills.20 For analyses, scores on the ASQ-3 were included both as continuous variables (ie, total scores for each domain [range, 0-60]) and binary variables defined by scores either below or above a standard cutoff value.20 For the latter, scores in the monitoring or below cutoff range (ie, scores requiring follow-up or referral) were combined into the at-risk category; scores above this cutoff were included in the typically developing category (with typically developing representing 0; and at-risk, 1).20
The Modified Checklist for Autism in Toddlers, Revised (MCHATR), a validated and adequately reliable screening tool for autism,20 provided an additional neurodevelopmental measure. Scores from 0 to 2 were considered low risk, while scores from 3 to 20 were considered higher risk, resulting in a binary variable (low-risk, 0; higher-risk, 1) included in analyses. The ASQ-3 and MCHAT-R were completed by mothers as part of an in-person visit or over the telephone. Before the pandemic, 22% of questionnaires were completed by phone, compared with 91% during the pandemic.
Developmental Assessment at 54 Months
Children completed the NIH Toolbox Early Childhood Cognitive Battery at age 54 months, administered on iPads during in-person visits to participants homes. The Flanker Inhibitory Control Test, Dimensional Change Card Sort (DCCS) Test, Picture Sequence Memory Test, and Picture Vocabulary Test were administered. These tasks assess inhibitory control and attention, cognitive flexibility, visual episodic memory, and language skills, respectively.21 This instrument has strong validity and reliability and has been widely used in this age group.22,23 Age-corrected standard scores with a mean (SD) score of 100 (15) were used in analyses. A Cognitive Composite score reflecting overall cognitive skills was also analyzed.24 Higher scores represented better performance for all tasks.
Mothers also completed the NIH Toolbox Emotion Battery. Before the pandemic, 8% of questionnaires were completed by phone, while 72% were completed by phone during the pandemic. The Anxiety, Negative Psychosocial Functioning, and Psychological Well-being summary scores, computed using standard methods, were used.25,26 Age- and sex-corrected T-scores (mean [SD], 50 [10]) were used in analyses.
Analyses were conducted using R version 4.2.1 (R Project for Statistical Computing). Associations between pandemic exposure vs nonexposure (reference group) and neurodevelopment were tested using either logistic or linear regression. In the logistic regression models at 24 months, the typically developing category was the reference group. At 24 and 54 months of age, linear regression was used to test the association between pandemic exposure vs nonexposure and childrens outcomes (reported as sample regression coefficient B, where a 1-unit increase in the variable is associated with a B unit increase in the outcome on the outcomes original scale). We tested both unadjusted models and adjusted models that controlled for maternal age (years), child sex (male, 0; female, 1), gestational age, birth weight, maternal race (White, 0; other race, 1), maternal birth country (Canada, 0; outside of Canada, 1), maternal education (bachelors degree or higher, 0; less than bachelors degree, 1), and household income (above $150000, 0; $150000 or less, 1). Covariates were selected based on associations with childrens cognitive and emotional development in prior studies. Information on participant race and ethnicity was self-reported and collected as part of the overall sociodemographic information collected for the OBS. Race and ethnicity was stratified as White and other or mixed race in analyses due to the small size of groups other than White. We focused on the adjusted analyses.
The distributions of ASQ-3 and NIH Toolbox cognitive scores were not consistently normal. Thus, multiple likelihood estimation, which accounts for non-normal data and is robust to skewness, was conducted with the lavaan package in R.26 A 2-sided P value <.05 was considered statistically significant.
Missing values for covariates were estimated using multivariate imputation by chained equations (MICE) using the MICE package in R. The frequency of missing data appeared to be randomly distributed (ie, the reason for missingness was not related to the outcome). Sensitivity analyses were conducted in which children with known neurodevelopmental diagnoses (eg, ASD and ADHD) were excluded. To test whether the results were robust to the analytic method chosen, we conducted additional analyses to assess whether childrens outcomes varied based on duration of pandemic exposure or proportion of ones life spent in the pandemic, as well as hierarchical linear regression models that controlled for exposure duration (eTables 4-12 in Supplement 1).
At 24 months of age, 258 children were assessed before the pandemic (April 17, 2018, to March 10, 2020) and 460 were assessed during the pandemic (March 17, 2020, to May 17, 2022) (Table 1). At 54 months of age, 417 children were assessed before the pandemic (February 8, 2018, to March 10, 2020) and 286 were assessed during the pandemic (March 14, 2020, to June 6, 2022). The mean (SD) ages were 25.6 (1.9) months and 55.4 (2.6) months, and 342 (47.6%) and 331 (47.1%) were female at each age, respectively. The 24-month and 54-month cohorts represented 2 groups of children that were assessed cross-sectionally, with 129 children who contributed data at both ages.
Most participating mothers self-identified as White (age 24 months, 461 [64.2%]; age 54 months, 487 [69.3%]) and approximately half reported a household income greater than $150000 (age 24 months, 362 [50.4%]; age 54 months, 365 [51.9%]). Additionally, 304 mothers (42.3%) in the 24-month cohort and 264 mothers (37.6%) in the 54-month cohort attended graduate or professional school. There were no sociodemographic differences between pandemic-exposed and nonexposed groups. Distributions of outcome measures are shown in Table 2.
Associations Between Pandemic Exposure and Neurodevelopment at 24 Months
The pandemic-exposed group had a significantly lower adjusted odds of problem-solving difficulties (odds ratio [OR], 0.33; 95% CI, 0.18-0.62; P=.005) but a significantly higher risk of personal-social difficulties (OR, 1.67; 95% CI, 1.09-2.56; P=.02) compared with the nonexposed group (Table 3). There were no significant differences on the MCHAT-R between groups. In adjusted models using continuous scores (Table 4), the pandemic-exposed group had significantly higher problem-solving skills (B, 3.93; 95% CI, 2.48 to 5.38; =0.21; P<.001), but lower personal-social skills (B, 1.70; 95% CI, 3.21 to 0.20; =0.09; P=.03), compared with the nonexposed group. Fine motor skills were significantly higher in the pandemic-exposed group (B, 2.18; 95% CI, 0.41 to 3.95; =0.10; P=.02). Results were similar after removing children with known neurodevelopmental diagnoses (eTables 1-3 in Supplement 1).
Associations Between Pandemic Exposure and Neurocognitive and Socioemotional Development at 54 Months
In adjusted models, the pandemic-exposed group had significantly higher vocabulary (B, 3.16; 95% CI, 0.13 to 6.19; =0.09; P=.04) and picture sequence memory scores (B, 5.95; 95% CI, 1.11 to 10.79; =0.11; P=.02) compared with the nonexposed group, as well as higher cognitive composite scores (B, 3.89; 95% CI, 0.73 to 7.04; =0.11; P=.02) (Table 5). There were no significant differences in childrens socioemotional functioning between exposed and nonexposed groups. Results were similar after removing children with neurodevelopmental diagnoses (eTables 1-3 in Supplement 1).
Additional Sensitivity Analyses
We examined duration of pandemic exposure (in days) prior to assessment, as well as the proportion of ones life spent during the pandemic (ie, length of time a child was exposed to the pandemic divided by age at assessment) (eTables 4-7 in Supplement 1). In both sets of models, longer pandemic exposure was linearly associated with better fine motor skills at 24 months (duration of pandemic: B, 0.01; 95% CI, 0.003 to 0.02; =0.003; P=.01; proportion of life in pandemic: B, 7.15; 2.47 to 11.83; =0.15; P=.003). The age 54 months cohort had no associations with outcomes.
We then conducted analyses where pandemic exposure was categorized into binned groups (eTables 8-9 in Supplement 1). At 24 months, compared with children with less than 5 months of pandemic exposure, those with 5 to 10 months exposure had lower gross motor (B, 3.19; 95% CI, 5.39 to 1.00; =0.12; P=.004) and personal-social skills (B, 2.20; 95% CI, 4.30 to 0.10; =0.09; P=.04), while those with 15 to 20 months or 20 months or more had better fine motor (15 to <20 months: B, 2.67; 95% CI, 0.19 to 5.15; =0.09; P=.04; 20 months: B, 4.93; 95% CI, 2.06 to 7.81; =0.14; P=.001) and problem-solving skills (15 to <20 months: B, 4.51; 95% CI, 2.49 to 6.53; =0.18; P<.001; 20 months: B, 2.65; 95% CI, 0.31 to 4.99; =0.09; P=.03). Higher problem solving was also observed for children with 10 to 15 months of exposure compared with those with less than 5 months exposure (B, 4.12; 95% CI, 2.35 to 5.88; =0.19; P<.001). At 54 months, children with 12 or more months exposure to the pandemic had higher picture sequence memory (B, 8.39; 95% CI, 1.88 to 14.90; =0.12; P=.01) and overall cognitive composite scores (B, 6.21; 95% CI, 1.93 to 10.50; =0.13; P=.01) compared with those with less than 6 months exposure.
Finally, hierarchical regression models that controlled for exposure duration revealed that pandemic exposure itself was associated with lower gross motor (=0.17; P=.01) and personal-social skills (=0.16, P=.01), but better problem-solving skills (=0.19; P=.003), at 24 months (eTables 10-12 in Supplement 1). At age 54 months, longer pandemic exposure was associated with better picture sequence memory (=0.13; P=.02) and cognitive composite scores (=0.13; P=.01), but not with pandemic exposure itself.
In this cross-sectional study, we examined associations between pandemic exposure vs nonexposure and developmental outcomes in preschool-aged children using a relatively large sample with sociodemographically comparable groups. At 24 months of age, children assessed during the pandemic demonstrated better problem-solving and fine motor skills, but lower personal-social skills, compared with children tested before the pandemic after adjusting for potential confounders. Results were largely consistent using categorical or continuous scores for outcomes. While there was no clear association between pandemic exposure and socioemotional functioning at 54 months of age, pandemic-exposed children demonstrated higher visual memory, vocabulary, and overall cognitive function on performance-based measures compared with nonexposed children. Sensitivity analyses generally supported the primary analyses. Results within this relatively socioeconomically advantaged sample suggest that the pandemic has not been universally associated with negative outcomes in preschool-aged children. Rather, the association between pandemic exposure and preschool childrens development is characterized by increased risk in some domains of development but apparent resilience in other domains. However, it is important to note that these results may not be representative of the experiences of all preschool-aged children and their families during the pandemic.
Prior studies using the ASQ-3 to assess associations between pandemic exposure and childrens neurodevelopment have generated mixed results,12 especially when the timing of assessment is considered. Several studies observed lower scores in some or all domains among children assessed at ages 6 or 12 months during the pandemic.27-29 In contrast, another study found very few differences in scores between prepandemic and postpandemic participants, with an advantage in problem-solving in the postpandemic group at 24 months.30 In the current study, we also observed better problem-solving skills at 24 months, in addition to better fine motor skills, among children assessed during the pandemic. This may reflect the increased individualized time and attention children received from caregivers to scaffold these skills during periods of lockdown and social distancing. However, we also showed reliable evidence for decreased personal-social skills and, less reliably, gross motor skills, among pandemic-exposed compared with nonexposed children. This may reflect the fact that children had fewer socialization experiences outside the home and less opportunity to build gross motor skills through community-based activities and play opportunities. Finally, we observed higher visual memory, vocabulary, and overall neurocognitive performance using performance-based measures at 54 months. Although unexpected, this finding may be explained in part by study sampling factors. Specifically, the current sample was more socioeconomically advantaged than the general Canadian population, which has a mean household income of CAD $68400.31 It is well known that the social and health burden experienced by families during the pandemic is not equally distributed across the population, with greater socioeconomic hardship related to worse parent and child well-being during the pandemic.32 Thus, for some families, particularly socioeconomically advantaged families, societal changes brought about by the pandemic (eg, no longer having to commute) may have resulted in less stress and more time spent with children at home. Combined with greater overall resources, these parents may have been able to provide cognitively stimulating learning environments that are well-known to foster cognitive development33-35 and buffer against the effects of adversity.36,37 Thus, the developmental advantages observed in the current study for pandemic-exposed vs nonexposed children may reflect the relatively privileged nature of our sample. Additional studies with greater representation across social, economic, and racial or ethnic categories are vital to understand the extent to which the current results generalize across diverse populations.
Although higher functioning during the pandemic was observed for several areas of development at 24 and 54 months of age, children assessed during the pandemic had lower personal-social skills at 24 months, consistent with other studies during this period.27,28,38 Sensitivity analyses suggested that concerns with social development may have been somewhat brief, with the most significant concerns for children assessed 5 to 10 months after the pandemic began compared with those assessed within 5 months. In Ontario, this period was characterized by school closures that, while not directly relevant to the preschool-aged children in our sample, was linked to increased social distancing overall among families with children. This may have contributed to an overall perception of reduced personal-social skills that eventually eased by the end of the first year of the pandemic.
In addition to limited socioeconomic variability, the results should be considered in light of additional limitations. First, the study was cross-sectional with 2 separate age cohorts (ages 24 and 54 months). Additionally, we only included children exposed to the pandemic in early childhood. In the future, we will be able to assess whether pandemic exposure prenatally confers risk to childrens development. Also, sources of resilience or social buffering were not explored and further work in this area is needed. Finally, we need to consider the potential for spurious results given the number of comparisons. We note that a number of comparisons were not independent, and we focused our interpretation on overall consistent patterns rather than individual nominally significant results.
Findings from this cross-sectional study paint a nuanced picture regarding the well-being of preschool-aged children exposed to the COVID-19 pandemic. Our results underscore both the challenges and potential areas of resilience relevant to policymakers, systems of education, and mental health professionals as they develop remediation efforts to support families with young children.
Accepted for Publication: October 4, 2023.
Published: November 16, 2023. doi:10.1001/jamanetworkopen.2023.43814
Open Access: This is an open access article distributed under the terms of the CC-BY License. 2023 Finegold KE et al. JAMA Network Open.
Corresponding Author: Mark Wade, PhD, CPsych, Department of Applied Psychology and Human Development, University of Toronto, 252 Bloor St W, Toronto, ON M5S1V6, Canada (m.wade@utoronto.ca).
Author Contributions: Dr Knight had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Finegold, Knight, Wade.
Acquisition, analysis, or interpretation of data: Finegold, Knight, Hung, Ssewanyana, Wong, Bertoni, Watson, Levitan, Jenkins, Wade.
Drafting of the manuscript: Finegold, Knight, Wade.
Critical review of the manuscript for important intellectual content: Knight, Hung, Ssewanyana, Wong, Bertoni, Adel Khani, Watson, Levitan, Jenkins, Matthews, Wade.
Statistical analysis: Finegold, Knight.
Obtained funding: Knight, Levitan, Matthews.
Administrative, technical, or material support: Bertoni, Adel Khani, Jenkins, Matthews.
Supervision: Knight, Wade.
Conflict of Interest Disclosures: Dr Matthews reported grants from Canadian Institutes for Health Research, Canada Research Chair Program, and Natural Sciences and Engineering Research Council outside the submitted work. Dr Wade reported grants from Social Sciences and Humanities Research Council of Canada, Connaught Foundation, Society for Research on Child Development, Institute for Pandemics, and American Psychological Foundation outside the submitted work. No other disclosures were reported.
Funding/Support: Funding for the Ontario Birth Study has been provided by Mount Sinai Hospital, the Sinai Health Foundation, the Lunenfeld-Tanenbaum Research Institute, and Canadian Institutes of Health Research (No. UIP-179214; principal investigator, Dr Knight).
Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Data Sharing Statement: See Supplement 2.
Additional Contributions: The authors acknowledge the contribution and support of Ontario Birth Study Team members. In addition, we thank and are extremely grateful to all of the women and children who took part in this study.
Squires J, Twombly E, Bricker DD, Potter L. ASQ-3 Users Guide. Paul H. Brookes Publishing Co; 2009.
Follow this link:
Cognitive and Emotional Well-Being of Preschoolers Before and ... - JAMA Network