Research

You can also find my work on Google Scholar. For a free copy of any paper, email me at iancallen@virginia.edu or use the links below.

Publications

Summer School as a Learning Loss Recovery Strategy after COVID-19: Evidence from Summer 2022

Callen, I., Carbonari, M. V., DeArmond, M., Dewey, D., Dizon-Ross, E., Goldhaber, D., Isaacs, J., Kane, T. J., Kuhfeld, M., McDonald, A., McEachin, A., Morton, E., Muroga, A., & Staiger, D. O. · American Educational Research Journal (2025)

We followed students across eight districts who attended summer school in 2022. It helped a little in math and not at all in reading, and overall it recovered only a small share of the ground students lost during the pandemic.

Media: Future Ed · The 74 · Chalkbeat · NPR

Abstract

To make up for pandemic-related learning losses, many U.S. public school districts have increased enrollment in their summer school programs. We assess summer school as a strategy for COVID-19 learning recovery by tracking the academic progress of students who attended summer school in 2022 across eight districts serving 400,000 students. Based on students’ spring to fall progress, we find a positive impact for summer school on math test achievement (0.03 standard deviation, SD), but not on reading tests. These effects are predominantly driven by students in upper elementary grades. To put the results into perspective, if we assume that these districts have losses similar to those present at the end of the 2022–23 school year (i.e., approximately -0.2 SD), we estimate summer programming closed approximately 2% to 3% of the districts’ total learning losses in math, but none in reading.

Putting the “A” in AP: The Effect of Advanced Placement State Policies on Student Participation and Performance

Callen, I. & Stoddard, C. · Economics of Education Review, 102 (2024)

We asked whether two state policies, requiring high schools to offer AP courses and waiving exam fees, get more students into Advanced Placement. Both raised the share of students taking AP exams, but a smaller share passed: the newly participating students were less prepared, and the number passing at least one exam barely changed.

Media: Fordham Institute

Abstract

Advanced courses prepare high school students for college material and the associated exams provide a low cost way to earn college credit. The College Board’s Advanced Placement (AP) program is the most common in the United States, with about 40 percent of graduating seniors taking at least one AP exam in recent years. However, these opportunities are not equal across high school students due to variation in school offerings and potentially limiting exam fees. We examine the effects of two state-level policies designed to provide greater access to this program: the first mandates a minimum number of AP courses to be offered in each high school and the second waives exam fees for all students for at least one exam. Our event study and two-way fixed effect estimates suggest that mandating the provision of AP courses raises the percent of high school graduates taking AP exams by 4 to 5 percentage points, while exam fee waivers increase participation by about 1.5 percentage points. At the same time, pass rates fell after implementation of the two policies, indicating that marginal exam takers are less proficient on the exams. We find both policies have minimal effects on the percent of graduates who passed at least one AP exam or on the number of passing exams per high school student.

Evidence on the Large Negative and Heterogenous Effects of the Pandemic on Student Achievement

Callen, I., Goldhaber, D., & Morton, E. · Handbook on Inequality and COVID-19, 254–277 (2025)

A book chapter reviewing what we know about the pandemic’s toll on student achievement: the losses were large, they fell hardest on students who were already behind, and they have been slow to reverse.

Working Papers

A Broader View of Recovery: Exploring Non-Test Student Outcomes in the Wake of the COVID-19 Pandemic

Callen, I., Dizon-Ross, E., Goldhaber, D., Kane, T. J., McEachin, A., & Morton, E. · CALDER Working Paper No. 344-0826 (2026)

We look beyond test scores at attendance, discipline, and course grades in one district across the pandemic. All of them worsened afterward, widening gaps by race and school poverty. Recovery programs helped, though: summer school improved students’ attendance the next year, and tutoring improved attendance and discipline.

Abstract

The COVID-19 pandemic sharply reduced student test scores, and ESSER-funded academic interventions largely failed to recover those losses. Yet few researchers have examined whether these interventions affected students in ways beyond test scores. We use rich longitudinal data from Guilford County Schools (GCS) to document trends before and after the pandemic in attendance, suspensions, disciplinary referrals, and course grades from 2016-17 through 2023-24. All non-test outcomes worsened in GCS after the pandemic, widening pre-existing gaps by race and school poverty level. We also estimate how participation in GCS’s tutoring and summer school in 2021–22 and 2022–23 affect these non-test outcomes. Students who participated in recovery interventions showed improved attendance and discipline in the following year. Effects varied across interventions: summer school robustly improved attendance the following school year, while tutoring improved discipline in one year (2021–22) and attendance in the other (2022–23). These results demonstrate that academic interventions support students on dimensions beyond traditionally measured academic performance and contribute to recovering student engagement and well-being.

Pandemic Learning Loss by Student Baseline Achievement: Extent and Sources of Heterogeneity

Callen, I., Goldhaber, D., Kane, T. J., McDonald, A., McEachin, A., & Morton, E. · CALDER Working Paper No. 292-0224 (2024) · R&R, Economics of Education Review

We asked whether the pandemic widened the gap between initially higher- and lower-achieving students, and where any gap came from. Lower-achieving students lost more ground (about 0.10 SD more in math and 0.11 SD in reading), and most of that widening traces to which school a student attended, not to differences between students within the same school.

Media: Economic Report of the President (2025)

Abstract

It is now well established that the COVID-19 pandemic had a devastating and unequal impact on student achievement. Test score declines were disproportionately large for historically marginalized students, exacerbating preexisting achievement gaps and threatening educational and economic inequality. In this paper, we use longitudinal student-level NWEA MAP Growth test data to estimate differences in test score declines for students at different points on the prepandemic test distribution. We also test the extent to which students’ schools and districts accounted for these differences in declines. We find significant differences in learning loss by baseline achievement, with lower-achieving students’ scores dropping 0.100 SD more in math and 0.113 SD more in reading than higher-achieving students’ scores. We additionally show that the school a student attended accounts for about three-quarters of this widening gap in math achievement and about one-third in reading. The findings suggest school and district-level policies may have mattered more for learning loss than individual students’ experiences within schools and districts.

Advanced Placement Access and College Enrollment: Postsecondary Effects of Advanced Placement State Policies

Callen, I. & Stoddard, C. · Working Paper (2025) · R&R, Education Finance and Policy

A follow-up to our earlier AP study. Here we ask whether the same state policies that drew more students into AP courses also led more of them to enroll in college.

Works in Progress

Interest in Teaching: Motivations, Self-Perceptions, and the Decline in Interest

with Brendan Bartanen and John Krieg

Fewer people want to become teachers than in the past. We study what draws people toward the profession, what pushes them away, and why interest has been falling.