Experimental Evidence on the Learning Impact of Generative AI
(with Zara Contractor)
Abstract | Markdown | Updated July 2026
We study how generative AI affects student learning in a randomized experiment. Undergraduates study an unfamiliar topic and write an analytical essay with or without access to off-the-shelf generative AI, then complete unaided assessments immediately and one week later. We measure learning with knowledge tests (factual and conceptual understanding) and open-ended essays (higher-order skills). AI access raises immediate test scores by 0.27 standard deviations, and these gains persist one week later. Essay quality, by contrast, changes little while students have AI access but improves in style and relevance one week later, when students write unaided. These delayed gains are larger among augmentation users—who use AI to explain concepts rather than generate text—whereas automation users’ essays have short-run quality gains that vanish one week later. We find evidence for two mechanisms behind the learning gains: students shift time away from drafting text and toward reading and searching for information, and they report greater learning enjoyment.