cs.CYMar 5, 2026

Training for Technology: Adoption and Productive Use of Generative AI in Legal Analysis

Authors: Benjamin M. Chen, Hong Bao

Organizations: Associate Professor and Gallant Ho Outstanding Young Professor, University of Hong Kong Faculty of Law. · PhD student, University of Hong Kong Faculty of Law.

Abstract

Can targeted user training unlock the productive potential of generative artificial intelligence in professional settings? We study this question using a randomized experiment in which 164 law students completed an issue-spotting examination under one of three conditions: no GenAI access, optional access to a large language model (LLM), or LLM access with a brief training intervention. Untrained LLM access proved counterproductive: relative to participants without any LLM access, untrained users wrote significantly shorter answers, committed more case misstatements, and scored marginally lower, though most differences fall short of conventional significance. Training reversed this pattern. Trained participants adopted the LLM at higher rates (41% vs. 26%; p = 0.044), scored 0.27 grade points higher than untrained users--roughly one fine grade--(p = 0.027), and stated applicable rules more accurately (p = 0.014). Principal stratification analysis suggests training operates primarily through adoption rather than effectiveness--the adoption lower bound (1.06) exceeds the effectiveness upper bound (0.42) at strict mean dominance--though confidence intervals are wide. More broadly, these findings challenge the view that GenAI primarily benefits lower-skilled workers: without training, higher-ability practitioners opt out while lower-ability users adopt but unproductively. Realizing GenAI's productivity gains requires investment in both access and instruction.

Explore similar work

CardsList
  1. Eskwai for Students: Generative AI Assistant for Legal Education in Ghana

    May 14, 2026George Boateng, Philemon Badu, Patrick Agyeman-Budu +6Generative AI in EducationLegal QA

  2. Generative AI and the Productivity Divide: Human-AI Complementarities in Education

    May 18, 2026Lihi Idan, Bharat AnandHuman-AI ComplementarityAI in Education

  3. Sophistication in GenAI Use: Field Evidence from a Large Firm

    Aug 27, 2026Nicholas J. Hallman, Zachary T. Kowaleski, Anu Puvvada +1AI and LaborHuman-AI Collaboration