Organizations: EFREI Research Lab - University of Paris Panthéon Assas, France · LIFAT - University of Tours, France · LIFO - University of Orleans, France · CMRRF, Mutuality of Morbihan, France
In this paper, we introduce the French-YMCA corpus, a new linguistic resource specifically tailored for children and adolescents. The motivation for building this corpus is clear: children have unique language requirements, as their language skills are in constant evolution and differ from those of adults. With an extensive collection of 39,200 text files, the French-YMCA corpus encompasses a total of 22,471,898 words. It distinguishes itself through its diverse sources, consistent grammar and spelling, and the commitment to providing open online accessibility for all. Such corpus can serve as the foundation for training language models that understand and anticipate youth's language, thereby enhancing the quality of digital interactions and ensuring that responses and suggestions are age-appropriate and adapted to the comprehension level of users of this age.
Figures & tables
Corpus name
Text source
Text genre
Number of files
Age range
CHILDES
Transcriptions from audio and video recordings of children’s conversations
Conversation
2,275
6 months to 11 years
E-calm
Student Essays and writings
Formal writing
4,500
6 to 18 years
Philosophèmes
Transcriptions of philosophical discussion
Philosophical conversation
22
5 to 18 years
Grenouille
Student Essays
Formal writing
400
8 to 14 years
C’est pas moi
Transcriptions of discussions on ”Lying” and writings
Conversation and formal writing
53
6 to 8 years
PréCPhi
Philosophical Writings
Formal writing
1,000
8 to 15 years
Table 1: Overview of varied corpora for children and adolescent.
Figure 1: Example of a text file and its corresponding JSON metadata file from the French-YMCA Corpus.
Text source
Age
Language register
Number of files
Number of words
Avg. sentence length
Data availability
Books and stories for children
Children
Literature
2 211
2 935 108
12
¿80% open; rest by agreement
Children e-journals
Children
Formal newspaper
16 026
5 103 070
17
By agreement only
Adolescents e-journals
Adolescents
Formal newspaper
2 079
949 753
16
By agreement only
Vikidia
Adolescents
Formal informative
17 237
7 380 229
20
Public
Animated movie subtitles
Children
Informal
1 647
6 103 738
7
By agreement only
Total
39 200
22 471 898
12
Table 2: Distribution of the collected texts based on their source type.
State-of-the-art ASR systems primarily target native adult speech, leading to substantial performance gaps for children, adolescents, and L2 speakers. We introduce AraYoungVoices, a 151.72-hour Arabic read-speech corpus from 286 speakers aged 7--18, comprising AraKids (7--12) and AraTeens (13--18). The corpus includes 146 native Arabic (L1) and 140 second-language (L2) speakers, with native speakers spanning Egyptian, Gulf, Levantine, and North African dialectal backgrounds and L2 speakers representing diverse linguistic backgrounds across the Americas, Asia, Africa, and Europe. We benchmark four pretrained ASR models under zero-shot and fine-tuned settings using unseen-speaker-&-unseen-prompt (USUP) and unseen-speaker-&-seen-prompt (USSP) evaluations. Results show that L2 speech remains substantially more challenging than L1 speech, with the largest errors observed mainly for younger L2 speakers. Age-specific fine-tuning improves the matched age group, while joint fine-tuning provides a stronger balance across populations. ASR hypotheses are also consistently closer to the standard reading prompt than to the verbatim transcription, particularly for L2 speech, suggesting partial normalization of reading deviations.
Shammur Absar Chowdhury, Zien Sheikh Ali, Houssam Eddine-Othman Lachemat +1
We introduce quantitative metrics for child language acquisition to evaluate language models. Our focus is on the formal syntactic and functional discourse properties of determiners in English, which young children acquire early and accurately. We propose Contextual Alternative Choice (CAC), a new prompting method which provides targeted tests for both syntactic and discourse knowledge of language. The method enables direct comparison of language models against children, and more importantly, against statistical benchmarks independently established in empirical research. No current model trained on a comparable amount of data simultaneously meet both formal and functional benchmarks like human children, but some very large models do. We present our results as methodological and technical contributions, with specific emphasis on cognitive status of language models.
Héctor Javier Vázquez Martínez, Charles Yang
University of Pennsylvania Department of Linguistics and Computer and Information Science
Research on developmentally plausible language models has largely focused on English, leaving open questions about multilingual settings. We present a systematic study of compact language models by extending BabyBERTa to English-French scenarios under strictly size-matched data conditions, covering monolingual, bilingual, and cross-lingual settings. Our design contrasts two types of training corpora: (i) child-directed speech (about 2.5M tokens), following BabyBERTa and related work, and (ii) multi-domain corpora (about 10M tokens), extending the BabyLM framework to French. To enable fair evaluation, we also introduce new resources, including French versions of QAMR and QASRL, as well as English and French multi-domain corpora. We evaluate the models on both syntactic and semantic tasks and compare them with models trained on Wikipedia-only data. The results reveal context-dependent effects: training on Wikipedia consistently benefits semantic tasks, whereas child-directed speech improves grammatical judgments in monolingual settings. Bilingual pretraining yields notable gains for textual entailment, with particularly strong improvements for French. Importantly, similar patterns emerge across BabyBERTa, RoBERTa, and LTG-BERT, suggesting consistent trends across architectures.
Liel Binyamin, Elior Sulem
Faculty of Computer and Information Science, Institute for Applied AI Research Data Science Research Center Ben-Gurion University of the Negev