AI
BabyLMs: A Low‑Cost Sandbox to Study and Fix Bias in Language Models
TL;DR Debiasing big language models is costly. This study shows compact “BabyLMs” can mimic how larger BERT-style models learn biases—so researchers can test ideas faster and cheaper. * BabyLMs (small, BERT-like models on tiny, editable corpora) track the same bias and performance patterns as standard BERTs. * Correlations hold across