AI
Large language models can sound confident even when they are wrong. This study pinpoints a sneaky culprit: spurious correlations — statistical shortcuts like linking certain surnames to a nationality. Models absorb these patterns from data and then answer with high certainty, even when the link is false. What the researchers found
AI
Teach your AI judge—faster—with synthetic test cases Evaluating AI with "LLM-as-a-judge" works—until you run out of good examples. This study introduces a tool that generates rich, customizable synthetic test cases to refine your evaluation criteria, all within a human-in-the-loop workflow. * Configure domains, personas, lengths, desired
AI
AI agents promise to speed up discovery by doing the messy parts of research—forming hypotheses, writing code, running experiments, and analyzing results. But do they actually handle end-to-end projects? InnovatorBench is a new benchmark+platform that tests agents on realistic Large Language Model (LLM) research workflows. * 20 tasks across