Scaling Generalist Data-Analytic Agents

DataMind: a scalable data synthesis and agent training recipe powering open generalist analytics agents

Generalist data‑analytic agents promise automated, end‑to‑end insights across messy, large, and diverse files. But open models often falter on long‑horizon, code‑based reasoning and multi‑turn tool use. DataMind introduces a full stack to fix that: a data synthesis pipeline, stability‑oriented rollouts, and a training objective that blends SFT and RL for robust skill acquisition.

Four key ingredients drive the recipe: (1) a fine‑grained task taxonomy paired with recursive easy‑to‑hard composition to scale difficulty and diversity; (2) knowledge‑augmented trajectory sampling plus model‑ and rule‑based filtering to ensure quality; (3) a dynamically adjustable objective that mixes SFT and RL losses; and (4) a memory‑frugal, stable, code‑centric multi‑turn rollout framework for agentic training.

The team releases DataMind‑12K, a curated trajectory set spanning domains, task types, and data formats. Trained on it, DataMind‑14B achieves an average 71.16% across multiple data analysis benchmarks, outperforming strong proprietary baselines such as DeepSeek‑V3.1 and GPT‑5 reported by the authors. DataMind‑7B tops open‑source peers at 68.10%.

Why it matters: building open, reproducible, and strong data‑analytic agents requires both high‑quality synthetic data and stable agentic training. DataMind offers an actionable blueprint and artifacts (dataset and models) to accelerate community progress.

Who should care: data science teams, analytics platform builders, and researchers pursuing agentic code execution over real‑world, heterogeneous datasets.

Paper: arXiv: Scaling Generalist Data‑Analytic Agents
Register: AiFeta

#AIAgents #DataAnalysis #ToolUse #ReinforcementLearning #SFT #OpenSource #CodeAgents

Read more