From Doodle to Design: Sketch‑to‑Layout Made Simple

From Doodle to Design: Sketch‑to‑Layout Made Simple

From doodle to design

Imagine sketching a rough poster layout and instantly getting a polished version. That’s the promise of Sketch‑to‑Layout, a new approach that uses your sketch as the design guide.

  • How it works: A multimodal transformer takes your quick sketch plus content (text/images) and generates clean layouts for posters, documents, or slides.
  • Why it’s better: No complex constraints—sketches are intuitive, fast, and closer to how designers think.
  • Training breakthrough: Human sketches are scarce, so the team created ~200k synthetic training sketches at scale.
  • Results: Outperforms state-of-the-art constraint-based methods on PubLayNet, DocLayNet, and SlidesVQA.
  • For the community: Paper: http://arxiv.org/abs/2510.27632v1 • Datasets: https://github.com/google-deepmind/sketch_to_layout

This work establishes "sketch-to-layout" as a promising direction for making AI design tools more usable and creative.

Paper: http://arxiv.org/abs/2510.27632v1

Register: https://www.AiFeta.com

AI Design GenerativeAI UX ComputerVision OpenSource Layout Creativity Research DeepLearning

Read more