From Doodle to Design: Sketch‑to‑Layout Made Simple
From doodle to design
Imagine sketching a rough poster layout and instantly getting a polished version. That’s the promise of Sketch‑to‑Layout, a new approach that uses your sketch as the design guide.
- How it works: A multimodal transformer takes your quick sketch plus content (text/images) and generates clean layouts for posters, documents, or slides.
- Why it’s better: No complex constraints—sketches are intuitive, fast, and closer to how designers think.
- Training breakthrough: Human sketches are scarce, so the team created ~200k synthetic training sketches at scale.
- Results: Outperforms state-of-the-art constraint-based methods on PubLayNet, DocLayNet, and SlidesVQA.
- For the community: Paper: http://arxiv.org/abs/2510.27632v1 • Datasets: https://github.com/google-deepmind/sketch_to_layout
This work establishes "sketch-to-layout" as a promising direction for making AI design tools more usable and creative.
Paper: http://arxiv.org/abs/2510.27632v1
Register: https://www.AiFeta.com
AI Design GenerativeAI UX ComputerVision OpenSource Layout Creativity Research DeepLearning
