From Sketch to Photorealistic Facades—No As-Built Model Needed
Renovate, don’t demolish
Producing facade proposals that respect existing structures usually requires painstaking as-built modeling. This research shows a faster path: turn a rough sketch and a short text prompt into a photorealistic renovation concept.
- Spot changes: a vision–language model reads your sketch and words to mark where to add or modify elements.
- Draft details: a diffusion model generates detailed new components and merges them with the original outline via inpainting.
- Make it real: ControlNet refines everything into a consistent, photorealistic image.
Across datasets and real industrial buildings, the framework preserved structure while improving facade quality, enabling rapid iteration and clearer client communication—without building a full as-built model first.
Read more: https://arxiv.org/abs/2601.08531v1
Paper: https://arxiv.org/abs/2601.08531v1
Register: https://www.AiFeta.com
AI architecture adaptive-reuse generative-design computer-vision diffusion-models ControlNet VLM sustainability