3D Synthesis for Architectural Design

WACV 2025

Cornell University

Abstract

We introduce a 3D synthesis method for architectural design to allow for the efficient generation of diverse and realistic building designs. In spite of advances in 3D synthesis, current off-the-shelf 3D synthesis techniques are inappropriate for architectural design: they are trained primarily on isolated objects, have limited diversity, blend building facades with background and produce overly complex geometry that is difficult to edit or manipulate, a major issue in an iterative design process. We propose an alternative pipeline that integrates auto-generated coarse models with segment-wise texture inpainting and semantics-based editing, resulting in diverse, style-consistent, and shape-precise designs. We show through qualitative and quantitative experiments that our pipeline generates more diverse, visually appealing architectures with clean geometries without the need for any extensive training.

ProlificDreamer

Dreamfusion-Hifa

Ours (low-rise)

"A stand-alone house, crafted with high-tech architecture and composite materials, features openings. It is depicted in a photorealistic style from a side view at a street corner, bathed in the glow of the northern light."

MVDream

Dreamfusion-Hifa

Ours (low-rise)

"A house showcasing vintage aesthetics is captured in a lifelike, two-point perspective with dynamic glass and moody lighting, nestled within a wetland setting."

MVDream

Magic3D

Ours (mid-rise)

"A stand-alone building, crafted with organic architecture and ceramic detailing, features large windows. It is depicted in a photorealistic style from a two-point perspective, nestled in an autumn setting and bathed in direct sunlight."

TextMesh

Magic3D

Ours (high-rise)

"A futuristic building with a prominent large glass window, set in a desert landscape surrounded by a variety of cacti and desert flora, bathed in sunset."

Sketch-Nerf SDS = 0.0)

Fantasia3D SDS = 0.0)

Ours (user-input shape)

"A minimalist modern house with large glass windows and a concrete structure, elevated on stilts in a snowy forest. Bare trees covered in light snow create a serene winter scene."

Method

Description of Image

Automatic Detail Editing

Ours

Visual Effects

Auto-generated CSG

3D Synthesis

Geometry Output

Geometry Output

Sketch-Nerf SDS = 1.0)

Visual Effects

CSG Input

3D Synthesis

Geometry Output

Geometry Output

Fantasia3D SDS = 1.0)

Visual Effects

CSG Input

3D Synthesis

Geometry Output

Geometry Output

"A stand-alone house, crafted with high-tech architecture and composite materials, features openings. It is depicted in a photorealistic style from a side view at a street corner, bathed in the glow of the northern light."

BibTeX

@InProceedings{Tsai_2025_WACV,
      author    = {Tsai, I-Ting and Hariharan, Bharath},
      title     = {{3D} Synthesis for Architectural Design},
      booktitle = {Proceedings of the Winter Conference on Applications of Computer Vision (WACV)},
      month     = {February},
      year      = {2025},
      pages     = {4799-4809}
  }