PlantoGraphy: Incorporating Iterative Design Process into Generative Artificial Intelligence for Landscape Rendering

要旨

Landscape renderings are realistic images of landscape sites, allowing stakeholders to perceive better and evaluate design ideas. While recent advances in Generative Artificial Intelligence (GAI) enable automated generation of landscape renderings, the end-to-end methods are not compatible with common design processes, leading to insufficient alignment with design idealizations and limited cohesion of iterative landscape design. Informed by a formative study for comprehending design requirements, we present PlantoGraphy, an iterative design system that allows for interactive configuration of GAI models to accommodate human-centered design practice. A two-stage pipeline is incorporated: first, the concretization module transforms conceptual ideas into concrete scene layouts with a domain-oriented large language model; and second, the illustration module converts scene layouts into realistic landscape renderings with a layout-guided diffusion model fine-tuned through Low-Rank Adaptation. PlantoGraphy has undergone a series of performance evaluations and user studies, demonstrating its effectiveness in landscape rendering generation and the high recognition of its interactive functionality.

著者
Rong Huang
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China
Haichuan Lin
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
Chuanzhang Chen
Lappeenranta-Lahti University of Technology, Lahti, Finland
Kang Zhang
Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China
Wei Zeng
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China
論文URL

doi.org/10.1145/3613904.3642824

動画

会議: CHI 2024

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2024.acm.org/)

セッション: Creative Professionals and AI A

315
5 件の発表
2024-05-14 23:00:00
2024-05-15 00:20:00