Beyond Code Generation: LLM-supported Exploration of the Program Design Space

要旨

In this work, we explore explicit Large Language Model (LLM)-powered support for the iterative design of computer programs. Program design, like other design activity, is characterized by navigating a space of alternative problem formulations and associated solutions in an iterative fashion. LLMs are potentially powerful tools in helping this exploration; however, by default, code-generation LLMs deliver code that represents a particular point solution. This obscures the larger space of possible alternatives, many of which might be preferable to the LLM’s default interpretation and its generated code. We contribute an IDE that supports program design through generating and showing new ways to frame problems alongside alternative solutions, tracking design decisions, and identifying implicit decisions made by either the programmer or the LLM. In a user study, we find that with our IDE, users combine and parallelize design phases to explore a broader design space---but also struggle to keep up with LLM-originated changes to code and other information overload. These findings suggest a core challenge for future IDEs that support program design through higher-level instructions given to LLM-based agents: carefully managing attention and deciding what information agents should surface to program designers and when.

受賞
Honorable Mention
著者
J.D. Zamfirescu-Pereira
UC Berkeley, Berkeley, California, United States
Eunice Jun
UC Berkeley, Berkeley, California, United States
Michael Terry
Google, Cambridge, Massachusetts, United States
Qian Yang
Cornell University, Ithaca, New York, United States
Bjoern Hartmann
UC Berkeley, Berkeley, California, United States
DOI

10.1145/3706598.3714154

論文URL

https://dl.acm.org/doi/10.1145/3706598.3714154

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Coding and Development

G418+G419
7 件の発表
2025-04-29 23:10:00
2025-04-30 00:40:00
日本語まとめ
読み込み中…