Integrating stable diffusion via remote server APIs for enhanced parametric design workflows

Abstract

The current advancements of deep learning models offer potential applications for computational design through sets of generated images controlled by parametric inputs, yet they remain disconnected from geometry-driven parametric tools. For this reason, we study the implications of text and image-based generation methods to be used in traditional parametric design procedures. We implement this study by integrating Stable Diffusion and ControlNet to Rhino Grasshopper through a Python-based remote-API plug-in. This API allows a direct connection to the diffusion-based image generation methods without any middleware. Our main contribution is to enable architects and designers to interactively generate and investigate new design ideas in their native parametric design environment. We evaluate potential impact on parametric design education with 15 architecture students using a single GPU server running Stable Diffusion v1.5 across three exercises: Text-to-Image, Image-to-Image using Rhinoceros view captures, and Parametric-Model-to-Image with ControlNet. Quantitative results showed that the API-enabled image generation averaged 4-15 seconds per image, allowing seamless integration with parametric workflows for all 15 students in a classroom setting. Performance evaluations show that our approach offers significantly improved efficiency and responsiveness compared to existing diffusion-based tools, highlighting its suitability for seamless integration within parametric design environments. Qualitative feedback indicated improved design ideation, greater fluency in prompt engineering, and enhanced understanding of parametric logic through iterative visual experimentation. These findings demonstrate the potential of real-time AI integration to augment both conceptual design and parametric design education.