Kyle Steinfeld

L'apprenti Sorcier

(The Sorcerer's Apprentice)

Kyle Steinfeld

In a chapter of L'intelligence artificielle au service de l'architecture, edited by Stanislas Chaillou, I argue that while recent developments in artificial intelligence threaten to dislodge some of our basic assumptions about the nature and purpose of computational design tools, creative designers ought to welcome the disruption.

Routledge Companion to Artificial Intelligence in Architecture

Significant Others - Machine learning as actor, material, and provocateur in art and design

Kyle Steinfeld

I was invited to contribute the first chapter of The Routledge Companion to Artificial Intelligence in Architecture, an edited volume that surveys the state of the art in Artificial Intelligence (AI) as it relates to architecture. In this chapter, I sketch out of a number of models for practice that I see emerging in the area of machine-augmented architectural design, each defined in terms of how it situates the use of ML in design differently.

Sketch2Pix - CDRF 2020

Machine-Augmented Sketching in the Design Studio

Kyle Steinfeld

This paper presents a technical account of the development of an the augmented architectural drawing tool Sketch2Pix: an interactive application that sup-ports architectural sketching augmented by automated image-to-image translation processes.

Sarah Dey, 2020

Drawn, Together - ACADIA 2020

Machine-Augmented Sketching in the Design Studio

Kyle Steinfeld

This paper documents the approach taken by and the work produced in an undergraduate research studio conducted at UC Berkeley in the Spring of 2020. Here, a series of small design projects examine the applicability of machine-augmented sketching tools to early-stage architectural design.

Nicholas Doerschlag, 2020

Death Valley

NeurIPS 2017 Machine Learning for Creativity and Design

Kyle Steinfeld

In work exhibited at the NeurIPS 2017 Machine Learning for Creativity and Design, we developed a process for relating depthmaps extracted from Google Street View panoramas with the corresponding photographic information. A number of separate models were produced using limited geographic areas of selected cites. With these depthmap-to-panoramic cityscape models trained, we are able to generate new images from unrelated depthmaps which resembled photographic images of the selected cities. This is demonstrated using a javascript app (not currently online) and documented in still images and a series of videos.

GAN Loci - ACADIA 2019

Imaging Place using Generative Adversarial Networks

Kyle Steinfeld

This paper proposes the production of synthetic images of cities using generative adversarial networks (or GANs) represents the first computational approach to documenting the Genius Loci of a city, which is understood to include those forms, textures, colors, and qualities of light that exemplify a particular urban location and that set it apart from similar places. Presented here are methods for the collection of urban image data, for the necessary processing and formatting of this data, and for the training of two known computational statistical models (StyleGAN and Pix2Pix) that identify visual patterns distinct to a given site and that reproduce these patterns to generate new images.

GAN Loci - Towards Data Science

Kyle Steinfeld

This post on the Towards Data Science blog concisely summarizes the GAN Loci project - a project which applies techniques in machine learning in order to produce synthetic images intended to capture the predominant visual properties of urban places.

Fresh Eyes - CAAD Futures

A Framework for the Application of Machine Learning to Generative Architectural Design, and a Report of Activities at Smartgeometry 2018

Kyle Steinfeld, Kat Park, Adam Menges, Samantha Walker

This paper presents a framework for the application of Machine Learning (ML) to Generative Architectural Design (GAD), and illustrates this framework through a description of a series of projects completed at the Smart Geometry conference in May of 2018 (SG 2018) in Toronto.

Fresh Eyes - Toronto Exhibition

Kyle Steinfeld

In work exhibited at the University of Toronto in the context of the 2018 Smart Geometry Conference, three-dimensional architectural massings for single-family homes are generated by a generative adversarial network. This GAN is trained on a small dataset of three-dimensional models of homes falling into seventeen architectural styles, and that are represented as multi-view heightfield images.

Fresh Eyes - Smart Geometry Workshop

Hosted by the University of Toronto

Adam Menges, Kat Park, Kyle Steinfeld, Samantha Walker

This workshop cluster offered at the 2018 Smart Geometry Conference in Toronto was the initial catalyst for the Fresh Eyes project, and was the first incorporation of user-generated image recognition models into the evaluation step of a traditional generative design workflow.

This project uniquely links the familiar parametric environment of Grasshopper with cloud-hosted models trained using Lobe.ai: a user-friendly ML graphic programming environment that runs Tensorflow.

Fresh Eyes - Universität der Künste Berlin Workshop

Applying machine learning to generative architectural design

Adam Menges, Kat Park, Kyle Steinfeld, Matt Turlock, Nono Martinez Alonso

This workshop offered at the Design Modeling Symposium in Berlin presents tools and techniques for the application of Machine Learning (ML) to Generative Architectural Design (GAD).

Fresh Eyes for Grasshopper

Kyle Steinfeld

A toolkit for connecting parametric models in Grasshopper with hosted image classification machine learning models.

Not Far From Home

NeurIPS 2018 Machine Learning for Creativity and Design

Kyle Steinfeld

In work exhibited at the NeurIPS 2018 Machine Learning for Creativity and Design, three-dimensional architectural massings for single-family homes are generated by a generative adversarial network. This GAN is trained on a small dataset of three-dimensional models of homes falling into seventeen architectural styles, and that are represented as multi-view heightfield images. A process is developed for converting from 3d CAD model to 2d tiled heightfield image, and from the 2d heightfield images generated by GAN back to three-dimensions in voxel format.

Dreams May Come

Kyle Steinfeld

This paper argues that prevailing approaches to CAD software have been fashioned to support modes of reasoning only of secondary importance to design activity, and that, due to some recent developments in computer vision, this state of affairs may be about to change. Surveying the current state of CAD tools, a critical position is developed based upon the best current understanding of the cognitive processes related to design.

Necessary Tension

A Dual-Evaluation Generative Design Method for Tension Net Structures

Matt Turlock & Kyle Steinfeld

The nature of design tools is related to the social relationships they serve. This paper speculates on the emergence of a new professional configuration - the synthesis of architect and engineer - and on the nature of new computational tools and methods that will be required to support such a reconfiguration.