-
How Can Large Language Models Help Humans in Design and Manufacturing?
Authors:
Liane Makatura,
Michael Foshey,
Bohan Wang,
Felix HähnLein,
Pingchuan Ma,
Bolei Deng,
Megan Tjandrasuwita,
Andrew Spielberg,
Crystal Elaine Owens,
Peter Yichen Chen,
Allan Zhao,
Amy Zhu,
Wil J Norton,
Edward Gu,
Joshua Jacob,
Yifei Li,
Adriana Schulz,
Wojciech Matusik
Abstract:
The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we scrutinize the utility of LLMs in tasks such as: converting a text-based prompt into a design specification, transforming a design into manufacturing instruction…
▽ More
The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we scrutinize the utility of LLMs in tasks such as: converting a text-based prompt into a design specification, transforming a design into manufacturing instructions, producing a design space and design variations, computing the performance of a design, and searching for designs predicated on performance. Through a series of examples, we highlight both the benefits and the limitations of the current LLMs. By exposing these limitations, we aspire to catalyze the continued improvement and progression of these models.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Polygrammar: Grammar for Digital Polymer Representation and Generation
Authors:
Minghao Guo,
Wan Shou,
Liane Makatura,
Timothy Erps,
Michael Foshey,
Wojciech Matusik
Abstract:
Polymers are widely-studied materials with diverse properties and applications determined by different molecular structures. It is essential to represent these structures clearly and explore the full space of achievable chemical designs. However, existing approaches are unable to offer comprehensive design models for polymers because of their inherent scale and structural complexity. Here, we pres…
▽ More
Polymers are widely-studied materials with diverse properties and applications determined by different molecular structures. It is essential to represent these structures clearly and explore the full space of achievable chemical designs. However, existing approaches are unable to offer comprehensive design models for polymers because of their inherent scale and structural complexity. Here, we present a parametric, context-sensitive grammar designed specifically for the representation and generation of polymers. As a demonstrative example, we implement our grammar for polyurethanes. Using our symbolic hypergraph representation and 14 simple production rules, our PolyGrammar is able to represent and generate all valid polyurethane structures. We also present an algorithm to translate any polyurethane structure from the popular SMILES string format into our PolyGrammar representation. We test the representative power of PolyGrammar by translating a dataset of over 600 polyurethane samples collected from literature. Furthermore, we show that PolyGrammar can be easily extended to the other copolymers and homopolymers such as polyacrylates. By offering a complete, explicit representation scheme and an explainable generative model with validity guarantees, our PolyGrammar takes an important step toward a more comprehensive and practical system for polymer discovery and exploration. As the first bridge between formal languages and chemistry, PolyGrammar also serves as a critical blueprint to inform the design of similar grammars for other chemistries, including organic and inorganic molecules.
△ Less
Submitted 5 May, 2021;
originally announced May 2021.
-
Knitting Skeletons: A Computer-Aided Design Tool for Shaping and Patterning of Knitted Garments
Authors:
Alexandre Kaspar,
Liane Makatura,
Wojciech Matusik
Abstract:
This work presents a novel interactive system for simple garment composition and surface patterning. Our approach makes it easier for casual users to customize machine-knitted garments, while enabling more advanced users to design their own composable templates. Our tool combines ideas from CAD software and image editing: it allows the composition of (1) parametric knitted primitives, and (2) stit…
▽ More
This work presents a novel interactive system for simple garment composition and surface patterning. Our approach makes it easier for casual users to customize machine-knitted garments, while enabling more advanced users to design their own composable templates. Our tool combines ideas from CAD software and image editing: it allows the composition of (1) parametric knitted primitives, and (2) stitch pattern layers with different resampling behaviours. By leveraging the regularity of our primitives, our tool enables interactive customization with automated layout and real-time patterning feedback. We show a variety of garments and patterns created with our tool, and highlight our ability to transfer shape and pattern customizations between users.
△ Less
Submitted 31 July, 2019; v1 submitted 11 April, 2019;
originally announced April 2019.
-
Neural Inverse Knitting: From Images to Manufacturing Instructions
Authors:
Alexandre Kaspar,
Tae-Hyun Oh,
Liane Makatura,
Petr Kellnhofer,
Jacqueline Aslarus,
Wojciech Matusik
Abstract:
Motivated by the recent potential of mass customization brought by whole-garment knitting machines, we introduce the new problem of automatic machine instruction generation using a single image of the desired physical product, which we apply to machine knitting. We propose to tackle this problem by directly learning to synthesize regular machine instructions from real images. We create a cured dat…
▽ More
Motivated by the recent potential of mass customization brought by whole-garment knitting machines, we introduce the new problem of automatic machine instruction generation using a single image of the desired physical product, which we apply to machine knitting. We propose to tackle this problem by directly learning to synthesize regular machine instructions from real images. We create a cured dataset of real samples with their instruction counterpart and propose to use synthetic images to augment it in a novel way. We theoretically motivate our data mixing framework and show empirical results suggesting that making real images look more synthetic is beneficial in our problem setup.
△ Less
Submitted 19 June, 2019; v1 submitted 7 February, 2019;
originally announced February 2019.
