Showing 1–1 of 1 results for author: Rosenberg, K T

DrawTalking: Building Interactive Worlds by Sketching and Speaking

Authors: Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei, Haijun Xia, Ken Perlin

Abstract: We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study with our prototype shows that the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to… ▽ More We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study with our prototype shows that the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring. △ Less

Submitted 4 August, 2024; v1 submitted 10 January, 2024; originally announced January 2024.

Comments: 25 pages, 27 figures; Matching version accepted at UIST 2024

ACM Class: H.5.2; D.2.2; I.2.7; D.1.7; H.5.1