Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Prompts
Angert, Tyler, Suzara, Miroslav Ivan, Han, Jenny, Pondoc, Christopher Lawrence, Subramonyam, Hariharan
–arXiv.org Artificial Intelligence
Creative coding tasks are often exploratory in nature. When producing digital artwork, artists usually begin with a high-level semantic construct such as a "stained glass filter" and programmatically implement it by varying code parameters such as shape, color, lines, and opacity to produce visually appealing results. Based on interviews with artists, it can be effortful to translate semantic constructs to program syntax, and current programming tools don't lend well to rapid creative exploration. To address these challenges, we introduce Spellburst, a large language model (LLM) powered creative-coding environment. Spellburst provides (1) a node-based interface that allows artists to create generative art and explore variations through branching and merging operations, (2) expressive prompt-based interactions to engage in semantic programming, and (3) dynamic prompt-driven interfaces and direct code editing to seamlessly switch between semantic and syntactic exploration. Our evaluation with artists demonstrates Spellburst's potential to enhance creative coding practices and inform the design of computational creativity tools that bridge semantic and syntactic spaces.
arXiv.org Artificial Intelligence
Aug-7-2023
- Country:
- North America
- United States
- Virginia (0.04)
- Colorado (0.04)
- New York > New York County
- New York City (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- Hawaii > Honolulu County
- Honolulu (0.04)
- Georgia > Fulton County
- Atlanta (0.04)
- California
- San Francisco County > San Francisco (0.16)
- Los Angeles County > Los Angeles (0.14)
- Santa Clara County > Palo Alto (0.04)
- Canada > British Columbia
- United States
- Europe > United Kingdom
- Scotland > City of Glasgow
- Glasgow (0.04)
- England > Oxfordshire
- Oxford (0.04)
- Scotland > City of Glasgow
- Asia > Japan
- Honshū > Kantō > Kanagawa Prefecture > Yokohama (0.04)
- North America
- Genre:
- Research Report (1.00)
- Questionnaire & Opinion Survey (1.00)
- Workflow (0.68)
- Industry:
- Leisure & Entertainment (0.46)
- Technology: