SimStep: Chain-of-Abstractions for Incremental Specification and Debugging of AI-Generated Interactive Simulations
Kaputa, Zoe, Rajaram, Anika, Feliciano, Vryan Almanon, Lyu, Zhuoyue, Agrawala, Maneesh, Subramonyam, Hari
–arXiv.org Artificial Intelligence
Programming-by-prompting with generative AI offers a new paradigm for end-user programming, shifting the focus from syntactic fluency to semantic intent. This shift holds particular promise for non-programmers such as educators, who can describe instructional goals in natural language to generate interactive learning content. Yet in bypassing direct code authoring, many of programming's core affordances - such as traceability, stepwise refinement, and behavioral testing - are lost. We propose the Chain-of-Abstractions (CoA) framework as a way to recover these affordances while preserving the expressive flexibility of natural language. CoA decomposes the synthesis process into a sequence of cognitively meaningful, task-aligned representations that function as checkpoints for specification, inspection, and refinement. We instantiate this approach in SimStep, an authoring environment for teachers that scaffolds simulation creation through four intermediate abstractions: Concept Graph, Scenario Graph, Learning Goal Graph, and UI Interaction Graph. To address ambiguities and misalignments, SimStep includes an inverse correction process that surfaces in-filled model assumptions and enables targeted revision without requiring users to manipulate code. Evaluations with educators show that CoA enables greater authoring control and interpretability in programming-by-prompting workflows.
arXiv.org Artificial Intelligence
Jul-15-2025
- Country:
- Asia (0.04)
- Europe > United Kingdom
- England
- Cambridgeshire > Cambridge (0.14)
- Dorset > Bournemouth (0.04)
- England
- North America
- Canada > Ontario
- Toronto (0.04)
- United States
- California
- Los Angeles County > Los Angeles (0.14)
- Santa Clara County > Palo Alto (0.04)
- New York > New York County
- New York City (0.04)
- California
- Canada > Ontario
- Genre:
- Instructional Material (1.00)
- Research Report (1.00)
- Workflow (1.00)
- Industry:
- Education
- Curriculum > Subject-Specific Education (0.92)
- Educational Setting > Online (0.66)
- Education
- Technology: