Jacob, Joshua
ASAP: Automated Sequence Planning for Complex Robotic Assembly with Physical Feasibility
Tian, Yunsheng, Willis, Karl D. D., Omari, Bassel Al, Luo, Jieliang, Ma, Pingchuan, Li, Yichen, Javid, Farhad, Gu, Edward, Jacob, Joshua, Sueda, Shinjiro, Li, Hui, Chitta, Sachin, Matusik, Wojciech
The automated assembly of complex products requires a system that can automatically plan a physically feasible sequence of actions for assembling many parts together. In this paper, we present ASAP, a physics-based planning approach for automatically generating such a sequence for general-shaped assemblies. ASAP accounts for gravity to design a sequence where each sub-assembly is physically stable with a limited number of parts being held and a support surface. We apply efficient tree search algorithms to reduce the combinatorial complexity of determining such an assembly sequence. The search can be guided by either geometric heuristics or graph neural networks trained on data with simulation labels. Finally, we show the superior performance of ASAP at generating physically realistic assembly sequence plans on a large dataset of hundreds of complex product assemblies. We further demonstrate the applicability of ASAP on both simulation and real-world robotic setups. Project website: asap.csail.mit.edu
How Can Large Language Models Help Humans in Design and Manufacturing?
Makatura, Liane, Foshey, Michael, Wang, Bohan, HähnLein, Felix, Ma, Pingchuan, Deng, Bolei, Tjandrasuwita, Megan, Spielberg, Andrew, Owens, Crystal Elaine, Chen, Peter Yichen, Zhao, Allan, Zhu, Amy, Norton, Wil J, Gu, Edward, Jacob, Joshua, Li, Yifei, Schulz, Adriana, Matusik, Wojciech
Advances in computational design and manufacturing (CDaM) have already permeated and transformed numerous industries, including aerospace, architecture, electronics, dental, and digital media, among others. Nevertheless, the full potential of the CDaM workflow is still limited by a number of barriers, such as the extensive domainspecific knowledge that is often required to use CDaM software packages or integrate CDaM solutions into existing workflows. Generative AI tools such as Large Language Models (LLMs) have the potential to remove these barriers, by expediting the CDaM process and providing an intuitive, unified, and user-friendly interface that connects each stage of the pipeline. However, to date, generative AI and LLMs have predominantly been applied to non-engineering domains. In this study, we show how these tools can also be used to develop new design and manufacturing workflows.