AI for 3D Generative Design

Several recent papers have investigated similar ideas as this project; however, none of them captured the specific intent I was aiming for and so I ended up taking inspiration from these models but going in a new general direction. Specifically, I wanted to be able to generate objects from at least 10 different categories (the papers below capture only 2–3) and I wanted to develop the model architecture with the capacity to extend to unlabelled 3D shape data. To produce an encoded knowledge base for this design space I chose to use the PartNet database (a subset of ShapeNet) which has 30k densely annotated 3D models across 24 categories. From these annotations and heuristics on the models, I made simplified text descriptions. From the 3D models, I created 3D voxel volumes (voxels are like pixels in 3D) to represent the model in a way that could then be fed into a neural network architecture.