Speaking Code: PointNet

This work explores the applications of deep learning architectures with 3D geometric data such as point clouds or meshes. Usually, CNNs require regular data formats like image grids or 3D voxels. However, point clouds and meshes do not match the conventional format; therefore, people used to transform them into regular 3D voxel grids or collections of images. Although you could vaxolize the input data, the approach is very expensive since it results in a large input space (your mesh would be really sparse). PointNet, however, simply utilizes point clouds as input data and outputs either class labels for the entire input or for each individual point to perform Part Segmentation.