Ren, Carl
Aria Everyday Activities Dataset
Lv, Zhaoyang, Charron, Nicholas, Moulon, Pierre, Gamino, Alexander, Peng, Cheng, Sweeney, Chris, Miller, Edward, Tang, Huixuan, Meissner, Jeff, Dong, Jing, Somasundaram, Kiran, Pesqueira, Luis, Schwesinger, Mark, Parkhi, Omkar, Gu, Qiao, De Nardi, Renzo, Cheng, Shangyi, Saarinen, Steve, Baiyya, Vijay, Zou, Yuyang, Newcombe, Richard, Engel, Jakob Julian, Pan, Xiaqing, Ren, Carl
We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from https://www.projectaria.com/datasets/aea/. We are also providing open-source implementations and examples of how to use the dataset in Project Aria Tools https://github.com/facebookresearch/projectaria_tools.
Robust, High-Precision GNSS Carrier-Phase Positioning with Visual-Inertial Fusion
Dong, Erqun, Sheriffdeen, Sheroze, Yang, Shichao, Dong, Jing, De Nardi, Renzo, Ren, Carl, Chang, Xiao-Wen, Liu, Xue, Wang, Zijian
Robust, high-precision global localization is fundamental to a wide range of outdoor robotics applications. Conventional fusion methods use low-accuracy pseudorange based GNSS measurements ($>>5m$ errors) and can only yield a coarse registration to the global earth-centered-earth-fixed (ECEF) frame. In this paper, we leverage high-precision GNSS carrier-phase positioning and aid it with local visual-inertial odometry (VIO) tracking using an extended Kalman filter (EKF) framework that better resolves the integer ambiguity concerned with GNSS carrier-phase. %to achieve centimeter-level accuracy in the ECEF frame. We also propose an algorithm for accurate GNSS-antenna-to-IMU extrinsics calibration to accurately align VIO to the ECEF frame. Together, our system achieves robust global positioning demonstrated by real-world hardware experiments in severely occluded urban canyons, and outperforms the state-of-the-art RTKLIB by a significant margin in terms of integer ambiguity solution fix rate and positioning RMSE accuracy.