Depth Pro: Sharp Monocular Metric Depth in Less Than a Second
Bochkovskii, Aleksei, Delaunoy, Amaël, Germain, Hugo, Santos, Marcel, Zhou, Yichao, Richter, Stephan R., Koltun, Vladlen
–arXiv.org Artificial Intelligence
We present a foundation model for zero-shot metric monocular depth estimation. The predictions are metric, with absolute scale, without relying on the availability of metadata such as camera intrinsics. And the model is fast, producing a 2.25-megapixel depth map in 0.3 seconds on a standard GPU. These characteristics are enabled by a number of technical contributions, including an efficient multi-scale vision transformer for dense prediction, a training protocol that combines real and synthetic datasets to achieve high metric accuracy alongside fine boundary tracing, dedicated evaluation metrics for boundary accuracy in estimated depth maps, and state-of-the-art focal length estimation from a single image. Extensive experiments analyze specific design choices and demonstrate that Depth Pro outperforms prior work along multiple dimensions. Zero-shot monocular depth estimation underpins a growing variety of applications, such as advanced image editing, view synthesis, and conditional ...
arXiv.org Artificial Intelligence
Oct-2-2024
- Country:
- Europe > Poland (0.04)
- North America > United States
- Massachusetts > Middlesex County > Cambridge (0.04)
- Asia > Myanmar
- Tanintharyi Region > Dawei (0.04)
- Genre:
- Research Report (1.00)
- Industry:
- Media > Photography (0.66)
- Technology: