DA3-BASE

Depth Anything 3: DA3-BASE#

Project Page Paper Demo # noqa: E501

Abstract#

We present Depth Anything 3 (DA3), a model that predicts spatially consistent geometry from an arbitrary number of visual inputs, with or without known camera poses. In pursuit of minimal modeling, DA3 yields two key insights: a single plain transformer (e.g., vanilla DINO encoder) is sufficient as a backbone without architectural specialization, and a singular depth-ray prediction target obviates the need for complex multi-task learning. Through our teacher-student training paradigm, the model achieves a level of detail and generalization on par with Depth Anything 2 (DA2). We establish a new visual geometry benchmark covering camera pose estimation, any-view geometry and visual rendering. On this benchmark, DA3 sets a new state-of-the-art across all tasks, surpassing prior SOTA VGGT by an average of 44.3% in camera pose accuracy and 25.1% in geometric accuracy. Moreover, it outperforms DA2 in monocular depth estimation. All models are trained exclusively on public academic datasets.

Model Description#

DA3 Base model for multi-view depth estimation and camera pose estimation. Compact foundation model with unified depth-ray representation.

Capabilities#

• ✅ Relative Depth
• ✅ Pose Estimation
• ✅ Pose Conditioning

Quick Start#

Installation#

git clone https://github.com/ByteDance-Seed/depth-anything-3
cd depth-anything-3
pip install -e .

Basic Example#

import torch
from depth_anything_3.api import DepthAnything3

# Load model from Hugging Face Hub
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model = DepthAnything3.from_pretrained("depth-anything/da3-base")
model = model.to(device=device)

# Run inference on images
images = ["image1.jpg", "image2.jpg"]  # List of image paths, PIL Images, or numpy arrays
prediction = model.inference(
    images,
    export_dir="output",
    export_format="glb"  # Options: glb, npz, ply, mini_npz, gs_ply, gs_video
)

# Access results
print(prediction.depth.shape)        # Depth maps: [N, H, W] float32
print(prediction.conf.shape)         # Confidence maps: [N, H, W] float32
print(prediction.extrinsics.shape)   # Camera poses (w2c): [N, 3, 4] float32
print(prediction.intrinsics.shape)   # Camera intrinsics: [N, 3, 3] float32

Command Line Interface#

# Process images with auto mode
da3 auto path/to/images \
    --export-format glb \
    --export-dir output \
    --model-dir depth-anything/da3-base

# Use backend for faster repeated inference
da3 backend --model-dir depth-anything/da3-base
da3 auto path/to/images --export-format glb --use-backend

Model Details#

• Developed by: ByteDance Seed Team
• Model Type: Vision Transformer for Visual Geometry
• Architecture: Plain transformer with unified depth-ray representation
• Training Data: Public academic datasets only

Key Insights#

💎 A single plain transformer (e.g., vanilla DINO encoder) is sufficient as a backbone without architectural specialization. # noqa: E501

✨ A singular depth-ray representation obviates the need for complex multi-task learning.

Performance#

🏆 Depth Anything 3 significantly outperforms:

• Depth Anything 2 for monocular depth estimation
• VGGT for multi-view depth estimation and pose estimation

For detailed benchmarks, please refer to our paper. # noqa: E501

Limitations#

• The model is trained on academic datasets and may have limitations on certain domain-specific images # noqa: E501
• Performance may vary depending on image quality, lighting conditions, and scene complexity

Citation#

If you find Depth Anything 3 useful in your research or projects, please cite:

@article{depthanything3,
  title={Depth Anything 3: Recovering the visual space from any views},
  author={Haotong Lin and Sili Chen and Jun Hao Liew and Donny Y. Chen and Zhenyu Li and Guang Shi and Jiashi Feng and Bingyi Kang},  # noqa: E501
  journal={arXiv preprint arXiv:2511.10647},
  year={2025}
}

Links#

• 🏠 Project Page
• 📄 Paper
• 💻 GitHub Repository
• 🤗 Hugging Face Demo
• 📚 Documentation

Authors#

Haotong Lin · Sili Chen · Junhao Liew · Donny Y. Chen · Zhenyu Li · Guang Shi · Jiashi Feng · Bingyi Kang # noqa: E501