Show notes
Meta AI, in collaboration with Inria and WRI, has announced the release of DINOv3, a 7-billion-parameter Vision Transformer model trained using self-supervised learning. The research addresses the 'scaling paradox' in computer vision, where increasing model size and training duration traditionally improves global classification but degrades dense, local feature accuracy. To combat this, researchers introduced 'Gram Anchoring,' a regularization technique that anchors the model's feature relationships to high-resolution targets. DINOv3 was trained on the LVD-1689M dataset, consisting of 1.689 billion high-quality images filtered from a larger pool of 17 billion. The resulting model achieves state-of-the-art performance on dense tasks such as segmentation and depth estimation without requiring fine-tuning. This architecture provides robust spatial priors for frameworks like ProxyCLIP and demonstrates strong generalization across domains, including aerial and satellite imagery.



