WildDet3D
Collection
This is the collection of WildDet3D artifacts, including demos, model checkpoints and data. https://github.com/allenai/WildDet3D • 7 items • Updated • 4
WildDet3D in Your Pocket
Real-time 3D object detection on iPhone with AR overlay.
Download: App Store
The app captures RGB frames and LiDAR depth via ARKit and streams them to a cloud-hosted WildDet3D inference endpoint. It supports multiple interaction modes: open-vocabulary text queries, 2D bounding box prompts for geometric detection, and real-time camera-based inference. Detected 3D boxes are rendered as AR overlays anchored to the physical scene using ARKit world tracking.
Note: The model currently runs on a remote server — the app sends frames to a cloud-hosted API and receives 3D detection results back. On-device inference is not yet supported.
License
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support