Skip to content

Markerless 3D Object Tracking SDK for Unity

XRTracker is a markerless, model-based 3D object tracking SDK for Unity. Import your CAD model or 3D mesh, and track real-world objects with 6DoF pose estimation and sub-centimeter precision — no scanning or cloud training required.

XRTracker uses computer vision to track the full 6 degrees of freedom (position + rotation) of real objects in real-time from a single camera. Just assign a 3D model (FBX, OBJ, or any Unity mesh) and press Play — the SDK handles detection, pose estimation, and continuous tracking on-device.

Key Features

  • Multiple tracking algorithms — Silhouette (foreground separation), Edge (contour-based), and Depth modalities, usable individually or combined
  • AR Foundation integration — Works with ARKit and ARCore camera feeds for mobile AR on iOS and Android
  • Cross-platform — Windows, iOS, Android from a single Unity project
  • Real-time performance — Native C++ computer vision core with GPU-accelerated rendering, typically 4-8ms per frame on mobile
  • No code required — Configure everything from the Unity Inspector, no scanning step or external tools needed
  • Built-in model generation — Generate tracking models directly in the Editor from any mesh (FBX, OBJ, glTF)

Supported Platforms

Platform Camera Source Depth Support
Windows Native capture, RealSense, Sequence RealSense, recorded depth
iOS AR Foundation (ARKit) ARKit depth (LiDAR)
Android AR Foundation (ARCore) —

How It Works

  1. Assign a 3D mesh to a TrackedBody component — this is the object you want to track
  2. Generate a tracking model (silhouette mode) or just assign the mesh (edge mode)
  3. Press Play — XRTracker detects the object, locks on, and continuously tracks its pose

The tracked pose is applied directly to the GameObject's transform, so your augmentations follow the real object automatically.

Next Steps