Meet Mon3tr: Lifelike 3D Telepresence from One Camera
Imagine joining a meeting as a lifelike 3D hologram—no studio rig, just your phone or laptop camera. Mon3tr makes this possible.
How it works: Mon3tr builds your personal 3D avatar once (offline) from multi-view photos. During calls, a single RGB camera tracks your body and face to drive that avatar in real time. Only compact motion-and-appearance features are sent—under 0.2 Mbps over WebRTC—so it stays smooth even on spotty networks.
On the receiver (e.g., Meta Quest 3), a lightweight “Gaussian” renderer—think a cloud of tiny 3D dots—fine-tunes the pre-built avatar on the fly, delivering photorealistic motion and expressions at about 60 FPS.
Results: over 1000× less bandwidth than point-cloud streaming, about 80 ms end-to-end latency, and high visual quality (>28 dB PSNR) across diverse scenes—while running from a single camera.
Demos: https://mon3tr3d.github.io
Paper: https://arxiv.org/abs/2601.07518v1
Register: https://www.AiFeta.com
#AR #VR #Telepresence #3D #AI #ComputerVision #XR #WebRTC #MetaQuest #GaussianSplatting #Monocular #Holograms
