Imagine being able to virtually teleport from one space to another in real time.
With 3D-capture cameras and a mixed reality display such as HoloLens, Microsoft Research’s new ‘haloportation’ innovation allows users to see, hear, and interact with remote participants in 3D as if they are actually present in the same physical space.
Custom software helps reconstruct every possibly viewpoint from each camera and then stitches them together into one fully formed 3D model.
“We want to do all of this processing in a tiny window — around 33 milliseconds — to process all the data coming from all of the cameras at once, basically, and also create a temporal model, and then stream the data,” says project lead Shahram Izadi, whose team leans on NVIDIA GPUs to crunch the relevant numbers.
Izadi also mentioned the system is able to record and playback entire previous ‘haloportation’ sessions which is like walking back through time to experience memorable events.
Read more >>
AI-Generated Summary
- Microsoft Research's holoportation system enables real-time 3D telepresence using 3D-capture cameras and mixed reality displays such as HoloLens.
- Custom software reconstructs every possible viewpoint from multiple cameras and stitches them into a fully formed 3D model within approximately 33 milliseconds.
- Project lead Shahram Izadi's team relies on NVIDIA GPUs to process the camera data and create temporal models for streaming.
- The system records and plays back entire holoportation sessions, allowing users to revisit previous interactions.
Next Step
- Read the Wired article on Microsoft holoportation for additional details.
Powered by NVIDIA Nemotron. AI-generated content may summarize information incompletely. Verify important information. Learn more
About the Authors
