Join gaming leaders online at GamesBeat Summit Next this upcoming November 9-10. Learn more about what comes next.
Valve’s Portal video game has spawned thousands of videos that appear to bring the first-person shooter’s holographic windows to real life. This is different.
Creative software designer Roland Smeenk built a system that leverages Microsoft’s Kinect V2 sensor to re-create Portal’s portals in real time. He uses one Kinect to record a 3D view of the world in real-time and another to track the head of the user to see where they are looking.
This isn’t just a bunch of cool video editing. Smeenk is reconstructing the camera view as if the user is looking through a virtual window. Taking it a step further, he uses both Kinects for 3D world reconstruction and head-tracking to re-create a two-way portal effect with his laptop and a connected projector:
Three top investment pros open up about what it takes to get your video game funded.
The projector shows the larger portal, and the laptop shows the smaller one. To ensure proper head-tracking, the setup opens a portal as soon as Kinect detects someone.
Smeenk notes this has a size limitation to consider: smaller portals hide more of the other side of the scene and provide for larger head movements because the field of view is limited. There is also a distance limitation (about 7 meters when using USB 3.0 extension cables) because latency is being minimized by only transferring the recorded bodyframes through a network connection (as opposed to transferring the whole recorded 3D scene).
This is quite the technical achievement, given that Kinect wasn’t built for this type of thing. That said, Microsoft’s HoloLens was.
Smeenk envisions how technologies like Kinect and HoloLens could transform human communications:
Looking through a window is a familiar experience for almost everyone. Imagine being in a Skype conversation and having the capability to move your head to see who your caller is looking at or talking to (when it’s not you). A holographic window has the power to give people the feeling of being in the same space and allows for interesting new interactions.
In other words, one day you could put on Microsoft’s HoloLens and see holographic windows into not just virtual worlds but other parts of the real world as events happen there — and in real time.
GamesBeatGamesBeat's creed when covering the game industry is "where passion meets business." What does this mean? We want to tell you how the news matters to you -- not just as a decision-maker at a game studio, but also as a fan of games. Whether you read our articles, listen to our podcasts, or watch our videos, GamesBeat will help you learn about the industry and enjoy engaging with it. How will you do that? Membership includes access to:
- Newsletters, such as DeanBeat
- The wonderful, educational, and fun speakers at our events
- Networking opportunities
- Special members-only interviews, chats, and "open office" events with GamesBeat staff
- Chatting with community members, GamesBeat staff, and other guests in our Discord
- And maybe even a fun prize or two
- Introductions to like-minded parties