Connect with top gaming leaders in Los Angeles at GamesBeat Summit 2023 this May 22-23. Register here.

Controller-free hand-tracking company Leap Motion is preparing for the day we ditch our position-tracked controllers with its new Interaction Engine, which is launching as an Early Access Beta today.

This promising new concept aims to refine interaction with hand-tracked controls and is now available as a Unity module. Leap announced the launch in a new blog post that goes into detail about what the Interaction Engine means for hand-tracked controls.


The new tools essentially make something of a compromise in terms of believeability of interactions in favor of the ease of actually performing them. With previous iterations of Leap controls, for example, you might struggle with the physical action of holding a virtual object, as anything but a precise and definitive movement might cause the item in question to squeeze out of your grip.


GamesBeat Summit 2023

Join the GamesBeat community in Los Angeles this May 22-23. You’ll hear from the brightest minds within the gaming industry to share their updates on the latest developments.

Register Here

With the Interaction Engine in place, the user’s hand would actually be able to phase into an item without causing it to shoot off, and then establish a firm hold on it from within. You can see it at work in some of the clips Leap recently provided; it might not look realistic, but the payoff in actually being able to manipulate objects without awkward issues may be worth it for many more delicate actions.


The system is essentially implementing a new set of rules for hand physics, detecting when an object is being grasped and how that object should behave in the way that it has been picked up.

You can try the system out for yourself with an early tech demo named Interaction Engine 101, which has now been posted on GitHub. Of course you’ll actually need your own Leap Motion sensor to use it, and a mount to stick it on the front of your VR headset of choice is a good idea too.

It’s important to note it’s far for the final iteration, and much of its future is in the hands (sorry) of developers themselves. Leap is allowing for a wide degree of customization in the controls letting developers tailor the physics system to specific objects. You’ll be able to alter how items behave when thrown, for example, to ensure realistic results that your players won’t struggle with.

It’s a positive step forward for the future of hand-tracking in VR. Oculus Touch, the Vive wands and PlayStation Move are going to be here for years, but Oculus’ own acquisition of companies like Pebbles and Nimble prove that this tech’s time is coming. When it does arrive, it sounds like Leap Motion will be ready.

This post first appeared on UploadVR.

GamesBeat's creed when covering the game industry is "where passion meets business." What does this mean? We want to tell you how the news matters to you -- not just as a decision-maker at a game studio, but also as a fan of games. Whether you read our articles, listen to our podcasts, or watch our videos, GamesBeat will help you learn about the industry and enjoy engaging with it. Discover our Briefings.