GamesBeat

Canesta shows off gesture controls for TV, PCs, games and more

Ever since the Nintendo Wii took the video game market by storm with its motion-sensing controller, next-generation user interfaces have become a big attraction. Canesta is one of the companies trying to upstage the Wii with a 3-D vision system.

The webcam-like camera lets you control your PC, TV, games and other things with natural hand gestures rather than a controller or remote control. The camera detects your movements and then calculates exactly where you are. The system then translates your motion into commands for your electronic devices.

The San Jose, Calif., company is showing off the CanestaVision technology this week at the AllThingsD conference in Carlsbad, Calif. But I got a sneak peak at some of the applications in the works. Various software partners are creating the applications that make use of the camera.

Omek Interactive, for example, is developing games that use them. You can wave your arms or jump up and down to make these happen in the exercise-oriented games. Both Hitachi and Softkinetic/Orange Vallee have worked with Canesta to create TVs you can control with the wave of your hand. And Honda is a partner and investor.

In an interview, Canesta chief executive Jim Spare (right) said the company also sees applications for robots that need computer vision. Human servant replacement robots — like in the Jetsons cartoon series — are a long-held dream. If you combine good computer vision with the artificial intelligence of robots such as the Honda Asimo, you might actually get a pretty good household servant robot.

It’s not true 3-D vision the way that we see. The image sensors in the camera, made of ordinary CMOS (complimentary metal oxide semiconductor) chips, can detect objects based on light reflections. A light-emitting diode (LED) flashes and the infrared light bounces off the objects and then returns within fractions of a second to the sensor, which measures the travel time for the returning light to gauge distance.

The infrared is invisible to the human eye. It works in ordinary light and, as I saw in the demo, the user can still operate the controls from across a room.

All of this translates into a lower-cost 3-D depth camera, Spare said. While 3DV uses more expensive gallium arsenide chips that take many more processsing steps to manufacture, Spare said his chips are fabricated in factories owned by Tower Semiconductor and cost around $15 or so in volume.

The company has won more than 40 patents since it was founded in 1999. It competes with such rivals as 3DV Systems and PrimeSense, both based in Israel. Canesta has raised more than $58 million from Venrock, Carlyle Group, and Honda. The company says it has multiple Fortune 500 customers.

Other applications include car rear-view cameras that detect obstacles as cars are backing up, security cameras, and industrial automation controls. Nintendo has brought back the gesture. Apple’s iPhone has shown how much can be done with multi-touch screens. But Canesta is good at showing what natural controls will be like when you yourself serve as the remote.


Don't let cyber attacks kill your game! Join GamesBeat's Dean Takahashi for a free webinar on April 18 that will explore the DDoS risks facing the game industry. Sign up here.
blog comments powered by Disqus

GamesBeat is your source for gaming news and reviews. But it's also home to the best articles from gamers, developers, and other folks outside of the traditional press. Register or log in to join our community of writers. You can even make a few bucks publishing stories here! Learn more.

You are now an esteemed member of the GamesBeat community. That means you can comment on stories or post your own to GB Unfiltered (look for the "New Post" link by mousing over your name in the red bar up top). But first, why don't you fill out your via your ?

About GamesBeat