The Kinect Robot

The Kinect Robot uses the Kinect, the gaming module that’s popular for literally “changing the game” could now also change robotics.



Many Leaf Robots Use a Kinect

Kinect Robot. Kinect is a "controller-free gaming and entertainment experience" developed by Microsoft especially for the Xbox 360 video game platform. The system employs a webcam-style add-on peripheral for the gaming console, which enables users to control and interact with the Xbox 360 without having to use a game controller. Instead, a natural user interface is utilized, along with the user’s body gestures and spoken commands. With the help of sensors, the software enables advanced gesture recognition, facial recognition and voice recognition, allowing gamers to literally transform their bodies into Xbox 360 controllers.

Requiring at least 190 MB of available storage space, the Kinect system software employs breakthrough techniques which can automatically identify users/ players. This exciting software was developed by Rare, a subsidiary of Microsoft Game Studios, and Israeli developer PrimeSense, whose range camera technology interprets 3D scene information from a continuously-projected infrared structured light. The Kinect sensor is a horizontal bar connected to a small base with a motorized tilt mechanism, designed to be positioned lengthwise above or below the video display. The sensor’s most important features are its “RGB camera, depth sensor and multi-array microphone running proprietary software,” which allow the software’s full-body 3D motion capture, facial recognition and voice recognition capabilities.

The sensing range of the depth sensor is adjustable, so the software can also automatically calibrate the sensor based on the player's environment, and accommodate for the presence of physical obstacles like furniture. Kinect is also reportedly able to simultaneously track up to six people at a time, including two active players for motion analysis as well as feature extraction of up to 20 joints per player. PrimarySense has said however that there is really no limit to the number of people the device can "see," as long as they are within the camera’s view.

Unquestionably, a Kinect Robot presents huge and highly exciting possibilities in the field of robotics, even if it was created specifically as an Xbox add-on. Since the software can be used in conjunction with basically any computer system, numerous developers have been researching possible applications of Kinect that go beyond the system's intended purpose of enhanced game play.

In fact, so many people have tried reverse engineering the Kinect software since it came out that Adafruit Industries decided to hold a competition highlighting the new creations. Héctor Martín, who produced a Linux driver that allows the use of both the RGB camera and depth sensitivity functions of the device, was declared the winner.

Other examples of people who have developed Kinect’s technology for a Kinect Robot include Philipp Robbel of MIT, who combined Kinect with the iRobot Create to map a room in 3D while allowing the robot respond to human gestures, and the Robot Locomotion Group at MIT, who have been using the drivers to develop a motion-controller user interface similar to the one envisioned in the film “Minority Report.”

The main feature of the Kinect is that it provides a 640x480 depth map in real time, which can basically indicate which objects are near and which are far in a given scene. This is highly valuable for use in obstacle avoidance and effective navigation in robots. One specific application based on this technology is RoboRealm, which provides computer vision, image analysis, and robotic vision systems through simplified vision programming. It utilizes a simple point and click interface using only an inexpensive USB webcam and any PC. Through Roborealm’s window-based application, robotic projects are able to gain “vision,” allowing it to track colored objects, navigate with obstacle avoidance, identify where it is, among others things.

But while the Kinect provides exciting developments in the field of robotics, it does have some limitations. The depth map is only valid for objects more than 2.5 feet away from the sensing device, for example. So if an object is closer than two feet, its depth will not be detected correctly. Also, because Kinect uses an IR projector with an IR camera (which is a form of stereo vision) it means that the sun’s presence will cause some issues with its functionality. A robot using the Kinect program will have a hard time functioning in sunny areas, although it can navigate perfectly without daylight. (The IR projector provides high resolution images in total darkness). A Kinect Robot would not be able to operate in sunlight.

Still, these setbacks are believed to be quite minor compared to what this super sensor has been able to and can still do. Microsoft’s Kinect has been dubbed the future of gaming, and may well even be the future of Windows, computers and yes, even robotics. As predicted by one enthusiastic reviewer, the biggest pull of Kinect is not what it does now, but what developers may be able to do with it in the future. Virtual reality, anyone?

New! Comments

Have your say about what you just read! Leave me a comment in the box below.

Recent Articles

  1. A. I. Phoboia

    Jul 21, 17 09:20 PM

    AI Phobia is a medical condition that...

    Read More

  2. Romo the Smart Phone Robot - Powered by Your iPhone or Android Device

    May 03, 17 02:07 AM

    Meet Romo the Smart Phone Robot. Peter Seid and Phu Nguyen are the engineers behind Romo, a simple and inexpensive robot kit that can turn a smart phone into a highly functional and mobile droid.

    Read More

  3. Star Wars Robot Chicken

    May 03, 17 01:51 AM

    Star Wars Robot Chicken was an episode of the animated cartoon called Robot Chicken...

    Read More

Robot-Android-Blog  Read our blog about robots, building robots, and easy robot building.

How to Build a Robot How to Build a Robot takes you through each step required to build a robot.

Build an Arduino Robot Yes you CAN! We get you started.

Robot Comics Robot Comics are HERE! We start off our comics with...

Virtual Steve Jobs Virtual Steve Jobs? Steve Jobs is gone and we missed him so much we re-created his essence in software...

The EZ Robot Review The EZ Robot Review. This article reviews the EZ Robot building system, the robot board and system for beginner's robot building.

Medical Robots Medical robots are now showing their silver faces in hospitals and doctors' offices across the world.

Roomba Repair Quick and Simple Fixes for Your iRobot Roomba vacuum

Roomba Batteries How to extend the life of your Roomba's battery. Buy replacement batteries here.

Robot Cars - Yesterday’s Vision, Today’s Reality Are robot cars 'on track' to becoming the way of the future? What issues are at stake at their current level of development?

Robot Car Safety - The Future of Today’s Vehicles

Robot Car Safety can be identified by two main technological components - lacking in human drivers -a (1) instant reaction time and (2) 360-degree awareness of the road.

Educational Robots Learn robotics with these educational robots..

Robot People Robotic replicas of people - robot people - are starting to pop up here and there. We even visit a company who is today making them to order.

Hacking Elvis - The Alive Elvis Animatronic Robot In these articles we show you how to run your Alive Elvis from a microcontroller such as the Arduino and the Basic Stamp. Hacking Elvis...

Wall-e toy robots from Disney Wall-e toy robots are still popular this year

R2D2 Toy Robot : Interactive-Astromech Droid Here's a review of the high-end R2D2 toy robot, the interactive astromech droid.

Toy Robot Dogs Toy Robot dogs: In the robot pet store, you will find toy robot dogs - robomuts if you will - of all sizes, shapes and prices.

Wowwee Robotics Wowwee Robotics has been building toy robots for years.

Lost in Space Toys : The Robot Lost in Space Toys : There have been scores of toys built resembling the Lost in Space Robot, sometimes call by his model number "B9"...

Tribot Robot The tribot robot is one of the most entertaining toy robots that has come from Wowwee...

Terminator Robots Terminator Robots : The Terminator movies and television show brought robots to...

Artificial Intelligence: Our Brain In That Small Chip Artificial Intelligence was once thought of as an impossible feat. Now, with modern advancements in robotic technology, machines can be made to think like humans.

R2D2 - An Adventurous, Resourceful, and Loyal Robot R2D2 demonstrates several notable characteristics every human can learn from, in spite of the fact that he is, a robot. Read his biography here.

Anybots Vistual Assistant Robots - The Coming of Age in Telepresence Robotics Anybots Virtual Assistant Robots are expected to grow in a few years, or perhaps sooner.

BlueBiped: Propelled by it's Own Weight BlueBiped uses no power source to walk. This robot has set a Guinness World Record, walking nonstop for a distance of 15 km (9.32 miles), the longest distance ever walked by a bipedal robot

EZ-Robot May Be the Easiest Way to Build a Robot EZ-Robot May Be the Easiest Way to Build a Robot. The EZ-Robot is a $235 kit that includes everything you need to transform one of your old toys into a functional robot.

Introducing MorpHex, a Spherical Hexapod Robot Introducing MorpHex, a Spherical Hexapod Robot. Imagine a robot shaped like a ball which transforms into a walking six-legged contraption. That’s a description of MorpHex, created by Kare Halvorsen.

Recovering Kids Monitored by Robots After Surgery Recovering Kids Monitored by Robots After Surgery. A Boston, Mass. hospital introduces a sci-fi worthy caregiver system, where patients can go home and stay monitored by robots after surgery.

iCub the "Baby Robot" - Learns to Crawl Like a Baby Have you heard of the iCub? It is a one-meter high android originally developed by the Europe-based RobotCub Consortium. The iCub strongly resembles

Dongbu Robot HOVIS Kits Allow Users to Build An Android Phone Powered Robot Dongbu Robot HOVIS Kits Allow Users to Build An Android Phone Powered Robot

Robots and Androids


Build an Arduino Robot!

Get the ebook.

Only $.99!