Select Topics

Posts by Tag

See all

Latest Blog Post

Two-arm teleoperation robot with Kinect and electric grippers

Guillaume Robert
by Guillaume Robert. Last updated on May 05, 2016 5:10 PM
Posted on Mar 19, 2013 11:31 AM. 2 min read time

Maybe some of you have seen the following video from the guys at Rensselaer Polytechnic Institute (RPI) where a robot replicates the movements of somebody by using Kinect. It was very interesting to see how a Kinect could perform on an industrial robot.

Today, guys from this robotics research lab are going a step further by integrating a Kinect, electric grippers, force/torque sensors and Firewire cameras to do teleoperation through motion detection. The robot uses vision and Alvar tags to align with the surfaces of the box, then applies squeeze control (using position accommodation) for a secure grasp. The user stands in front of the Kinect (with simulation and Kinect skeletal command shown) to provide motion input to the box. The robot autonomously applies the required force to prevent the box from falling.

Robot raconteur kinect RPI web

The key of this integration is the Robot Raconteur (RR). Robot Raconteur is an open-source project intended to provide a solution to distributed control and component interfaces. It is precisely designed for the scenario of an engineer wanting to control a component from a high level language (refer to this blog post to learn more about Robot Raconteur). So this team of researchers has built a RR service for the Motoman High Speed Controller to handle its peripherals. Here is the overall architecture:

Robot raconteur RPI web

Using Kinect frees users from all the constraints related to mechanical interfaces, such as a joystick, keyboard, etc. It is much more natural and intuitive that way.

Laws for control have also been implemented to make sure the box doesn't slip or fall. The arms "squeeze" the box with 10N force towards each other (the other degrees of freedom are under position control). Since the robot position is the only command, the robot's position accommodation control can be used to emulate a generalized damper (essentially integral force feedback).  The robot motion is also limited to avoid excessive motion induced force from causing the robot to lose its grip.

To learn more about other research projects which include our electric grippers visit our research webpage.


GET THE EBOOK: Electric Robot Gripper Advantages

Leave a comment

Guillaume Robert
Written by Guillaume Robert
Connect with the writer:

Related posts

What's New In Robotics?  07.12.2018

-UR celebrates 10 years since 1st sale-China robot production data -World's first automated ferry -Hello Bennu-Elowan the...

Emmet Cole
By Emmet Cole - December 7, 2018
Demo Week Highlights

What's trending on DoF this week? Demo week kick-off, circle move looped twice, security planes, use of Arduino to control...

Amanda Lee
By Amanda Lee - February 9, 2017
Trending on DoF This Week - Nov. 17

What's trending on DoF this week? Using one snapshot position to sort multiple parts, sampling rate for polishing, Revtech...

Amanda Lee
By Amanda Lee - November 17, 2016