Yu Jiang Tham

Dream it. Build it.

How to Build a Robotic Arm that Tracks Your Hand Movements (Part 1)

This past week, I made a robotic arm that tracks your hand  in free space using a Leap Motion, Arduino, and node.js.  It tracks my hand very well.  It is able to pick up stuff and set it down with relatively good precision, although there is definitely some room for improvement.  I can’t pick up anything too heavy with it (mainly due to the gripper limitations), but it’s a good first try.  See the video below:

I’ve spit this tutorial into two parts.  This part 1 (you are here) deals with building the hardware.  Part 2 deals with the software implementation.  Let’s get started!



I built all of this in the kitchen of my studio apartment in San Francisco.  Unfortunately, I did not have access to any sort of workshop, so I had to use whatever I had lying around.  I ended up ordering a few things from Amazon.  The tools I used are as follows:

Additionally, the materials/components I had to buy to get this thing working are:

I bought a sheet of aluminum (0.025″ thick) and used the ruler and sharpie to figure out the dimensions of the arm.  I then set about cutting the aluminum with the aluminum scissors (be sure to use gloves and eye protection since the aluminum is sharp).  After the cut, The aluminum can be bent by hand, since it’s relatively thin.  Push any corners that aren’t straight against your table to flatten them.  We want to get the piece as flat as possible.


After that, we want to bend the piece of aluminum so that we can have some semblance of an arm section.  We’ll bend the piece twice to get that in place.  To make a sharper bend, use the ruler. Press the aluminum against the table and pull it up against the edge of the ruler.


Align the servo arm holes to the metal and mark the spots where you want to drill holes for the servo arm screw to attach to the aluminum arm section.  Drill holes there.


Before coming up with a design for the servo base attachment plate, you need to see what your servo’s range of motion is.  We want to make sure that at the 90 degree point, the servo arm points up.  The design I came up with is sketched on this piece of paper:


After that, creating the next arm section is similar, except we want to make it shorter and thinner  for two reasons.  One, less weight.  Two, the end effector (gripper) will have some length as well, and we don’t want to have an out-of-proportion arm.  That would look ugly.

The end effector is a relatively simple design that mimics the following design I saw on youtube, except I used aluminum for the joints and paperclips to keep everything in place.  Here’s the youtube video:

I tried using wood, but the pieces were too thin and I split them when I drilled the holes.  Here’s the final end effector that I came up with.  I used plastic spoons because I didn’t have anything else lying around.  Here’s what it looks like after I put it together.


And then the rest of the arm just comes together after some additional drilling of holes and aligning of pieces!  Here’s the final arm (minus the wood board that I used to attach to the base).



That’s that for the hardware! Continue to part 2 where I will go into detail about the software and how to link it to your Leap Motion device.


  1. hey,
    I made a robotic arm in the past much like yours but it was all software controlled (really dumb but you can see the images in my blog). I see you have done and excellent job and given it a new level or intelligence. Good work congrats.
    The one problem I faced was, I didn’t know how to add a free running axle on the back side of servos so as to increase the stability. Anything I did with glue won’t last more than an hour. I was like out of time, so I had to deal with this by placing two servos back to back and giving one servo ‘n’ deg and the other servo ‘180-n’ deg. Could you explain how you managed to solve this?

  2. hello sir
    i want make a robot kindly help me

  3. Amazing!! Last night I also made a little robot that tracks the movements of my hand with an accelerometer and 2 flex sensors. Now I will surely check the leap motion device.l!!

    Video here:http://m.youtube.com/watch?feature=youtu.be&v=mDVJaJGJ814 .

    Greetings from Italy.

  4. hii…ma final yr project s the same…can u post the arm dimensions???

  5. Hi,
    Great project. I have it running on Windows 7 64bit and it works fine.
    I have found after a while it will stop responding and moving your hand away and back doesn’t fix it.
    The running values on the screen look wrong too
    I did see an out of memory message at one stage.
    Any idea’s?

  6. hi.. can you put the diagram of how to connect the servos on the breadboard then then connecting it to the arduino.. thats my only problem it will be very helpful if u put the diagram or a bigger picture of the connections

  7. I love what you guys are up too. This sort of clever work and
    reporting! Keep up the very good works guys I’ve added you
    guys to my blogroll.

  8. need help!!

  9. https://www.socialenvy.co/es/
    I am truⅼy thankful to the holder of thiѕ website
    ԝhо has shared thіs fantastic paragraph aat Һere.

  10. hey,
    I also made a robotic arm using leap motion sensor in my final year project and i use fingers instead of clip or gripper but there is a problem i have program my leap motion using C++ and it doesn’t work so I need your help . How to interface the arduino with Leap motion sensor using C++ .Could you explain how you managed to solve this? I see you have done and excellent job and given it a new level or intelligence. Good work congrats. I am waiting for your kind reply. Thank you.

  11. May you please post the dimensions of the Arm?
    The code has Length= 160 mm. Is that the shoulder or elbow?

    Thank you

Leave a Reply

Your email address will not be published.


© 2018 Yu Jiang Tham

Theme by Anders NorenUp ↑