
Robot hand recognises object by touch
The robot hand by engineers from the University of California can feel, grasp and manipulate objects. āRobbie, could you screw in that LED for me please?ā
The ability to grasp things is essential for a wide range of robots. For industrial robots, this is done directly using suction cups or grippers that are completely fine-tuned to the often sturdy product to be grasped. Grippers with a more subtle grasp are now available, for plucking peppers, for instance. These robots don't crush the peppers to pulp because the āfingersā of their robot hand adapt the pressure accordingly. This is mostly done using pressure sensors in the motors that drive the fingers.
However, the engineers at the University of California opted for a different approach: they made the āfingersā of the gripper from soft material and gave them āhaptic nervesā, as you can read about in This soft robotic gripper can screw in your light bulbs for you. These sensors serve different functions:
- When the āfingersā feel for the object, the sensors register the shape taken by the āfingersā. The robot is thus able to form a picture of the object, without having to use a camera with image recognition.
- This enables the robot to create a point cloud to recognise the object, sensing āthis is a light bulbā, for instance.

- Once the robot has recognised the light bulb, then it knows that the surface is made of glass, and adjusts the pressure of the grip from the āfingersā on the object, with the pressure sensors in the āfinger tipsā providing information about the pressure applied by the āfingersā. This means the light bulb can be gripped sturdily enough without breaking the glass.
- The gripper is then able to rotate the light bulb one turn, return the āfingersā to their original position and once again turn the light bulb one rotation, a complex action for a robot hand.
The āfingersā are made of an elastic silicone, with each one comprising three sealed chambers operated with compressed air. The construction is kept as simple as possible, and enables each āfingerā to make all possible movements. The benefit of soft āfingersā versus stiff metal is that the soft āfingerā is much better able to feel objects.

Three āfingersā together form the robot gripper, and movement has been coordinated in such a way that they can carry out various actions, such as undoing bottle tops, tightening a screw with a screwdriver, picking up a box or an object with a complex shape like a pair of spectacles.
The sensors in the āfingersā are incorporated in the outer layer of one of the air chambers of the āfingerā, at the point at which it touches an object. A strain sensor registers how far the āfingerā bends, and a pressure sensor, the force with which the āfingerā grips the object.

This means that the robot gripper is able to feel the object, generate a 3D-model of it, recognise the object and adapt its gripping action as necessary. It doesn't yet work perfectly: the variety of objects that the gripper can cope with is still limited, the robot hand can only twist objects along a fixed axis and would need a second āhandā to become entirely autonomous. What's more, the robot hand doesnāt yet know how many times an object has been rotated.
Other systems have also been created to give the āfingersā of a robot hand the ability to feel, by fitting them with optical fibres, for instance.
Did you like this article? Subscribe to our weekly newsletter.