Sweater-Wrapped Robots Can Feel, React to Human Touch
RobotSweater, developed at Carnegie Mellon University’s Robotics Institute, is a machine-knitted textile “skin” that can sense contact and pressure. Once knitted, the fabric can be used to help the robot “feel” when a human touches it. Current industry solutions for detecting human-robot interaction look like shields and use very rigid materials that can’t cover the robot’s entire body because some parts need to deform. Learn more in this video.
“With RobotSweater, the robot’s whole body can be covered, so it can detect any possible collisions,” said Changliu Liu , an assistant professor of robotics in the School of Computer Science.
Transcript
00:00:00 00:00:04:07 - 00:00:28:06 Changliu Liu I'm Changliu Liu, an assistant professor in the Robotics Institute here at Carnegie Mellon. And my main research area is on robot safety and how to make robots safely and efficiently collaborate with humans in industrial environments. This is the industrial robot that we are currently doing research on. It is from Fanuc. It was usually used in heavy-duty production lines doing something like welding and heavy-duty tasks - 00:00:28:14 - 00:00:43:21 Changliu Liu and usually they're put into the cages. There's a huge shift of emphasis from massive production to massive customization. We also want those robots to be on flexible assembly lines so that they can collaborate with humans to improve efficiency and productivity in the final assembly..
00:00:46 00:00:43:21 - 00:01:03:28 James McCann So one of the cool things about this project is this was a collaborative end to end project where we did knitting design, we did sensor calibration, and we put the whole thing on a robot, and that was all down to three different faculty members and a whole host of different students working together. 00:01:04:06 - 00:01:08:15 Wenzhen Yuan In the tactile sensing community there has been a longstanding demand of having a nice, large scale, tactile skin to cover the very complicated surface of multiple robots. Jim and I worked on designing the sensor, calibrate the sensor, and then we worked with Changliu to optimize the system. 00:01:21:11 - 00:01:27:03 James McCann
00:01:21 Can we take this technology - machine knitting - and use it to make a sensor which is suitable for deployment on robots? 00:01:27:03 - 00:01:33:13 Changliu Liu and make the surface a sensor such that we can sense the contact and the force? 00:01:33:21 - 00:01:53:00 Changliu Liu I was like, Okay, that's a great idea. My robot actually needs that! My student created a very clever way to calibrate the skin with respect to the robot. For each touch will know what location it is on the skin. And also we know what location it is on the robot. Then we kind of map these two things together. And also we can do this similarly for the force calibration. And after that, we can use the skin as a very powerful sensor.
00:01:56 00:01:53:08 - 00:02:14:05 Bo Ying Su Hi I'm Bo Ying Su I'm a Masters ECE student here at CMU. The tactile skin is attached to the robot. It allows us to interact with a robot in a more natural way. The skin is being calibrated to localize the contact and determine the actual force that is applied on the skin. 00:02:14:19 - 00:02:22:03 Bo Ying Su The skin can actually localize where the human contact is, and you can see it gives the location and the pressure. 00:02:22:03 - 00:02:35:11 Changliu Liu We can do this safety modification of the trajectory - whenever there's a touch in one direction, the robot cancels out all the velocity in the other direction,
00:02:31 but still try to best continue to follow the rest of the trajectory. 00:02:35:21 - 00:02:43:28 Wenzhen Yuan There's a large potential of our sensors to correlate not only to industrial robots like Changliu is using, but also the robots in other factories or the robots that work with humans at home, in hospitals, in a warehouse and generally everywhere. 00:02:43:28 - 00:03:03:27 James McCann So this is an example of what can happen when you have people with expertise in the whole robotics pipeline. From the fundamental materials, to electrical design and characterization, modeling, sensing and control. 00:03:04:04 - 00:03:13:25 James McCann
00:03:04 When everybody's working together, you can have these very satisfying projects where you go from a very small idea to really seeing it on an actual robot proving out the idea.