Robot Eyes Can Capture Real-Time, Accurate 3D Video

Watch this video to learn more about "Robot Eyes," the creation of a bespoke micro-structured optical element that, when partnered with a high-speed projector and camera, allows robots to capture the 3D shape of moving objects 100 times faster than current commercial systems.

“Our systems are based on the principle of projecting structured light onto the object surface, with the surface profile distorting those patterns," said Senior Research Associate in Optical Metrology, Dr Russ Coggrave  . "The images we then capture from those distorted patterns allow us to decode and extract the 3D shape of the surface."



Transcript

00:00:02 so what we've done at laf was combined our experience in cohering Optics and interferometry we developed a special element which is a bspoke nanop patterned piece of glass that can be placed in front of the projection Optics of the system and if you combine that with high-speed camera that allows you to measure moving objects Dynamic [Music]

00:00:25 scenes our systems are based on the principle of projecting structured light on to the object surface and the surface profile distorts those patterns we capture images of those distorted patterns and from that we can decode and extract the three-dimensional shape of the surface so this is a very well established technique and it's been widely used and adopted in industrial

00:00:46 Metrology for precision coordinate measuring of high value engineering components but existing systems are relatively slow so are only applicable to static objects or objects that are slow moving the new technology that we've been working on allows us to increase the acquisition rate capturing almost 100 million coordinates per second almost

00:01:08 100 times faster than existing systems and that allows us to measure moving objects and opens up opportunities for robotic applications and many other engineering [Music] challenges so if we think in terms of robotic assisted surgery so currently you have that the surgeon controls the robot and there are different mechanisms

00:01:29 to give the surgeon feedback but you could imagine a robot that has this 3D Vision and that would give it awareness and understanding of where the object is where the organ where the beating heart is and guide the for example the position of the tool the scalpel and register to the shape of the heart and follow that and track in real time one of the challenges with electric

00:01:53 car batteries is what we do with them at the end of life can we recycle the materials and bring them back into the production line and as the robot disassembles the object it changes shape that's a challenge for the current robotic systems which assume that the battery is a rigid body this new 3D high-speed Vision system will provide closed loop feedback to the robot and

00:02:15 allow it to react to changes in the assembly it's great to see that lfro has been at the heart of the development of this technology as I said and it's a really a combination of experiencing structure light techniques for 3D shape measurement and coherent Optics which is interferometry laser based techniques so merging the experience that we had lfro we were able to develop the key element

00:02:39 that enables the the technology really the accelerator that special piece of glass the optical engineering research group here at L university has a long history in developing leading technology we have a strong Legacy in delivering 3D Optical Metrology systems and this is simply another example that can deliver real impact to UK K Manufacturing