Smart cameras have been used in industrial applications for roughly two and a half decades, but advances in processor technologies have made the devices much more accessible and popular within the past 7 years, especially in areas such as machine vision and surveillance. However, when the term smart camera is mentioned, a wide variety of ideas still come to mind among individuals because there is no widespread agreement upon the definition of what a smart camera technically is. It is generally agreed upon that the basics of a smart camera include not only the image sensor, but also some type of processing chip: a CPU, DSP, FPGA, or other type of processing device (see Figure 1).

Figure 1. A smart camera typically includes an image sensor, processor, and some type of I/O. Other features can be added, such as direct drive lighting control, industrial I/O, and a display port.

Today, however, even an off-the-shelf, point & shoot digital camera has some type of built-in image processing to remove the red eye effect, conduct facial recognition, apply a filter, or perform another type of image processing. So, if the inclusion of a processor along with an image sensor is not the defining attribute of a smart camera, what makes a smart camera “smart?” The key lies in the output.

Unlike most cameras, the primary output of a smart camera is not an image, but a decision or information. Since the image processing or machine vision algorithm is done directly on the smart camera, the image does not need to be passed onto a PC or another device. Instead, the result of the processing can be passed directly to an operator or another device in the system. For example, a smart camera may be selected for use in an in-line inspection system for a manufacturing line. The output of the smart camera could be a pass/fail report over a network to a database, a digital signal triggering a sorting system, or a serial command to a programmable logic controller (PLC).

A smart camera is a decision maker. Still, if you conduct an internet search for a smart camera, you will receive a large variety of results with very different features and appearance options. Let’s review some essential properties of smart cameras and how they have progressed:

Processor Performance

As previously mentioned, the growing popularity of smart cameras can mainly be attributed to the increase in processor performance over the past decade. A 1 MHz smart camera 15 years ago would have been four times the size and cost of a >1 GHz smart camera of today. Many may be surprised when they realize the processing performance on some smart cameras rival what can be done on PC-based systems. An in-line inspection application, for example, that requires barcode reading, multiple geometric pattern matching, color analysis, line detection, and particle analysis can be done with a yield of over 25 parts per second. Additionally, this type of application can include triggering, lighting control, communication with other devices, and display all within the same compact package. Smart cameras come with a range of available processors, including DSPs, PowerPC-class, and Atom-class. There are also options with a mixed offering, such as a CPU with a DSP co-processor for certain algorithms.

Size

One benefit to using a smart camera is that multiple components of a vision system are integrated into a single package, resulting in a small size and the potential to save a lot of space. The top-of-the-line, high-performance smart cameras keep getting faster without having to affect size, but the devices are also heading further into the low-end market. Reducing the functionality from an all-purpose smart camera to one that is designed for specific algorithms, such as barcode verification/reading and optical character recognition (OCR), reduces the number of components and complexity. With sizes smaller than 55 x 50 mm and weights of less than 60 grams, these types of smart cameras have been significantly growing in market availability.

Image Sensor

Of course, a smart camera is still a camera and must acquire images. Both CMOS and CCD sensors can be found in smart cameras with resolutions of 5 MP, available in both color and monochrome. Smart cameras are not just limited to area scan anymore. Line-scan smart cameras are also available with frequencies over 10 kHz. While smart cameras do not cover the full range of options as normal cameras, they feature some of the most popular sensors.

A key downfall with smart cameras, however, comes when an application requires multiple image sensors connected to the same processing unit. One way to solve the problem is to synchronize multiple smart cameras, but that can add significant cost and complexity. In these cases, it is best to explore alternatives, such as compact vision systems or PC-based systems.

Software

Figure 2. Most smart cameras come with relatively intuitive programming software, reducing the need for an advanced knowledge of programming skills. The program should not only be easy-to-use, but should also be flexible enough to scale to different hardware targets without a complete rewrite.

Most smart cameras today come with relatively simple-to-use software. Advanced knowledge of programming is not required to use the technology, but it is important to keep flexibility and scalability in mind. The investment to learn a new piece of software and write an application should be a somewhat long-term one. That is, the software should scale with application requirements and future projects.

Sensor and processor technologies are advancing rapidly, so the best-case scenario takes place when the smart camera model and software are well integrated, but not exclusive to each other. As a result, if you change smart camera models to a new version or need to move to a different hardware platform, such as a PC or operating system, a complete rewrite of the application or IP should not be required. The operating system running on the camera itself can also be a critical factor as Windows-based smart cameras connected to a plant network may fall under IT restrictions (see Figure 2).

Ruggedness

Figure 3. Smart cameras like the NI 1772 camera from National Instruments have high IP ratings for protection against environmental exposures like dust and water. Higher IP ratings are beneficial for applications in harsh environments, including outdoor monitoring and industrial vision inspection.

The level of ruggedness required is dependent upon the environment in which the smart camera is to be deployed. It is important to note that many applications take place in fairly harsh environments. In food inspection applications, for example, the cleaning process washes all parts on the line, including the camera. Smart cameras are available with an IP rating of at least 67, which offers total protection against dust and submersion in water up to 1 m deep (see Figure 3).

Integration

Those who have completed a vision application know that vision is often part of a much larger system. Since the primary output of a smart camera is a decision, result, or some other information beyond an image, most smart cameras have built-in I/O to communicate or control other devices in the system. With industrial automation, the smart camera may need to control actuators to sort products; communicate inspection results to a robot controller, PLC, or programmable automation controller (PAC); save images and data to network servers; or communicate inspection parameters and results to a local or remote user interface. With USB and display ports, smart cameras can completely replace PC vision systems where an operator interface is required; the parts are integrated in a single device.

Figure 4. Since the primary output of a smart camera is a decision or some type of signal other than an image, many smart cameras include integrated I/O and communication ports: lighting, digital I/O, serial, Ethernet, and USB buses, as well as display ports for user interfaces.

Often, for scientific imaging applications, the vision must integrate with motion stages, data acquisition systems, microscopes, specialized optics, and advanced triggering. As a result, many smart cameras today include I/O such as industrial digital inputs and outputs, encoder inputs for image synchronization, and communication ports.

Models are also available with built-in lighting, however, an integrated light cannot be independently positioned, and the feature is useless if a backlight is used. Built-in light controllers, an available alternative, can modify illumination directly from the smart camera. To effectively communicate to other devices, more and more industrial communication protocols, including DeviceNet, EthernetIP, and serial, are also being supported natively in smart cameras. It is therefore critical to understand how the smart camera will best integrate into an overall system (see Figure 4).

Decision Making

With the capabilities of today’s smart cameras, the adoption of these devices continues to grow, and newer technologies are being integrated that could help accelerate the growth. The devices, for example, are moving into the 3D vision space by providing solutions with multiple image sensors integrated into stereoscope or laser triangulation packages. These days, smart cameras can come in all shapes, sizes, and performance levels, but there is still one attribute that still defines them as smart cameras: the ability to perform image processing and make decisions directly on the camera. It is the decision making that makes a camera smart, and with the potential cost savings, ease of integration, and increasing performance, smart cameras are a cutting-edge option for many vision applications.

This article was written by Carlton Heard, Product Engineer – Vision Hardware and Software, at National Instruments (Austin, TX). For more information, Click Here .


Imaging Technology Magazine

This article first appeared in the June, 2014 issue of Imaging Technology Magazine.

Read more articles from this issue here.

Read more articles from the archives here.