2069 TD - lineScanApp Whitepaper.v4
2069 TD - lineScanApp Whitepaper.v4
2069 TD - lineScanApp Whitepaper.v4
Understanding Line Scan Camera A single, 16,000 pixel line scan camera is a much better
solution. One camera now spans across the material and
Applications there are no defective pixels. The rotary encoder output
triggers the acquisition of each line of the image. Line
Discover the benefits of line scan cameras, exposure time is short to avoid motion blur, but now the
including perfect, high resolution images, and illumination can be focused into a line, rather than being
the ability to image large objects. spread out over a frame, to get an acceptable image. A Time
Delay and Integration (TDI) line scan camera has rows of
A line scan camera has a single line of pixels that image pixels that integrate exposures in synchrony with the material
across an object. To build up a two-dimensional image of the movement, thus multiplying the effective exposure time by
object, either the camera or object is moved perpendicular the number of rows of pixels. Last, the gain and offset of each
to the line of pixels. This might seem like a complicated way pixel can be adjusted to give a uniform response over the line
to image an object compared with frame cameras that of pixels, and these adjustments are done in the line scan
take two-dimensional images (a frame). However, when cameras hardware.
the object is large, continuously moving, or the task needs
perfect or high resolution imaging, a line scan camera is When to Use Line Scan Technology
often a much better choice than a frame camera.
Line scan technology is ideally suited to applications in
which large, high-resolution, or high-speed image capture
is needed, such as in a continuous web applicationpaper,
textiles, metal, or glass tape, for exampleor for railway and
road inspection, or for satellite imaging or surface topography
scanning. Line scan technology works well with free-falling
products, including molten glass and steel or postal sorting.
Line scan is required for tasks such as inspection of silicon
Suppose a machine vision system is to inspect long rolls of wafers, flat panel displays, solar cells, printed circuit boards,
material, such as paper or plastic, for defects. A resolution medical diagnostics and other tasks that require large, defect-
of 16,000 pixels across the material is needed to detect free images.
these defects. The material is unrolled under the camera
and the materials speed is measured by a rotary encoder Line scan cameras are better than frame cameras when the
connected to the unrolling mechanism. product speed is high, because you can compensate for
short exposure times by using concentrated illumination and
You could use four large-format frame cameras mounted Time Delay and Integration (TDI) to increase the photons
side-by-side across the web of material, but this has a harvested by the camera. A line scan camera does gain and
number of disadvantages. First, large-format frame cameras offset correction in the camera, while an area scan camera
usually have defective pixels that are hidden by filling uses the vision systems CPU to compute this correction and
in a pixel value from neighboring pixels. This can hide so is much slower.
the defects you are trying to detect. Second, the frame
cameras exposure time must be short to prevent blurring
due to the materials motion. A short exposure requires
high intensity lighting over the entire imaged area to get
an acceptable image. The rotary encoder output triggers
synchronous image acquisition for all cameras. Last,
removing offset and gain variations in pixel responses
necessary to detect low contrast defects is time
consuming with frame cameras.
continued >
1 Property of Teledyne DALSA. Not for publication or reproduction without permission.
How Line Scan Images are Formed Line Scan Acquisition Interfaces
A line scan sensor has one or more lines of pixel sensors. The pixel data from the camera are transmitted to a
During the cameras exposure time each pixel accumulates vision processor or to a frame grabber for processing.
photoelectric charges proportional to the light from the Teledyne DALSA provides cameras with three types of data
object imaged onto that pixel. At the end of the exposure transmission interfaces.
time the charges in an entire row of pixels are transferred
into a readout register. The readout register shifts out the Gigabit Ethernet (GigE) can be used for data rates up to about
pixel charges and they are amplified, corrected and digitized 80 Megabytes per second (MB/s). A standard GigE interface
to produce the camera output. The readout register shifting receives the camera data at the vision processor. This
is done while the next row of pixels is being exposed. The interface is used on Teledyne DALSAs GEVA (GigE Vision
maximum rate at which exposure and readout can occur is Appliance) vision processors.
called the line rate and is specified in kilohertz (kHz).
CameraLink interfaces use a frame grabber to receive the data
and have one of three formats. The Base format transmits 255
MB/s using a single cable. The Medium format is 510 MB/s
and the Full format transmits 680 MB/s, using two cables.
continued >
2 Property of Teledyne DALSA. Not for publication or reproduction without permission.
The shifting and summing is driven by the objects movement Lenses for color line scan cameras must be color corrected so
rate, usually signaled by pulses from a motion encoder. TDI they do not have significant chromatic aberration. Chromatic
cameras effectively multiply the exposure time by the number aberration occurs when a lens doesnt focus light of different
of rows of pixels and so can provide high-contrast images wavelengths onto the same focal plane, and appears as color
even when exposure time is short. Another way to look at this fringes around intensity edges.
is that lines of pixels are electronically moved in synchrony
with the movement of the object being imaged and so the If the camera views an object at an angle off of the normal
exposure time is increased without causing additional blurring (the perpendicular to the objects surface), there can be some
due to the objects motion. perspective distortion. Perspective distortion is proportional
to 1/distance to the object, and so is slightly different for the
Note that the cameras exposure time is independent of the different color rows of pixels. So each row of pixels has a
line rate except that the exposure time should be less than the slightly different size and shape of pixel as projected on the
inverse of the line rate (seconds per line). objects surface, and this can cause errors in high-accuracy
color measurements. Make sure the camera is perpendicular
Color Line Scan Cameras to the surface of the object a good idea even if you are not
using color.
Color line scan cameras have rows of sensor pixels with
different color filters or different color filters on pixels along the Lighting for Line Scan Cameras
row, to detect light of different wavelengths. Typically filters are
what we perceive as red, green, and blue (RGB), but some You need light to see objects, and lighting and optics act
applications, such as satellite remote sensing, use more and as optical processors to enhance an objects interesting
different filter types. features. Line scan cameras typically use a line light,
focused light from a line of LEDs, to illuminate the object
along the line of object pixels being viewed. Line lights give
high intensity illumination needed for short exposure times
(fast camera line rates). Line lights can be butted together to
give very long lights for viewing wide objects.
Trilinear sensor pixels with Red, Green, Blue filters per line
continued >
3 Property of Teledyne DALSA. Not for publication or reproduction without permission.
The light intensity depends on the LEDs used, power flowing You could use an 8K (8,192 pixel) line scan camera, or two 4K
through the light, age and quality of the lamps, and the (4096 pixel) line scan cameras side-by-side with some overlap
efficiency of the lens. These variables make it difficult to in their horizontal fields of view.
specify a light with just the right amount of intensity so, to
be safe, we often specify more illumination intensity than we Line Rate
might need.
The line rate is set by the FOV, part speed, and object pixel
size. For example, if the FOV is 12, the part speed is 60
How to Select the Right Line Scan Camera per second, and you are using an 8K (8,192 sensor pixels)
for Your Application camera, then:
Three important considerations when choosing a line scan (Object pixel size in the FOV) = FOV/(camera size in sensor
camera are: sensitivity, size (in sensor pixels), and line rate. pixels) =
12/8192 = 0.001465 object pixel size in the FOV
Sensitivity Line rate needed: 60/0.001465 = 40.956 kHz
Sensitivity asks, Is the camera getting enough photons You might use a Teledyne DALSA Piranha4 70 kHz camera.
to perform the machine vision task? It is usually difficult to
answer this question only from component specifications, Optics for Line Scan Cameras
as there are too many variables. In practice we estimate the
light intensity needed, specify more light intensity than our The lens gathers light from the object to improve sensitivity
estimate, and then verify that we have the required sensitivity and magnifies (or minifies) the FOV to match the size of the
by testing. Here are some of the variables: cameras line sensor.
First, as mentioned, the light intensity depends on many You can compute the magnification as:
different variables.
Magnification = (camera pixel size in microns)/(FOV object
Second, the lens optics reduces the light to the camera. This pixel size)
reduction can be significant for high magnification lenses or In the above example, using the Piranha4 camera, this would
when the lens is stopped down to get more depth of field. be:
Magnification = (7.04 microns) / (37.211 = 0.001465 inches
Third, sensitivity depends on the response of the camera
converted to microns) = 0.189
its ability to convert photons to photoelectrons. For increased
sensitivity, you can use a camera with larger sensor pixels. So a reduction in size of 1/0.188 = 5.286 from the real world
Line scan cameras have 100% fill factor, the percent of the FOV to the cameras line sensor. This ratio (5.286 in this
sensor pixel that accumulates photons. Area scan cameras example) is the inverse magnification.
usually have smaller pixels and lower fill factors, and make
up for this loss in response by requiring longer exposure Next, you must specify a working distance, the distance
times. Finally, a TDI line scan camera can be used to increase from the cameras face plate (the front, flat surface of the
exposure time by electronically moving the cameras sensor camera) to the object being imaged (for example, the web
lines with the object. material). From this you can get the focal length of the lens
required:
Size (in sensor pixels)
Focal Length = (working distance) / (inverse magnification + 1)
To determine camera size (in sensor pixels) you need to
In this example, a working distance of 314.28 mm = 12.37
specify field of view (FOV) and minimum defect size. The
inches is chosen to give a focal length of 50 mm, which is
camera should have enough resolution to have at least 3 or 4
a standard focal length for lenses. The working distance is
pixels covering the minimum defect size. If, for example, the
usually adjusted to match a standard lens focal length.
FOV is 12 and the minimum defect size is 0.005, then:
Besides the focal length, you will need to know the lens or the encoder inputs on a Teledyne DALSA Xcelera frame
mounting type. Smaller line scan cameras, up to 2,048 pixels grabber to divide (really, count-down) the encoder pulses by
in some cases, can use a C-mount lens with a 1 aperture. a factor of 2. Or you could pick an encoder with 2048 pulses
For longer line scan sensors an F-Mount, M42 or M72 mount per revolution. Either would give:
lens is required.
Distance per pulse = 2 * 0.007324 = 0.0014648 inches
This is too small a distance by about a factor of 2. If the roller Pixel response after gain and offset correction
circumference is fixed, you could use a PLCs axis inputs
continued >
5 Property of Teledyne DALSA. Not for publication or reproduction without permission.
Line Scan Cameras at Work With a continuous web application, there is no way to
immediately reject a defect; the web is moving too fast to
Here are two real world applications of line scan cameras. stop the process. Instead, a roll map records and describes
the position and type of defects. This screen shot shows the
Multiple Camera Web Inspection portion of the roll map made by camera 5:
This shows a real-time view (on the left). The roll map, on the
right, the y axis identifies linear footage (in roller revolutions)
and the x axis shows the defect position. When the product
roll is sent for finishing, defects can be picked out as the
product is unwound.
continued >
6 Property of Teledyne DALSA. Not for publication or reproduction without permission.
www.teledynedalsa.com