MT9V124 CONFIDENTIAL AND PROPRIETARY
NOT FOR PUBLIC RELEASE
www.onsemi.com
11
Image Corrections
Image stream processing starts with multiplication of all
pixel values by a programmable digital gain. This can be
independently set to separate values for each color channel
(R, Gr, Gb, B). Independent color channel digital gain can
be adjusted with variables.
Lenses tend to produce images whose brightness is
significantly attenuated near the edges. There are also other
factors causing fixed pattern signal gradients in images
captured by image sensors. The cumulative result of all these
factors is known as image shading. The MT9V124 has an
embedded shading correction module that can be
programmed to counter the shading effects on each
individual R, Gb, Gr, and B color signal.
The IFP performs continuous defect correction that can
mask pixel array defects such as high dark-current (hot)
pixels and pixels that are darker or brighter than their
neighbors due to photoresponse nonuniformity. The module
is edge-aware with exposure that is based on configurable
thresholds. The thresholds are changed continuously based
on the brightness of the current scene. Enabling and
disabling noise reduction, and setting thresholds can be
defined through variable settings.
Color Interpolation and Edge Detection
In the raw data stream fed by the sensor core to the IFP,
each pixel is represented by a 10-bit integer, which can be
considered proportional to the pixel’s response to a
one-color light stimulus, red, green, or blue, depending on
the pixel’s position under the color filter array. Initial data
processing steps, up to and including the defect correction,
preserve the one-color-per-pixel nature of the data stream,
but after the defect correction it must be converted to a
three-colors-per-pixel stream appropriate for standard color
processing. The conversion is done by an edge-sensitive
color interpolation module. The module adds the incomplete
color information available for each pixel with information
extracted from an appropriate set of neighboring pixels. The
algorithm used to select this set and extract the information
seeks the best compromise between preserving edges and
filtering out high-frequency noise in flat field areas. The
edge threshold can be set through variable settings.
Color Correction and Aperture Correction
To achieve good color fidelity of the IFP output,
interpolated RGB values of all pixels are subjected to color
correction. The IFP multiplies each vector of three pixel
colors by a 3 ×3 color correction matrix. The color
correction matrix can either be programmed by the user or
automatically selected by the AWB algorithm implemented
in the IFP. Color correction should ideally produce output
colors that are independent of the spectral sensitivity and
color crosstalk characteristics of the image sensor. The
optimal values of the color correction matrix elements
depend on those sensor characteristics. The color correction
variables can be adjusted through variable settings.
To increase image sharpness, a programmable 2D
aperture correction (sharpening filter) is applied to
color-corrected image data. The gain and threshold for 2D
correction can be defined through variable settings.
Gamma Correction
The gamma correction curve (as shown in Figure 13) is
implemented as a piecewise linear function with 19 knee
points, taking 12-bit arguments and mapping them to 8-bit
output. The abscissas of the knee points are fixed at 0, 64,
128, 256, 512, 768, 1024, 1280, 1536, 1792, 2048, 2304,
2560, 2816, 3072, 3328, 3584, 3840, and 4096.
The MT9V124 IFP includes a block for gamma correction
that has the capability to adjust its shape, based on
brightness, to enhance the performance under certain
lighting conditions. Two custom gamma correction tables
may be uploaded, one corresponding to a brighter lighting
condition, the other one corresponding to a darker lighting
condition. The final gamma correction table used depends
on the brightness of the scene and can take the form of either
uploaded tables or an interpolated version of the two tables.
A single (non-adjusting) table for all conditions can also be
used.
Figure 13. Gamma Correction Curve
amma
orrection
0
50
100
150
200
250
300
0 1000 2000 3000 4000
Input RGB, 12−bit
Output RGB, 8−bit
0.45
Special effects like negative image, sepia, or B/W can be
applied to the data stream at this point. These effects can be
enabled and selected by registers.
To remove high- or low-light color artifacts, a color kill
circuit is included. It affects only pixels whose luminance
exceeds a certain preprogrammed threshold. The U and V
values of those pixels are attenuated proportionally to the
difference between their luminance and the threshold.
Image Scaling and Cropping
To ensure that the size of images output by the MT9V124
can be tailored to the needs of all users, the IFP includes a
scaler module. When enabled, this module performs
rescaling of incoming images-shrinks them to selected
width and height without reducing the field of view and
without discarding any pixel values. The scaler ratios are
computed from image output size and the FOV. The scaled