GVPP

8 MULTIPLE PERCEPTION
The vision perception processor chip processes motion images in real-time, and is
able to perceive and track objects based on combinations of hue, luminance, speed, direction
of motion and spatial orientation. The chip has three functions: temporal processing, spatial
processing and histogram processing. In applications, the vision processor called generic
visual perception processor (GVPP) is used with a microprocessor, flash memory and
peripherals.
In a case of detection of a driver falling sleep, the processor core detects movement of
the eyelids. First, the driver is identified, and then the microprocessor directs the vision
processor to search within the corner points of a rectangular area in which the nose of the
driver would be expected to be located, based on a model, and to select pixels having
characteristics of the shadows of nostrils. The results are calculated to the end of the image
frame being analyzed, and the microprocessor analyzes the resulting histograms to determine
characteristics indicative of nostrils, such as the spacing and shaping and shape of the
nostrils.
Then, the microprocessor directs the vision processor to isolate a rectangular area in
which the eyes of the driver are expected to be located, based on the model, and to select
pixels having characteristics of high-speed movement normally indicative of blinking. The
microprocessor analyzes over time the histograms taken of the eye area to determine the
duration of each blink and the interval between blinks. From the blink duration and interval
information, the microprocessor is able to determine when the driver is falling asleep and
triggers an alarm accordingly.
The highly parallel internal design of the vision processor allows it to perform over 20
billion instructions per second (BIPS), and the internal three functions play the following
roles. Temporal processing involves the processing of successive frames of an image to
smooth the pixels of the image over time to prevent interference affecting object detection.
Spatial processing involves the processing of pixels within a localized area of the
images to determine the speed and direction of movement of each pixel.

Dept.of CSE,Dr.TTIT,KGF

14

2014-2015

GVPP

MULTIPALE PERCEPTION
The chip is able to detect and track eight objects per frame, meaning 240 objects per

second in a 30 frames/s systems such as TV or high definition TVs (HDTV). The vision
processor includes a total of 23 spatial-temporal neural blocks, each having approximately 20
different input and output connections.
Since processing in each module on the GVPP runs in parallel out of its own memory
space, multiple GVPP chips can be cascaded to expand the number of objects that can be
recognized and tracked. When set in master-slave mode, any number of GVPP chips can
divide and conquer, for instance, complex stereoscopic vision applications.

Dept.of CSE,Dr.TTIT,KGF

15

2014-2015