Documente Academic
Documente Profesional
Documente Cultură
00
AUTOMOTIVE
COMMUNICATIONS
TABLE OF CONTENTS
CHAPTER 1: INTRODUCTION TO VEHICLE ELECTRONICS COMMUNICATIONS SYSTEMS........2
CHAPTER 2: WIRED IN-VEHICLE NETWORKING .................................................................5
CHAPTER 3: ADVANCED DRIVER ASSISTANCE SYSTEMS (ADAS)..........................................7
CHAPTER 4: VEHICLE COMMUNICATIONS TECHNOLOGY (V2X)........................................11
CHAPTER 5: VEHICLE RADAR..........................................................................................14
CHAPTER 6: LIGHT DETECTING AND RANGING (LIDAR)....................................................18
CHAPTER 7: SELF-DRIVING CARS....................................................................................20
MORE RESOURCES FROM ELECTRONIC DESIGN.............................................23
1 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 1:
INTRODUCTION TO
VEHICLE ELECTRONICS
COMMUNICATIONS
SYSTEMS
T
oday’s automobile has become a mobile platform It should come as no surprise, then, that wired networks
loaded with electrical and electronic systems. Over and wireless communications are playing an increasingly major
the decades, these systems have morphed from a role in automobiles. This chapter takes a look at the scope of
battery for the headlights and tail lights to subsys- communications systems currently in use and those in the
tems of electronic controls that vehicles depend on pipeline, as well as the benefits they offer.
for safety and economy.
Electrical Systems Overview
The basic automotive electrical
system begins with the power
source and its basic electrical
applications. Take a look at these
electrical components, many of
which involve motors:
• Battery (12 V)
• Alternator, battery charger
• Starter motor
• Horn
• Windshield wipers
• Power windows
• Door locks
• Power seats
• Headlights
• Tail lights
• Mirrors
• Interior lights
• 12-V lighter outlets
• USB charger outlets
• Moon roofs
• Convertible tops
2 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 1: INTRODUCTION
Electronic Subsystems Overview Various other features are often integrated, too, such as
Today’s main electronic subsystems include: communications technologies like video cameras. Radar and
ultrasonic sensors implement and automate all of these functions
• Ignition • Stability control and warning systems. Chapter 3 provides more detail.
• Fuel injection • Dashboard
• Engine control • Transmission Telematics
• Antilock braking • Backup camera Telematics is an automotive-related technology that employs
communications techniques for sending data to and from vehicles,
Each of these subsystems has at least one or more dedicated or for using satellite navigation systems like GPS for vehicle
microcontrollers. Furthermore, many of these subsystems need locations services. Different forms of telematics are integrated
to talk to one another. This has led to the development and into consumer vehicles and commercial vehicles like trucks and
deployment of electronic communications buses or networks. trailers.
Most vehicles have multiple buses. Most consumer vehicle manufacturers offer some form of
telematics accessory. The oldest and most widely adopted is GM’s
Communications Subsystems OnStar. It consists of a GPS receiver to provide location data to an
Now examine the many current communications subsystems: embedded cellular modem; the modem connects through local
cellular service with a central OnStar server, as well as human
• Entertainment – Adaptive cruise control operators on standby.
– AM radio – Lane departure warning Typical services offered include automatic collision notification,
– FM radio – Automatic braking emergency roadside service, diagnostics reporting, navigation
– Satellite radio (Sirius XM) – Blindspot detection help, and a wide range of other features. The cost varies, but is
– HD radio • LIDAR—laser-based radar typically in the $20-$40 per month range. Most other vehicle
– CD/DVD player to provide improved coverage manufacturers offer something similar.
– Video monitors surrounding the vehicle. Commercial vehicle telematics is used with trucks and fleet
• Navigation, GPS receiver • Video cameras to detect vehicles to keep track of their location, performance, and
• Wi-Fi hot spot with LTE vehicles, persons, and other operational condition. Fleet management involves the collection
cellular link obstacles in the surrounding of data remotely from trucks or other vehicles, and applying that
• Bluetooth, hands-free area. information into how the vehicles are used.
• Convenience • Wired networking buses or A telematics system employs a cellular link along with GPS to
– Tire-pressure monitor networks, some for monitoring report on location. However, sensors in the system can collect data
– Gate and garage-door and control, others for data. like speed, hours of operation, fuel usage, driver performance,
openers Chapter 2 provides more and diagnostics. The telematics system provides the data so that
– Remote keyless entry detail on these widely adopted companies can improve operating efficiency, productivity, vehicle
– Remote start/disable networks. scheduling, driver management, maintenance needs, and location
• Radar as used in advanced – Onboard-diagnostic tracking. Such systems are also used on the trailers and cargo
driver assistance systems (OBD) bus containers that trucks haul.
(ADAS) – Ethernet The core of a telematics system is the GPS receiver and cellular
3 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 1: INTRODUCTION
4 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 2:
WIRED IN-VEHICLE
NETWORKING
V
ehicles typically feature a large amount of electronic Data rates for ODB II, which is connected via a multiwire cable,
devices that must talk to one another. With so many range from 10 to 41.6 kb/s, depending on the version. Data format
devices, there’s only way to overcome the inherent is usually a UART type that sends data one byte at a time with start
interconnection wiring complexity: Use a network. and stop bits. A CAN version is available to support data rates of
Networks leverage efficient topologies that make 250 or 500 kb/s. Multiple signaling protocols have been developed,
the interconnections simpler and more organized. depending on the auto manufacturer. These include SAE J1850
While networks can handle hundreds, even thousands, of nodes, PWM, SAE J1850 VPW, ISO 9141-2, ISO 14239 KWP2000, and
the communications needs of these various nodes vary widely, so it is ISO 15765 CAN. Multiple standards also apply.
prudent to use networks that best fit the devices and the application.
Modern vehicles incorporate multiple networks that connect the LIN
various devices as needed and manage the communications. The simplest bus in the vehicle is the local interconnect network
This chapter covers in-vehicle networking (IVN). It summarizes (LIN). It’s used by a variety of non-critical sensors and actuators,
the most widely used wired networks—ODB II, LIN, CAN, FlexRay, such as those used for power windows, seats, mirrors, switches, A/C
Ethernet, and MOST—and how they’re deployed. heating, and others. The connection is a single-wire bus with chassis
ground. Its networking format is a master-slave arrangement that
Vehicle Networking Overview can accommodate up to 16 slaves. Data rate reaches 19.2 kb/s up
The modern vehicle employs multiple wired networks to to 40 feet. The data format is similar to UART with a byte of data
implement communications between sensors, actuators, and transmitted with start and stop bits. LIN is sometimes used as a
controllers. The choice of network is dictated by the nature of the sub-bus to CAN.
devices involved, their degree of simplicity or complexity,
and need for speed of operation.
These network types have been standardized for years; 1G
ETHERNET
virtually all auto manufacturers have agreed on the
150M
topologies and other features to handle various needs.
Figure 2-1 shows the relative cost per node for these
100M MOST
networks, and their speed of operation.
DATA RATE (b/s)
ETHERNET
As for the networking medium, ODB II and LIN use
10M
a single wire with chassis ground. CAN, FlexRay, and FLEXRAY
Ethernet opt for shielded or unshielded twisted pair. The 1M
MOST network relies on optical fiber. CAN (HS)
2-1. These wired networks are
OBD II CAN (FT) the most prevalent in modern
The earliest auto bus was the on-board diagnostics bus 100k vehicles. The illustration
introduced in the 1970s. Its second-generation version OBD II LIN shows data rate with relation
monitors multiple points in the vehicle and can provide 10k to cost per node.
diagnostic codes to a service technician who plugs into
the port. COST/NODE
5 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 2: WIRED IN-VEHICLE NETWORKING
CAN/LIN
infotainment systems. It employs a
CAN
6 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 3:
ADVANCED DRIVER
ASSISTANCE
SYSTEMS
A
dvanced driver assistance systems (ADAS) are automatic control of steering or brakes to prevent an accident.
electronic vehicle subsystems that provide a wide Active systems prevent accidents if the driver does not act fast
range of features that improve driving safety. These enough or at all.
systems use communications technology in the There is a major group of ADAS units widely deployed in
form of radar, video cameras, lasers, and ultrason- modern vehicles, consisting of backup cameras, lane departure
ic sensors to detect obstacles and road markings, warning, blind spot detection, automatic braking, adaptive cruise
helping the driver to avoid collisions and maintain the overall con- control and automatic parking.
trol of the vehicle. The goal of ADAS is to help reduce the number Backup cameras. These have been around for some years now
of vehicle deaths and accidents. According to government data, and are widely accepted as a key safety technology. A rear-facing
nearly 40,000 deaths occur each year in the U.S. along with mil- video camera provides an image to a dash-mounted LCD display
lions of accidents. ADAS systems should significantly reduce these that shows a complete wide angle view of the area behind the
figures in the coming years as more vehicles include them. vehicle. It takes the place of rear view mirrors and driver head-
Today, ADAS are available in most new cars either as standard turns. It has proven to be a great feature. Most of the newer
equipment or as an add-on. The government may mandate systems include some form of audible warning if another vehicle,
inclusion of ADAS in vehicles at some point, but current data person, or object is detected. Even more advanced systems provide
shows that consumers are readily adopting these extra-cost safety automatic braking if driver action is not taken in a given time. The
systems. This chapter offers a brief overview of
ADAS technology. OUTPUTS
VIDEO
ENGINE
Standard ADAS Features CAMERAS
DECISION PROCESSING
FUSION PROCESSING
VISION PROCESSING
7 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 3: ADVANCED DRIVER ASSISTED SYSTEMS
8 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 3: ADVANCED DRIVER ASSISTED SYSTEMS
Then knowing the speed of light and radio waves, the system LIDAR. This is the designation for light detecting and ranging.
can determine the distance to the object. Most radars can also This radar-like systems uses infrared light from a laser and seeks
determine direction, object speed, and relative size. reflections on its IR sensors. Lasers can provide greater detail
Most automotive radars are single-chip 77 GHz transceivers because of the shorter wavelength of light. As with radar, these
that use continuous wave (CW) rather than pulse modulation. sensors may be mounted in the rear view mirror, side mirrors,
These may be mounted in the rear view mirror, side mirrors, and and front and rear bumpers. More detail is provided in Chapter 5.
front and rear bumpers. See Chapter 4 for more radar details. Video cameras. Video cams have been around for decades and
9 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 3: ADVANCED DRIVER ASSISTED SYSTEMS
provide more detail than ever thanks to high-resolution sensors. infrastructure (V2I) systems that have yet to be implemented.
The benefits are low cost, color recognition, and wide field of The V2V systems will provide short-range links between nearby
view. Machine vision software, which has been developed and vehicles as they exchange location, speed, direction, and other
improved over the years (mainly in manufacturing) provides data that can actively prevent accidents. The V2I systems will link
accurate object recognition. You will find these sensors mounted nearby vehicles to roadside stations that will give information on
in the rear view mirror, side mirrors or front and rear bumpers. traffic, weather, roadwork, and other data that will assist drivers.
Figure 3-2 shows the general coverage areas of video cameras in More details on these systems are provided in Chapter 4.
typical ADAS-equipped vehicles.
Ultrasound. Ultrasound is another radar-like systems that Critical Issues
uses ultrasonic signals in the 40 kHz to 70 kHz range to provide As ADAS systems are improved and evaluated, no doubt they
distance measurement. The sensors are usually of the piezoelectric will be required by federal regulations. It is likely that significant
type, with 58kHz a common frequency. These sensors are highly benefits will result. A key issue is getting consumer buy-in and
accurate in distance measurements, but only over a short range. usage. That will no doubt occur over time. However, most drivers
They are used mainly in parking assist and blind spot detection must be trained in the usage of these systems if they are to be
systems. effective. The presence and use of ADAS depend upon driver
Processors. ADAS requires significant processing capability knowledge of how it works and what it does. Manufacturers must
to handle the sensor inputs and provide the identification and deliver clear and simple instructions and documentation that
decision-making capability. Again, refer to Fig. 3-1. A typical inform and teach ADAS deployment. Learning and adapting to
arrangement is to use multiple levels of processing. Initially vision ADAS takes time.
processing captures the sensor data and formats it for the next Finally keep in mind that these ADAS form the basis for future,
layer of processing. Another layer then performs recognition more-automated systems. Adaptive cruise control and automatic
algorithms and other feature identification operations. The output braking bring the vehicle to a near autonomous state, but not
then goes to a decision processor that will initiate the desired completely. Self-driving cars will incorporate ADAS in addition
outputs and actions. Along the way a variety of wired network to location and navigation technology, along with artificial
connections are used to transport the data. intelligence and machine learning processors and software to
implement fully autonomous driving. Chapter 7 gives a glimpse
Future ADAS of these forthcoming systems. n
In addition to ongoing improvements in current systems,
forthcoming ADAS units will incorporate more communications ☞ BACK TO TABLE OF CONTENTS
in the form of vehicle-to-vehicle (V2V) and vehicle-to-
10 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 4:
VEHICLE
COMMUNICATIONS
TECHNOLOGY
T
o further develop the safety aspects of new vehi- Wi-Fi variant that operates in the unlicensed 5 GHz spectrum.
cles, the National Highway Transportation Safety More recently, a competing technology called cellular V2X has
Administration (NHTSA) has mandated a com- been offered as an alternative. This chapter summarizes both
munications capability for all new vehicles begin- technologies and their implications on safety.
ning in 2021. This feature is generally referred to as
vehicle-to-everything (V2X) and its more specific The Intelligent Transportation System
functions such as vehicle-to-vehicle (V2V) and vehicle-to-infra- It all begins with the Intelligent Transportation System (ITS), a
structure (V2I) communications. This new communications re- program of the Department of Transportation (DOT). Its goals are
quirement will greatly improve ADAS safety by providing radio to improve the safety and mobility of all modes of transportation
communications between vehicles, as well as between vehicles and in the U.S. The ITS provides R&D that has focused on cars and
nearby roadside units that supply valuable information. light trucks but ultimately will affect all sectors of transportation,
Specific radio technology has been developed for this application. including trucking, trains, and aircraft. To achieve its goals,
Called Dedicated Short Range Communications (DSRC), it is a the ITS advocates the adoption of a mix of wired and wireless
11 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 4: VEHICLE COMMUNICATIONS TECHNOLOGY
communications technologies and information systems. includes information such as exact vehicle location and direction
At the heart of the ITS effort are the communications systems of travel, speed, braking status, and some other data. The driver
that let vehicles talk to one another and to receive information en does not see it, but the BSM provides safety warnings giving time
route from nearby infrastructure sources. With the appropriate for the driver to react. Or it could trigger action such as automatic
communications and information, the number of collisions and braking or steering for collision avoidance maneuvers. The BSM is
deaths are expected to decline. And the path will be paved to updated and transmitted 10 times per second.
implement the forthcoming self-driving vehicles. Another proposed function of DSRC is vehicle-to-infrastructure
Figure 4-1 illustrates the ITS variations. Vehicles of all types (V2I) communications. The vehicle links up with roadside access
and even pedestrians communicate with one another as well as points that will provide additional useful information, such as
nearby terminals and cell sites. The goal is a safe, efficient, and traffic or road conditions, weather, construction, and traffic light
environmentally friendly transportation system that can adapt to status. A vehicle-to-network (V2N) connection is also possible for
forthcoming new systems like autonomous vehicles. other services to be determined.
Figure 4-2 shows the main elements of a V2V installation. The
V2V Systems system interfaces with other components in the vehicle by way
V2V systems let automobiles and light trucks communicate with of wired network connections. Examples are the driver interface,
one another directly. Their full adoption will greatly minimize selected vehicle processors, and ADAS components like steering
accidents and reduce the annual vehicle death toll. To achieve this and brakes.
end the National Highway Traffic Safety Administration (NHTSA) On Jan. 12, 2017, the NHTSA issued a Notice of Proposed
developed the Dedicated Short Range Communications (DSRC) Rulemaking (NPRM) that would mandate DSRC and the
standard. supporting GNSS (GPS) technology on light vehicles. Public
DSRC was expected to be the official wireless technology for comments were received and closed on April 12. No final decision
use in vehicle-to-vehicle (V2V) communications. However that has been made. With the final determination in limbo, the cellular
decision seems to be up in the air, as a cellular standard has been option is being considered.
proposed as an alternative. Since there has been no final adoption
of DSRC, it appears that there is time to reconsider an alternative The Cellular Alternative
or some combination. The cellular option is known as cellular vehicle-to-everything
(C-V2X). It uses existing 4G cellular standards like LTE for both
DSRC Overview V2V and V2I. The 3GPP standards for LTE, specifically Release
DSRC V2V is a Wi-Fi variant and defined by the IEEE 802.11p 14, provide options such as LTE Direct or device-to-device
standard. The FCC allocated 75
MHz of spectrum (5.85-5.925 Security system
GHz) specifically for DSRC. That Provides and verifies V2V security certificates to ensure trust between vehicles
spectrum is divided up into seven
10 MHz channels. The standard GPS, DSRC
uses 52 subcarrier OFDM to antennae
achieve a data rate of 3 to 27
Mb/s. The range is estimated to
be an average of about 300 meters
Dedicated Short Range GPS receiver
up to one kilometer with a clear Communications • Provides vehicle position
Driver-vehicle
line of sight path. It offers 360- (DSRC) radio and time to DSRC radio
interface
Receives and transmits data • Provides timekeeping Generates warning
deg. coverage and a latency of less through antennae signal for applications issued to driver
than 50 ms.
The DSRC system transmits
a basic safety message (BSM) Memory Vehicle’s internal
Safety application
Stores security certificates, electronic control unit communications network
between vehicles. The BSM application data, and Existing network that
Runs safety applications
other information interconnects components
4-2. The main components of This in-vehicle equipment can consist of either a single,
a V2V system. DSRC is shown integrated unit or a discrete set of components
here, but a cellular-V2X solution
Sources: Crash Avoidance Metrics Partnership and GAO
would be the same except for
the radio technology.
12 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 4: VEHICLE COMMUNICATIONS TECHNOLOGY
13 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 5:
VEHICLE RADAR
O
ne of the main sensors in an
AUTOMOBILE RADAR CLASSIFICATIONS
automobile today is radar.
AND APPLICATIONS
It uses millimeter-wave (30
Long range radar Medium range Short range radar
GHz to 300 GHz) radiations Characteristic
(LRR) radar (MRR) (SRR)
to identify objects at the Frequency (typical) 77 GHz 79 GHz 79 GHz
front, sides, and rear of the Range 10 to 250 meters 1 to 100 meters 0.15 to 30 meters
vehicle and measures the distance to them. The
Lane change, blind spot
radar outputs are conditioned and processed Application Adaptive cruise control
detection
Parking assist
and the information derived from them is used
by the braking, steering, cruise control, alarms, Figure 5-1 shows the coverage areas of typical auto radars and
and other systems for driver assistance or automated driving. how they are deployed. Auto radars are also usually classified by
The concepts of radar have been known for over a century, but their range and application. This is summarized in the table above.
it wasn’t until 1937 that the Navy developed the first useable radar.
Radar was further developed during World War II and has evolved The Fundamentals of FMCW Radar
into a wide range of modern systems using the latest technology. An automotive radar transmitter (TX) radiates a continuous
This chapter covers the radar systems unique to modern wave (CW) signal toward a target; a receiver (RX) then looks for
vehicles. The emphasis is on the single-chip radars using a chirp the return or echo signal. The signal frequency is swept over a
continuous wave signal. range of frequencies for a known interval. This signal is said to
be frequency modulated (FM) or chirp. The reflected signal is
Automotive Radar Applications then compared to the transmitted signal and, using a variety of
Radar has become a key feature of ADAS and autonomous methods, the range and speed of the object can be computed.
vehicles. With its ability to detect objects and measure their The basic frequency modulated continuous wave (FMCW)
distance and speed, these radar systems have been adapted to signal is a sine wave at some frequency in the 76 to 81 GHz range.
perform a variety of functions. Thanks to modern semiconductor This range has been allocated for automotive radars. 77 GHz is a
technology, the radar systems have been
reduced to one or more tiny integrated Blind Spot Lane
circuits. Small size and low cost have allowed Detection Departure
engineers to design in radar where it can Parking Aid Parking Aid
improve safety and convenience. The most
common applications today are: Collision Warning
• Adaptive cruise control
• Collision detection, warning, and avoidance.
• Blind spot detection.
• Lane departure warning.
• Cross-traffic alerts. Adaptive
Cruise
•Road object detection.
Control
•Parking aid. Rear-end Collision
Other uses may be found as development Collision Blind Spot Lane Warning
Warning Detection Departure
of the connected car and autonomous
vehicles continues. 5-1. Radar coverage areas as used in ADAS or self-driving vehicles.
14 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 5: VEHICLE RADAR
15 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 5: VEHICLE RADAR
will occur at different times. Each signal will produce a different time.
baseband signal that the FFT will translate into the equivalent Note in Fig. 5-3 that separate transmitting and receiving
antennas are used to keep the transmitter
signal out of the receiver. The most
PWM common antennas are printed circuit
MCU board (PCB) patch types. Because of the
Level Adjustment
BB Low Pass small size of antennas at 77 GHz, simple
3-ChannelBB 6 6
RX BB
3-Channel SPI 6 6 antennas may actually be implemented on
RX BB
3-Channel SP I Σ∆
3-Channel
RX SP I the chip.
Rx ADC1..8
SP I Multiple patch antennas can be formed
into a matrix to create a phased array
LO that provides gain as well as directional
2-Channel ADC1..4 beamforming. A single antenna may also
MRD2001TX /1024 Sense
2-Channel be used if a ferrite circulator is used to
FC
Tx VCO
10 MHz
SPI isolate or block the transmitter signal from
FC SPI SPI
the receiver input. An example of a single
0…4V FM CW
antenna is a phased array or dielectric lens
DAC
Flash antenna.
RAM
PWM
Offset Commercial Automotive Radar
There are multiple vendors of automotive
40 MHz
radar devices. Some of the earlier available
XTAL
devices operated in the 24 GHz range.
5-4. The NXP MR2001 radar transceiver chipset. An external MCU does the Most of the newer devices use the 76 to 81
processing. GHz range, with 77 GHz being the most
(User programmable)
LNA IF ADC Digital Front
End
Boot
Prog RAM* Data RAM*
LNA IF ADC (Decimation ROM
filter chain)
Buffer Radar
Hardware SPI / I2C PMIC control
Accelerator
Synth Ramp (FFT, Log-
PA x4
(20 GHz) Generator Mag, and Primary communication
others.) DCAN
interface (automotive)
PA
DMA Debug
For debug
UARTs
RF Control/
BIST Mailbox Test/ JTAG for debug/
Debug development
Osc. VMON Temp GPADC
Master subsystem
RF/Analog subsystem (Customer programmed)
5-5. A block diagram of the Texas Instruments AWR1443 single chip CMOS radar transceiver that includes the processing.
16 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 5: VEHICLE RADAR
17 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 6:
LIGHT DETECTING
AND RANGING (LIDAR)
L
IDAR is radar using light. You will see it referred to How LIDAR Works
as LiDAR and as light detection and ranging. The big LIDAR, like radar, can be implemented in either a continuous
question is, why do we need another radar-like sensor wave or pulsed format. Most automotive LIDAR is of the pulse
if we already have video cameras, RF radar, and ultra- type. A laser emits a short pulse of light and a nearby photodetector
sonic sensors? The primary reasons are that LIDAR of- receives the reflected light pulse. The time of transition (t) is then
fers greater precision and a superior three-dimension- used to calculate the distance or range (R) to the object.
al (3D) plot of a scene. It is superior at identifying objects. R = (3 x 108)(t/2)
LIDAR is currently not used on modern vehicles simply This is the speed of light in meters per second multiplied by the
because of its high cost. However, it is being transition time (t) in seconds divided by 2.
widely developed, and hopefully through The time t is double the time for the signal
technology breakthroughs and volume to reach the target and the time to return.
production, LIDAR cost will go down and The can be simplified to:
increased adoption will occur. It is one R = 0.15t
development that the autonomous-vehicle Range is in kilometers and t is in
movement is counting on to make self- microseconds.
driving cars practical and safe. Here is a Laser Source. The laser is typically an
primer on how this technology works. edge-emitting solid-state laser diode. The
light frequency is typically in the near
LIDAR Applications infrared (IR) range from 600 to 1000
Up until recently the main application nanometers. A common wavelength is 905
for LIDAR has been weather mapping. It nanometers (nm). Lasers with a 1550 nm
is widely used by the National Oceanic wavelength are also used. The IR light
and Atmospheric Administration (NOAA). passes through a lens to the target. The
Its benefit is its ability to generate precise newer automotive systems employ multiple
3D maps of Earth and its surroundings. lasers. Vertical cavity surface emitting lasers
Examples are storm surge modeling, (VCSELs) could be incorporated since they
shoreline mapping, hydrodynamic 6-1. The Velodyne LiDAR HDL-64E S3 are easier to make in IC form and can be
modeling, hydrographic surveying, and is a real-time LIDAR scanner with a more conveniently made into arrays.
land elevation or topographic models. Most rotating head for horizontal scan and an A key laser specification is its power.
LIDAR is implemented on airplanes or array of 64 channels of laser/detector Lasers are usually rated in watts and are
satellites. units for a wide vertical scan. available in ranges from milliwatts to
Now, LIDAR is a leading sensor type hundreds of watts. Lower power lasers are
being deployed for autonomous vehicles (AVs). You can recognize the most common. Keep in mind that the range of the LIDAR is
the LIDAR on an AV test car by the large cylindrical object on the dependent upon the laser power output.
roof that seems to be spinning. Light Detectors. The reflected laser light is picked up with a
LIDAR provides a 360-deg. view of nearby objects in great 3D lens and is applied to a light detector. There are three types of IR
detail. That data is combined with related radar and video camera light detectors that can adequately receive laser reflections. These
data to get a realistic picture of the area around the vehicle. are PIN photodiodes, avalanche photodiodes (APDs), and photo
multiplier tubes. The APDs are the most common. These are
18 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 6: LIGHT DETECTING AND RANGING (LIDAR)
usually connected to a trans-impedance op amp for amplification cameras, radars, and even some ultrasound sensors are producing
of the weak signal usually received. The photodiode output is a digital versions of the same scene as well. The scenes from each
measure of the light amplitude and the surface reflectivity of the sensor are given to machine-vision software for interpretation. At
object. A common packaging arrangement is to include the APD some point, the typical multiple stages of processing produces an
and laser into a common housing. aggregated output that is used for making driving decisions.
Scanning. LIDAR systems use a scanning technique to observe
a scene. The laser “paints” an area with short light pulses and the Commercial LIDAR
photodiode picks up the back-scattered return pulses. The pulse An example of a modern LIDAR unit is the Velodyne HDL-64E
repetition rate (PRR) varies with the application but is usually in S3 (Fig. 6-1). It uses an array of 64 laser/detector channels aligned
the 10 kHz to 1 MHz range. Each pulse results in a photodiode to provide a 26.9-deg. vertical field of view. It uses a rotating head
reading that creates a pixel to provide a time interval to determine that gives a horizontal 360-deg. field of view. Rotation rate can
distance as well as a light amplitude value. be set from 5 to 20 Hz. This unit produces a point cloud of up to
The scanning process is accomplished with a single laser- 2.2 million points per second. These points provide time of flight
photodiode assembly and a rotating mirror. Many of the current (ToF) distance measurement with light intensity. Viewing range is
AV test cars use the rotating mirror and/or prism assembly. This up to 120 meters with an accuracy of ± 2 cm. The interface is by
implements the horizontal scan. These systems can provide a full way of a 100 Mb/s Ethernet port.
360 deg. of coverage around the vehicle. The laser beam is also
Comparison of Automotive Sensors
Specification Ultrasound Video Camera Radar LIDAR The table shows the characteristics of the
Inches to several different sensors used in ADAS and self-driving
Range 20 meters 300 meters 200 meters
meters vehicles. You can see why multiple sensors are
Heavy, scene Minimal, ok in Poor results in used as no one sensor provides the complete
Effect of weather Negative
obfuscation. rain, fog, etc. fog, smoke, etc. optimum scene capture and interpretation.
Effect of light None Poor night vision No effect. Minimal Some sensors like radar are just not good at
Field of view Broad Broad Narrow Broad object details detection. Video cameras and
LIDAR give a good picture of what an object
is. Video cameras also offer the benefit of color
positioned vertically to provide a vertical scan. A common vertical recognition allowing stop lights and signs to be recognized.
range of view is 20-30 deg.
An alternate method is called 3D flash. A strong but broad laser Current LIDAR Status
beam illuminates a large area of the scene and a light sensor like Current vehicles have widely adopted radar, cameras and
that in a digital camera captures the reflected light. The sensor is ultrasound sensors for their ADAS installations. However, LIDAR
either a CMOS or a CCD sensor with a matrix of pixel sensors. is not currently used in production vehicles. It is still a bit too large
Each pixel is interrogated to provide time and distance as well as and expensive. Luckily considerable development has occurred
light intensity. in the past several years making great strides in lowering the
Factors Affecting Range. LIDAR systems can accommodate a cost and miniaturizing the LIDAR units. It is expected that
range from about 10 to 200 meters. The range is a function of the when autonomous vehicles (AV) become available, most will
laser power, the sensitivity of photodetector, beam divergence, incorporate LIDAR. AVs like Tesla’s Model S with self-driving
lens characteristics, reflectivity of the target, and the nature of AutoPilot software does not use LIDAR because of the cost issue.
the environment out to the target. Any atmospheric characteristic Others may take that same route. Nevertheless, LIDAR is an
that affects light will determine the range. Laser light is greatly improvement that no doubt will be widely adopted when cost and
attenuated and scattered by fog, smoke, clouds, and dust. Rain and size issues have been resolved. n
snow will also reduce the range.
Processing. The time/distance and light intensity information ☞ BACK TO TABLE OF CONTENTS
is digitized with an ADC and stored in memory. This is processed
to create a 3D image that can be displayed or otherwise used to
interpret what the scene represents. The goal is to use that data to
determine the size and shape of an object and its distance. That
in turn can be used to recognize cars, people, and other objects.
Interestingly, the LIDAR image is not used alone. While the
LIDAR system is generating its own version of a scene, the video
19 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY FOCUS ON: AUTOMOTIVE COMMUNICATIONS
CHAPTER 7:
SELF-DRIVING
CARS
S
elf-driving cars, also referred to here as autono- who would not welcome an AV. A recent AAA survey indicated
mous vehicles (AVs), are the next big thing in the that 78% of respondents responded that they would be afraid to
automobile industry. AVs have been under test for ride in a self-driving car. In another AAA survey, more than half
several years and most of the technology is now in the respondents indicated a desire to have some autonomous
place. With some issues still to be finalized, AVs features in their next vehicle, meaning more and better ADAS. To
should start showing up in auto dealerships by many, the idea of a self-driving car is foolish. Many auto owners
2020. This chapter discusses the technology of AVs, the rationale, love to drive and want to continue to drive their own vehicle. Can
and the remaining issues to be resolved. self-drivers and real drivers coexist with one another?
Just to be clear, there are several stages or degrees of automation.
The Rationale for Self-Driving Vehicles These have been defined by the Society of Automotive Engineers
The primary reason stated for the development and deployment (see tables below). Currently we are at Levels 1 and 2. Test cars
of AVs is improved automotive safety. Some sources say that over have operated at Levels 4 and 5, but final products have not been
90% of road deaths could be eliminated. With up to 40,000 people manufactured.
dying each year in car accidents and millions of others injured,
it seems desirable to pursue an aggressive goal of reducing those The Components of an AV
figures as soon as possible. The primary parts of an AV are a comprehensive ADAS with full
Another rationale is personal convenience. Many do not like to sensor inputs from radar, LIDAR, video cameras, and ultrasound
drive or drive in difficult traffic conditions. Furthermore, many units. Next, a current GNSS/GPS navigation system and maps are
drivers continue to want to do other things while driving, such as essential. Add to this the V2V and V2I communications described
texting, eating, etc. Others such as older or handicapped citizens in an earlier chapter.
would love to have a self-driving option so they
can stay or become independent.
Some companies also see a way to reduce the DEGREES OF VEHICLE AUTOMATION
cost of personnel in some driving activities. AV Level Amount of automation
taxis are an example. Uber and Lyft are investing
in AVs. There is also potential for trucking and Level 0 No automation. Driver performs all functions.
delivery companies where driver costs are high. Level 1 Driver performs all functions but ADAS systems provide alerts and partial control.
It remains to be seen if these goals can actually
Partial automation. Driver must still monitor actions but automated systems control braking,
be attained in practice. Yet there is apparently Level 2
steering and acceleration.
enough evidence to justify the billions of dollars Automated driving systems perform all driving activities but driver must still be available to take
Level 3
of investment by the auto companies, Silicon control in special circumstances.
Valley stalwarts, and startups. The big questions Level 4
Automated driving systems perform all driving activities.
center around the real outcomes like improved Driver may still control the vehicle if needed.
safety. What are the unseen consequences? Level 5 Full automation. No driver needed but a driver may intervene if necessary.
20 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 7: SELF-DRIVING CARS
The idea is to provide as many sensory inputs as possible and Neural network Deep neural network
attempt to interpret the surrounding data as a real driver would.
Input Hidden Output Input Hidden Hidden Hidden Output
All of this data needs to be manipulated and processed in real
time so that steering, braking, and accelerator setting outputs are
generated. All of this represents a massive computing requirement.
Fast multiple processors will be involved along with software.
As it has turned out, conventional processors and algorithmic
software are just not up to the job. But the auto industry has
discovered artificial intelligence (AI) in the form of machine
learning. The core of AVs will be based on AI and machine- 7-1. A neural network consists of a set of inputs and outputs
learning processes. with a hidden layer in between. A deep neural network has
The latest idea in AI is “deep learning” technology, which is multiple hidden layers.
based on deep neural nets (DNNs). Deep learning has moved AI
into the spotlight again because of improved performance enabled Neural networks require training to generate the weights used
by platforms like graphic processing units (GPUs). This has in the system. Systems can learn dynamically, but these tend to be
turned many applications of DNN into practical concepts. Some more complex as training normally requires more computational
applications may use GPU clusters for training a DNN, but that horsepower than inference. Training uses a feedback system
deployment may only require a microcontroller. where an input is matched with outputs and the internal hidden
In the simplest sense, a neural network is an array of layer weights are adjusted. This process requires more than just a
interconnected nodes that connect a set of inputs to outputs. The few samples. A system with a large number of inputs like a photo
nodes have weights associated with them, and the inputs generate image and a large number of sample sizes will often require a
a set of outputs based on the node. The challenge is determining cluster or high end CPU and GPU to create a DNN configuration.
the weights, as well as the number of nodes in each layer, in On the flip side, a microcontroller may often be sufficient for
addition to the number of layers (or the depth) of the system. some applications to utilize a DNN configuration to perform
The weights are usually determined by “training” the network inferences in real time. FPGAs and specially designed hardware
via a set of inputs, such as photos of a particular type of object, to address neural networks are also available.
and providing an indication of whether recognition is positive or DNNs have been used for a wide range of applications, from
negative. DNNs are actually much more complex. They are made identifying items in an image to voice recognition. These can be
up of neural networks. done with conventional DNNs, but there are other configurations
that provide additional functionality. One of these configurations
Neural Networks is the convolutional neural network (CNN).
Artificial neural networks (ANNs) have been around for a long Convolutional neural networks are feed-forward ANNs that
time, but their high computational requirements for complex may constrain the nodes in three dimensions. CNNs consist of a
networks has limited their use and experimentation until recently stack of layers that include a convolutional, a pooling, and a fully
with multicore systems such as GPUs providing an economical connected layer.
platform for a variant called deep neural networks (DNNs). The actual design and configuration of neural networks is a bit
Initially neural networks were of interest as a way of copying more complex than presented here, although training and using
biological neural networks like the human brain. The brain is the results on an existing system are much simpler. This typically
made up of neurons that are connected via an axon to synapse entails providing training input and then deploying the results
and dendrites on other neurons. The electrical signals from where a system might be used to identify dogs in photos.
incoming signals are summed by the neuron. A result that exceeds Part of the challenge of using neural networks is that they are
a threshold sends a signal via the axon. essentially black boxes. This can be an advantage, but it essentially
ANNs are built in a similar fashion, but using electronics or hides what is going on inside the system. Properly preprocessing
software. It takes many neurons to perform useful functions; the input can also be critical to the success of using neural networks.
human brain has 100 billion. A basic neural network consists of a Likewise, neural networks are not applicable to every application,
set of inputs and outputs with a hidden layer in between, as shown but they do work very well for many applications.
in Fig. 7-1. A DNN has multiple hidden layers. The networks may Finally, it is possible to have a neural network provide feedback
be the same logically, but the number of inputs, outputs, and on part of the reasoning behind their results, but in general they
hidden layers varies as well as other configuration options. Of do not provide this information. That may not be a problem if the
course, the key to a system’s operation are the weights associated accuracy of the inference is sufficient for the application, like being
with the connections and nodes. able to identify a dog within a picture at least 95% of the time.
21 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
ELECTRONIC DESIGN LIBRARY CHAPTER 7: SELF-DRIVING CARS
AV systems will be based upon a combination of neural path would no doubt be via the V2V or V2I facilities. Or it could
networks and conventional algorithmic processors. It takes a occur through any Wi-Fi, Bluetooth, or cellular connection. Or
massive amount of computing power to emulate a human driver. even through the OBD II wired diagnostic port.
The concept has already been heavily tested with good success. •Insurance. Who is to blame in an accident? Would it be
But nothing is perfect. Hopefully the end result will be good the owner/passenger, the vehicle manufacturer, an equipment
enough for the real world. provider, or an actual driver? Of course, it depends upon the
nature of the accident and cause and the policies to be established.
Remaining Issues • Market acceptance. Will people actually buy AVs? Some will,
There are still some unresolved problems to a total AV. In of course. The major customers may just be the taxi, fleet, delivery,
addition to the unknown demand or lack thereof, the following and truck companies. Will consumers buy them in volume or will
issues need attention. sales be like that of today’s electric vehicles (EVs), a 1% niche?
• Regulation. Most if not all states will have AV laws. Automakers • Relationships with conventional drivers and cars. How will
fear the problem of meeting the differing regulations in 50 states AVs get along with the average driver of today? Will AVs be too
and adhering to eventual federal regulations. Hopefully some slow and conservative and simply annoy the usual driver? Will
common ground can be found. The Department of Transportation there be road rage for the AV riders? It will be years before the
recently announced its guidelines for automated vehicles, A Vision ADS systems including V2V and V2I become useful and all cars
for Safety: 2.0 (https://www.nhtsa.gov/technology-innovation/ include them, driverless and standard vehicles. Until then, some
automated-vehicles). This statement is a non-regulatory approach adjustments will no doubt have to be made, especially by current
to promote safe testing and development of automated driving drivers.
systems (ADSs). It is hoped that these guidelines to industry and • Driver Education. Will driver’s licenses go away or will the
state regulators will encourage innovation and creativity while requirements just be changed to match the AV situation? Learning
ensuring safety as well as shape future policy and consistent how to use ADAS equipment and full AV vehicles is critical to their
regulation. success in meeting the safety goals originally set.n
• Security. Can self-driving systems be hacked? Probably. While
no one knows for sure how this can happen, it could. The entry ☞ BACK TO TABLE OF CONTENTS
22 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics
CHECK OUT THESE RESOURCES FROM
ELECTRONIC DESIGN AND OUR SISTER BRANDS
WEBSITES
MAGAZINES NEWSLETTERS
You can also apply for a subscription to one of our Stay current with the industry with newsletters
traditional magazines available in both print and created by engineers and editors with inside
digital formats. connections! You’ll find coverage on a wide variety
of electronics technologies from Analog & Mixed
ELECTRONIC DESIGN – MICROWAVES & RF –
Signal to Embedded and more.
complimentary in US and complimentary internationally-
Canada - ☞ Subscribe Now ☞ Subscribe Now ☞ Click Here to check out what more than
Non-qualified or Outside the Non-qualified: you will be 200,000 engineers are reading now.
US and Canada: you will be prompted to pay based on your
prompted to pay based on your location.
location.
THE SMART HOME BUTLER
The Real Smart IoT
Electronic Design
the authority on
emerging technologies march 2017 trusted eNgiNeeriNg resource for oVer 50 years www.mwrf.com
for design solutions
Impedance Tuners
APRIL 2017 electronicdesign.com
in control 100
build, buy, p|
or both?
consumer electronics
•
$10 computing Price Point
•
trends in Poe
Y
march 2017 • Vol. 56 •, No. 3
FAST
CM
MY
CY
APRIL 2017 • Vol. 62, no. 11
CMY
$10.00 Periodicals Postage Paid • USPS 100 Approved Poly $10.00 Powered by Periodicals Postage Paid • USPS 100 Approved Poly
ABOUT US
A trusted industry resource for more than 50 years, the Penton Electronics Group is the electronic
design engineer’s source for design ideas and solutions, new technology information and engineering Powered by
essentials. Individual brands in the group include Electronic Design, Microwaves & RF and Power
Electronics. Also included in the group is a data product for engineers, SourceToday.com.
23 | electronicdesign.com ☞ Want more coverage like this? Subscribe to Electronic Design’s newsletter Automotive Electronics