Analogue, Mixed Signal, LSI


How sensor fusion is driving vehicle autonomy forward

26 October 2022 Analogue, Mixed Signal, LSI

From reading road signs to keeping you inside lane markers, artificial-intelligence-assisted cameras are already making our vehicles smarter and safer. But what happens when the fog rolls in and your camera’s vision is as compromised as yours?

“A camera might be great for object recognition, but it’s not so good in bad weather or at night,” said Miro Adzan, general manager of advanced driver assistance systems (ADAS) at TI. “However, radar will continue to work in rain, snow or mist. Driver assistance systems need to incorporate a range of different sensors so the vehicle can take full advantage of the benefits of these different technologies.”

Using the strengths of different types of sensors is not just a matter of switching between them for different conditions or applications. Even in clear weather, a camera will be stronger for object details, but radar will measure an object’s distance more accurately.

As these systems extend to critical and time-sensitive applications such as emergency braking, automatic parking, front-collision warning and avoidance, and blind spot detection, design engineers will need to fuse these different information sources into a single picture to deliver reliable real-time decisions.

“For automatic parking, you need to combine data from cameras, radar and sometimes ultrasound to give the vehicle an accurate sense of what’s going on around you,” said Curt Moore, general manager for Jacinto processors at TI. “None of these sensors would be accurate enough on their own, but by combining them, you can get a much more accurate picture of the space around you. This allows you to park in much tighter spaces without the risk of causing damage.”

Advanced safety systems are no longer reserved only for high-end automobiles. Nearly 93% of vehicles produced in the US come with at least one ADAS feature, and automatic emergency braking is set to become standard across 99% of new cars in the United States by September.

The shift is a result of the decreasing cost and size of sensors, such as TI mmWave radar sensors which integrate an entire radar system into a chip the size of a coin.

“Ten years ago, radar was predominantly used in military applications because of size, cost and complexity,” Adzan said. “But today, radar is on the verge of becoming a standard component in the car.”

While the proliferation of affordable sensors opens up new applications, it also creates new challenges for ADAS engineers who need to design systems that bring together all the data streams and process them efficiently, while meeting tight affordability and power constraints.

In a single-sensor ADAS system, pre-processing data for object detection takes place close to the sensor in order to use that information immediately. But sensor fusion requires that raw, high-resolution data be instantly transmitted to a central unit for processing to form a single, accurate model of the environment that will help the vehicle avoid a collision.

“With all the data coming in from these sensor nodes, the challenge is making sure all of it is synchronised so the vehicle can understand what’s happening around you and make critical decisions,” said Heather Babcock, general manager for FPD-Link products at TI. “In order to transmit synchronised data in real time, it’s important to have high-bandwidth, uncompressed transmission capability because compressing data introduces latencies.”

The physical constraints of an automobile place tight limits on the size and weight of batteries and cooling infrastructure, so ADAS engineers need processors specifically designed to perform these tasks as efficiently as possible.

The Jacinto processors combine dedicated DSP and matrix multiplication cores that operate with the lowest available power, even at temperatures of up to 125°C.

“There are tremendous advantages in integrating the DSP and the processor into one system on a chip,” Moore said. “Otherwise, each will need its own memory and power supply, driving up the system cost. The other advantage is the reduction in latency gained by integrating these operations into one chip.”

In addition to power-efficient processors, TI’s automotive-qualified power management ICs with functional safety features for sensor fusion, front cameras and domain controllers improve overall power efficiency and functionality within the vehicle.

Beyond the individual components, TI’s entire ecosystem of ADAS products is created for seamless compatibility, allowing car manufacturers to select from a holistic portfolio that can be scaled to the demands and price points of their vehicles.

“We have all the pieces of the ADAS puzzle designed in a way that keeps the various challenges of the vehicle in mind,” Adzan said. “That makes the system design easier for our customers.”


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Accelerate development of physical AI deployments
Altron Arrow DSP, Micros & Memory
With Avocado OS now available on the HummingBoard RZ-V2N- AIoT and SolidSense AIoT V2N from SolidRun, teams can move from prototype to deployed fleet in weeks.

Read more...
Universal NFC device
Altron Arrow DSP, Micros & Memory
Delivering high-end performance in a compact 4 x 4 mm package, the multipurpose NFC reader from ST Microelectronics, enables the convenience of contactless interaction and features for various end applications.

Read more...
Java Card-based solution
Future Electronics Analogue, Mixed Signal, LSI
The SECORA ID Key S USB, from Infineon Technologies, is a Java Card-based solution with USB and NFC connectivity for secured authentication and digital signatures.

Read more...
Compact direct Time-of-Flight 3D LiDAR module
Altron Arrow AI & ML DSP, Micros & Memory
The VL53L9 from STMicroelectronics is the first direct Time-of-Flight (dToF) 3D LiDAR all-in-one module in ST’s portfolio, offering a resolution of 2,3K zones, wide field of view, on-chip processing, 100 frames per second, and sensing range from 5 centimeters to 9 meters.

Read more...
SoC brings scalable edge AI to life
Altron Arrow AI & ML
The NXP i.MX 937 applications processor is optimised for performance without excessive power draw and bridges the gap between entry-level chips and high-end processors.

Read more...
Accelerate STM32-based IoT development with SPI EEPROM board
Altron Arrow Computer/Embedded Technology
ST Microelectronics’ ready-to-use STM32 expansion board helps design more efficient battery-friendly IoT devices based on ultra low power 32-Mbit Page.

Read more...
Compact direct Time-of-Flight 3D LiDAR module
Altron Arrow Opto-Electronics Electronics Technology AI & ML
The VL53L9 from STMicroelectronics is the first direct Time-of-Flight (dToF) 3D LiDAR all-in-one module in ST’s portfolio, offering a resolution of 2,3K zones, wide field of view, on-chip processing, 100 frames per second, and sensing range from 5 centimeters to 9 meters.

Read more...
Digital isolators for I2C interfaces
Analogue, Mixed Signal, LSI
Würth Elektronik has expanded its range of digital isolators with 2-channel bidirectional isolators for I2C communication interfaces.

Read more...
Generating negative voltages from a positive supply
Altron Arrow Editor's Choice Passive Components
It is common for IoT devices, industrial sensors, meters, and medical equipment to require both a positive and negative voltage, and this article explains the options available to produce a negative rail from a positive rail supply.

Read more...
Addressing latency and signal integrity challenges
Altron Arrow DSP, Micros & Memory
Strengthening Microchip Technology’s data centre solutions portfolio, its XpressConnect retimers support high-bandwidth architectures, while helping reduce integration complexity.

Read more...









While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd | All Rights Reserved