DSP, Micros & Memory


New hybrid sensor for in-car safety and comfort monitoring

26 October 2022 DSP, Micros & Memory

As leading automotive markets start to mandate driver-monitoring systems (DMS), STMicroelectronics is already equipping carmakers with the required technologies. While DMS promises greater road safety by assessing driver alertness, the next-generation dual image sensor from ST monitors the full vehicle interior, covering both the driver and all passengers. New applications enabled by ST’s new image sensor include passenger safety-belt checks, vital-sign monitoring, child-left detection, gesture recognition, and high-quality video/picture recording.

“The DMS market is growing at a double-digit pace and ST’s new image sensor is set to push that forward by enabling brands to create new services and deliver even greater value for vehicle users, leveraging complete in-cabin monitoring that covers multiple occupants,” said Eric Aussedat, executive vice president, imaging sub-group general manager, STMicroelectronics. “Our market-leading DMS sensor provided the perfect launchpad to take the technology further and empower new innovations.”

The new sensor, the VD/VB1940, delivers a cost-effective solution that combines the sensitivity and high resolution of infrared sensing with high dynamic range (HDR) colour imaging in a single component. It can capture frames in rolling-shutter or global-shutter modes. With 5,1-megapixels, it captures the high-dynamic-range (HDR) colour images needed for an occupant monitoring system (OMS) in addition to the high-quality near-infrared (NIR) images typically captured by standard DMS sensors. DMS uses NIR imaging to analyse driver head and eye movements in all lighting conditions.

The new automotive image sensor uses ST’s second-generation 3D-stacked back-side illuminated (BSI) wafer technology, which maximises the optical area and on-chip processing in relation to die size. This lets the sensor perform sophisticated algorithms locally for optimal performance in both colour and NIR imaging, saving power and relieving demand for an external co-processor.

Algorithms performed on-chip include Bayer conversion and HDR merging for optimal image-quality and frame rate. On-chip Bayerisation processing enables the user to reshuffle the colour pixels of the RGB NIR 4X4 pattern into the RGGB format compatible with a wide range of SoCs. In addition, local processing also handles independent colour and NIR pixel-exposure optimisation for optimum image quality in both modes, as well as smart upscaling to maximise NIR image resolution by capturing extra NIR information from RGB pixels.

ST has planned to meet demand for 2024 model vehicles that are currently in design.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

General-purpose evaluation board
Altron Arrow DSP, Micros & Memory
Based on the 32-bit Arm Cortex-M7 S32K3 MCU in a 172 HDQFP package, the S32K3X4EVB-T172 offers dual cores configured in lockstep mode, ASIL D safety hardware, and HSE security engine.

Read more...
Unlock power efficiency with the new generation of ultra-low-power MCUs
DSP, Micros & Memory
STMicroelectronics has announced a one-hour webinar on its STM32U0, the company’s latest generation of entry-level, ultra-low-power MCUs.

Read more...
Using AMD HLS to supercharge your design performance
DSP, Micros & Memory
This workshop explores the power and capabilities of High-Level Synthesis (AMD Vitis HLS) to dramatically accelerate embedded software to hardware speeds.

Read more...
The 8-bit survival syndrome – Part 2
DSP, Micros & Memory
Just like the 4-bit pre-microcontroller, the 8-bit MCU has been finding ways to stick around. Their features and speeds have been improving, offering competitive reasons to work with them.

Read more...
Enhanced code protection for USB µC portfolio
Future Electronics DSP, Micros & Memory
To help easily incorporate USB power and communication functionality into embedded systems, Microchip Technology has launched the AVR DU family of microcontrollers.

Read more...
General-purpose MCU with RISC-V architecture
EBV Electrolink DSP, Micros & Memory
Renesas has released a general-purpose MCU to enhance its existing RISC-V portfolio, and this is its first MCU using a RISC-V core developed internally at the company.

Read more...
8-bit MCU with I3C support
Avnet Silica DSP, Micros & Memory
The PIC18-Q20 8-bit microcontrollers from Microchip easily interface with devices operating in multiple voltage domains, and the built-in I3C interface supports higher-speed and lower-power data transfers than I2C.

Read more...
An evolutionary step in customisable logic
Altron Arrow DSP, Micros & Memory
Microchip Technology is offering a tailored hardware solution with the launch of its PIC16F13145 family of microcontrollers, which are outfitted with a new Configurable Logic Block module.

Read more...
MCU for battery-powered applications
Altron Arrow DSP, Micros & Memory
Included in ST’s family of devices is the STM32U031, an ultra-low-power MCU featuring an ARM Cortex-M0+ 32-bit core running at up to 56 MHz.

Read more...
Serial SRAM up to 4 MB
EBV Electrolink DSP, Micros & Memory
The chips are designed to provide a lower-cost alternative to traditional parallel SRAM products, and include optional battery backup switchover circuitry in the SRAM memory to retain data on power loss.

Read more...