DSP, Micros & Memory


New hybrid sensor for in-car safety and comfort monitoring

26 October 2022 DSP, Micros & Memory

As leading automotive markets start to mandate driver-monitoring systems (DMS), STMicroelectronics is already equipping carmakers with the required technologies. While DMS promises greater road safety by assessing driver alertness, the next-generation dual image sensor from ST monitors the full vehicle interior, covering both the driver and all passengers. New applications enabled by ST’s new image sensor include passenger safety-belt checks, vital-sign monitoring, child-left detection, gesture recognition, and high-quality video/picture recording.

“The DMS market is growing at a double-digit pace and ST’s new image sensor is set to push that forward by enabling brands to create new services and deliver even greater value for vehicle users, leveraging complete in-cabin monitoring that covers multiple occupants,” said Eric Aussedat, executive vice president, imaging sub-group general manager, STMicroelectronics. “Our market-leading DMS sensor provided the perfect launchpad to take the technology further and empower new innovations.”

The new sensor, the VD/VB1940, delivers a cost-effective solution that combines the sensitivity and high resolution of infrared sensing with high dynamic range (HDR) colour imaging in a single component. It can capture frames in rolling-shutter or global-shutter modes. With 5,1-megapixels, it captures the high-dynamic-range (HDR) colour images needed for an occupant monitoring system (OMS) in addition to the high-quality near-infrared (NIR) images typically captured by standard DMS sensors. DMS uses NIR imaging to analyse driver head and eye movements in all lighting conditions.

The new automotive image sensor uses ST’s second-generation 3D-stacked back-side illuminated (BSI) wafer technology, which maximises the optical area and on-chip processing in relation to die size. This lets the sensor perform sophisticated algorithms locally for optimal performance in both colour and NIR imaging, saving power and relieving demand for an external co-processor.

Algorithms performed on-chip include Bayer conversion and HDR merging for optimal image-quality and frame rate. On-chip Bayerisation processing enables the user to reshuffle the colour pixels of the RGB NIR 4X4 pattern into the RGGB format compatible with a wide range of SoCs. In addition, local processing also handles independent colour and NIR pixel-exposure optimisation for optimum image quality in both modes, as well as smart upscaling to maximise NIR image resolution by capturing extra NIR information from RGB pixels.

ST has planned to meet demand for 2024 model vehicles that are currently in design.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

MCU for low-power, IoT applications
NuVision Electronics DSP, Micros & Memory
Silicon Labs recently announced the PG26, a general-purpose microcontroller with a dedicated matrix vector processor to enhance AI/ML hardware accelerator speeds.

Read more...
EEPROMs for industrial and military markets
Vepac Electronics DSP, Micros & Memory
Designed to ensure the data retention and the secure and safe boot of digital systems, the memory product line includes small and medium density EEPROMs from 16 kb to 1 Mb.

Read more...
PLCnext – Open, IIoT-ready industrial platform
IOT Electronics DSP, Micros & Memory
PLCnext can be used alongside an existing PLC system, collecting control system data via EtherNet/IP, PROFINET, or MODBUS, and can push this information to a cloud instance.

Read more...
ICs vs modules: Understanding the technical trade-offs for IoT applications
NuVision Electronics Editor's Choice DSP, Micros & Memory
As the IoT continues to transform industries, design decisions around wireless connectivity components become increasingly complex with engineers often facing the dilemma of choosing between ICs and wireless modules for their IoT applications.

Read more...
Hardware quantum resistance to embedded controllers
Avnet Silica DSP, Micros & Memory
To help system architects meet evolving security demands, Microchip Technology has developed its MEC175xB embedded controllers with embedded immutable post-quantum cryptography support.

Read more...
High-performance processor for edge-AI
Altron Arrow DSP, Micros & Memory
The STM32MP23 microprocessor from STMicroelectronics is the latest addition to the STM32MP2 series, designed to meet the demands of industrial, IoT, and edge AI applications.

Read more...
Winner of the Advanced Electronics Challenge
Avnet Silica News
Avnet Silica has named Hydronauten winner of the Advanced Electronics Challenge for breakthrough AI-driven vibration damping technology.

Read more...
Bluetooth module brilliance
Avnet Silica Telecoms, Datacoms, Wireless, IoT
Following the company’s popular PAN1780, the PAN1783 Bluetooth 5.3 Low Energy (LE) module from Panasonic is based on the Nordic nRF5340 single chip controller.

Read more...
NXP’s latest wireless chip solution
Avnet Silica Telecoms, Datacoms, Wireless, IoT
NXP’s IW610 wireless chip solution features a 1x1 dual-band Wi-Fi 6 radio subsystem, offering improved network efficiency, reduced latency and extended range.

Read more...
PolarFire SoC FPGAs achieve AEC-Q100 qualification
ASIC Design Services DSP, Micros & Memory
Microchip Technology’s PolarFire SoC FPGAs have earned the Automotive Electronics Council AEC-Q100 qualification.

Read more...