DSP, Micros & Memory


New hybrid sensor for in-car safety and comfort monitoring

26 October 2022 DSP, Micros & Memory

As leading automotive markets start to mandate driver-monitoring systems (DMS), STMicroelectronics is already equipping carmakers with the required technologies. While DMS promises greater road safety by assessing driver alertness, the next-generation dual image sensor from ST monitors the full vehicle interior, covering both the driver and all passengers. New applications enabled by ST’s new image sensor include passenger safety-belt checks, vital-sign monitoring, child-left detection, gesture recognition, and high-quality video/picture recording.

“The DMS market is growing at a double-digit pace and ST’s new image sensor is set to push that forward by enabling brands to create new services and deliver even greater value for vehicle users, leveraging complete in-cabin monitoring that covers multiple occupants,” said Eric Aussedat, executive vice president, imaging sub-group general manager, STMicroelectronics. “Our market-leading DMS sensor provided the perfect launchpad to take the technology further and empower new innovations.”

The new sensor, the VD/VB1940, delivers a cost-effective solution that combines the sensitivity and high resolution of infrared sensing with high dynamic range (HDR) colour imaging in a single component. It can capture frames in rolling-shutter or global-shutter modes. With 5,1-megapixels, it captures the high-dynamic-range (HDR) colour images needed for an occupant monitoring system (OMS) in addition to the high-quality near-infrared (NIR) images typically captured by standard DMS sensors. DMS uses NIR imaging to analyse driver head and eye movements in all lighting conditions.

The new automotive image sensor uses ST’s second-generation 3D-stacked back-side illuminated (BSI) wafer technology, which maximises the optical area and on-chip processing in relation to die size. This lets the sensor perform sophisticated algorithms locally for optimal performance in both colour and NIR imaging, saving power and relieving demand for an external co-processor.

Algorithms performed on-chip include Bayer conversion and HDR merging for optimal image-quality and frame rate. On-chip Bayerisation processing enables the user to reshuffle the colour pixels of the RGB NIR 4X4 pattern into the RGGB format compatible with a wide range of SoCs. In addition, local processing also handles independent colour and NIR pixel-exposure optimisation for optimum image quality in both modes, as well as smart upscaling to maximise NIR image resolution by capturing extra NIR information from RGB pixels.

ST has planned to meet demand for 2024 model vehicles that are currently in design.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Webinar: AMD Vitus Unified Software Platform
DSP, Micros & Memory
By mastering this bi-directional workflow to efficiently transition between AMD Vitis and AMD Vivado environments, design engineers will be able to maximise their productivity.

Read more...
Low-cost i.MX development board
Altron Arrow DSP, Micros & Memory
The FRDM i.MX 93 development board from NXP is a low-cost and compact development board featuring the i.MX93 applications processor.

Read more...
PowerGood DC-DC converter
Vepac Electronics DSP, Micros & Memory
Standard features on the full range of converters include output current limiting and short circuit protection, output over-voltage protection, and input under-voltage lockout.

Read more...
ATmega328P: Getting started without Arduino
DSP, Micros & Memory
In this article, we’ll walk through bringing up the chip completely on its own, using only an external power source and an Atmel-ICE programmer.

Read more...
Integrated IoT development board
DSP, Micros & Memory
The new ESP32 development board from ideaspark features the 32-bit Xtensa dual-core 240 MHz microcontroller combined with a 1,9-inch (6,4 cm) full-colour TFT LCD.

Read more...
QuecPython live demonstration
Quectel Wireless Solutions DSP, Micros & Memory
QuecPython allows designers to adapt Quectel’s modules quickly, with a low-code approach to suit their precise requirements in less time and at reduced cost, while maintaining high security standards.

Read more...
Robust and customisable SBC
Altron Arrow DSP, Micros & Memory
Pairing the powerful i.MX8M Plus System on Module (SoM) from SolidRun, which features the i.MX 8M Plus SoC from NXP, this high-performance SBC is set to transform industrial environments.

Read more...
New family supports future cryptography
Altron Arrow DSP, Micros & Memory
NXP has introduced its new i.MX 94 family, which contains an i.MX MPU with an integrated time-sensitive networking (TSN) switch, enabling configurable, secure communications with rich protocol support in industrial and automotive environments.

Read more...
Fast and reliable 4G connectivity worldwide
TRX Electronics DSP, Micros & Memory
Powered by a powerful Quectel LTE Cat 4 modem, the Arduino Pro 4G module’s fast data throughput and high bandwidths ensure reliable and quick data download and upload, even in remote locations.

Read more...
NXP’s all-purpose microcontroller series
Altron Arrow DSP, Micros & Memory
NXP has released its MCX A14x and A15x series of all-purpose microcontrollers which are part of the larger MCX portfolio that shares a common Arm Cortex-M33 core platform.

Read more...