DSP, Micros & Memory


Applications processor for machine learning at the edge

29 January 2020 DSP, Micros & Memory

NXP Semiconductors has expanded its advanced EdgeVerse portfolio with the i.MX 8M Plus application processor – the first i.MX family to integrate a dedicated Neural Processing Unit (NPU) for advanced machine learning inference at the industrial and IoT (Internet of Things) edge.

The i.MX 8M Plus combines a high-performance NPU delivering 2,3 TOPS (tera operations per second) with a quad-core Arm Cortex-A53 sub-system running at up to 2 GHz, an independent real-time sub-system with an 800 MHz Cortex-M7, a high-performance 800 MHz audio DSP for voice and natural language processing, dual-camera image signal processors (ISP), and a 3D GPU for rich graphics rendering.

With the combination of high-performance Cortex-A53 cores and NPU, edge devices will be able to make intelligent decisions locally by learning and inferring inputs with little or no human intervention. The range of applications made possible with the cost-effective i.MX 8M Plus spans people and object recognition for public safety, industrial machine vision, robotics, hand gesture, and emotion detection with natural language processing for seamless human-to-device interaction with ultra-fast response time and high accuracy.

Built on advanced 14 nm LPC FinFET process technology, the NXP i.MX 8M Plus can execute multiple, highly complex neural networks simultaneously, such as multi-object identification, speech recognition of 40 000+ English words, and medical imaging. For example, the powerful NPU is capable of processing MobileNet v1, a popular image classification network, at over 500 images per second.

Developers can off-load machine learning inference functions to the NPU, allowing the high-performance Cortex-A and Cortex-M cores, DSP, and GPUs to execute other system-level or user applications tasks. The vision pipeline is anchored by dual integrated ISPs that support two high-definition cameras for real-time stereo vision or a single 12 megapixel resolution camera and includes high dynamic range (HDR) and fisheye lens correction. These features enable real-time image processing applications such as surveillance, smart retail applications, robot vision, and home health monitors.

To enable voice applications, the i.MX 8M Plus integrates a high-performance HiFi 4 DSP that enhances natural language processing with pre- and post-processing of voice streams. The powerful Cortex-M7 domain can be used to run real-time response systems while the applications processor domain executes complex non-real-time applications to reduce the overall system-level power consumption by turning off the application processor domain while keeping only the Cortex-M domain alive for wake word detection.

The i.MX 8M Plus extends advanced multimedia, and video processing with a system that can compress multiple video feeds using the H.265 or H.264 HD video encoder and decoder for cloud streaming or local storage and a rich user experience enabled by 3D/2D graphics, and Immersiv3D audio with Dolby Atmos and DTS:X.

The i.MX 8M Plus advances industrial productivity and automation with machines that can inspect, measure, precisely identify objects, and enable predictive maintenance by accurately detecting anomalies in machine operation. In addition, the factory human-machine interfaces can be made more intuitive and secure by combining accurate face recognition with voice/command recognition and even gesture recognition.

Supporting Industry 4.0 IT/OT convergence, the i.MX 8M Plus integrates gigabit Ethernet with time-sensitive networking (TSN), which combined with Arm Cortex M7 real-time processing provides deterministic wired network connectivity and processing. NXP also offers a tailor-made, optimised power management IC, the PCA9450C, to support the i.MX 8M Plus.

To meet the high quality and reliability standards required for industrial applications, the i.MX 8M Plus features error correction code (ECC) for internal memories and the DDR interface. The family is expected to be qualified to meet the stringent industrial temperature range (-40°C to 105°C ambient), power-on profile (100% power-on), and is planned to be part of NXP’s extended longevity commitment (15 years).

For more information contact EBV Electrolink, +27 21 402 1940, capetown@ebv.com, www.ebv.com


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Wireless MCUs for automotive and industrial
31 August 2020, EBV Electrolink , Telecoms, Datacoms, Wireless, IoT
New devices have been added to NXP Semiconductors’ KW3x family of wireless microcontrollers (MCUs). The new KW39/38/37 MCUs add Bluetooth 5.0 long-range capabilities and expanded Bluetooth advertising ...

Read more...
Smallest automotive maXTouch controllers
29 July 2020, Altron Arrow, Avnet Silica , DSP, Micros & Memory
To help enhance and ease today’s driving experience, automotive manufacturers are implementing additional touch displays beyond the centre infotainment display (CID). Supporting the application of these ...

Read more...
New low-power MCU from Renesas
29 July 2020, Hi-Q Electronics , DSP, Micros & Memory
The RE01-256k is the newest member of Renesas Electronics’ RE microcontroller (MCU) family, implemented on the unique silicon on thin buried oxide (SOTB) ultra-low power process from Renesas. It offers ...

Read more...
New low-power MCU from Renesas
30 June 2020, Hi-Q Electronics , DSP, Micros & Memory
The RE01-256k is the newest member of Renesas Electronics’ RE microcontroller (MCU) family, implemented on the unique silicon on thin buried oxide (SOTB) ultra-low power process from Renesas. It offers ...

Read more...
MIFARE DESFire EV3 IC
30 June 2020, EBV Electrolink , Telecoms, Datacoms, Wireless, IoT
NXP Semiconductors announced its new MIFARE DESFire EV3 IC that ushers in next-generation performance, advanced security and seamless integration of mobile services for a new era of security and connectivity ...

Read more...
MCUs for precision sensing and measurement
29 July 2020, RS Components (SA) , DSP, Micros & Memory
A new series of single-chip devices from Renesas, the RX23E-A microcontrollers (MCUs), combine an analog front end (AFE) and an MCU core for use in equipment that delivers high-precision measurements ...

Read more...
ON Semi expands portfolio for industrial motor drives
29 April 2020, EBV Electrolink , Power Electronics / Power Management
Motor drive systems are proliferating along with industrial automation and robotics. These systems require energy efficiency, precise measurement, accurate control, and high reliability within harsh industrial ...

Read more...
USB-C PD 3.0 controllers
29 May 2020, EBV Electrolink , Power Electronics / Power Management
ON Semiconductor has announced a pair of novel devices that are fully compliant with the USB-C PD 3.0 standard. The FAN6390 adaptive charging controller brings ease of integration of the USB-C PD 3.0 programmable ...

Read more...
Ultra-sensitive NIR image sensor
29 May 2020, EBV Electrolink , Opto-Electronics
ams recently introduced the CMOS Global Shutter Sensor (CGSS) near-infrared (NIR) image sensor, CGSS130, complementing its recently announced 3D system. The CGSS130 enables 3D optical sensing applications ...

Read more...
Industrial-grade 32 GB DRAM modules
29 May 2020, Vepac Electronics , DSP, Micros & Memory
32 GB DRAM modules from Innodisk are the newest industrial-grade, high-capacity DRAM series launched with expanded capacity. Targeted at core network switches for 5G technology – touted as a much faster, ...

Read more...