Design Automation


Deep learning APIs for Espressif SoCs

27 October 2021 Design Automation

ESP-DL, recently introduced by Espressif Systems, provides APIs for neural network (NN) inference, image processing, maths operations and deep learning (DL) models. With ESP-DL, developers can use Espressif's SoCs for neural network inference easily and quickly.

Thus far, Espressif’s data show that, in comparison to the company’s ESP32 wireless MCU, when ESP-DL runs on an ESP32-S3 chip the acceleration of a 16-bit detection model is increased by 4,5 times, or 6,25 times in the case of a face recognition model. In addition, the 8-bit face recognition model is 2,5 times faster than the 16-bit model on the ESP32-S3. Furthermore, Espressif offers a tool that can help developers make their own model compatible with the company’s platform.

Since ESP-DL does not need any peripherals, it can be used as a project component. For example, if it is added to the esp-who/components/directory, ESP-DL can be used as a submodule of ESP-WHO, which contains several project-level examples of image-based applications. The accompanying figure below shows what ESP-DL consists of and how it is implemented as a project component.

ESP-DL provides tools that can help developers convert their own model (possibly developed with a third-party platform such as TensorFlow, PyTorch, MXNet, etc.) into an 8-bit or 16-bit model and evaluate the performance of the quantised model.

Model Zoo

ESP-DL also provides certain easy-to-use models such as human face detection, human face recognition, cat face detection, etc., in the so-called Model Zoo. These models can be used out-of-the-box. Other models, such as for colour detection and hand-pose recognition, will be released soon.

Customising a model

In the GitHub tutorial entitled ‘How to Customize a Model Step by Step’ you can find all relevant instructions with a runnable example which will help you implement your model quickly and easily.

Variety of APIs

ESP-DL contains sufficient APIs for developers to build their own model, such as neural networks (NN), image processing and matrix operations. Meanwhile, developers can customise layers and provide feedback if they have any special requirements regarding the API utility.

Software and hardware boost

ESP-DL implements quantised computation and brings about a more efficient kind of software by optimising the assembly and architecture of the C/C++ code. It is worth mentioning that the ESP32-S3, with its vector instructions, high-speed SPI interface and configurable cache memory, achieves a much faster acceleration in AI applications.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Battery-friendly Thread and BLE solution
iCorp Technologies DSP, Micros & Memory
Positioned as an incremental upgrade to the ESP32-H2, Espressif’s ESP32-H21 adds an integrated DC-DC converter that reduces active current draw and helps extend battery life in power-sensitive consumer and industrial devices.

Read more...
Connected without limits: An engineering perspective on Altron Arrow’s wireless ecosystem
Altron Arrow Editor's Choice Design Automation
Wireless connectivity is no longer a supporting technology, but rather, a core design consideration that underpins modern electronic systems across industries.

Read more...
Next-gen robotic systems initiative
EBV Electrolink Design Automation
EBV Elektronik recently introduced MOVE – Driving Robotics Forward, a new initiative designed by EBV Elektronik‘s Embedded Solutions team to support the development of next-generation robotic systems.

Read more...
DC-DC converters for next-generation IoT
iCorp Technologies Power Electronics / Power Management
AIPUPOWER’s K78XXJT-500R3 and K78XXJT-500R3-LB give designers a compact, high-efficiency power option for battery-powered and space-constrained systems, combining up to 96% efficiency with no-load input current as low as 0,2 mA.

Read more...
Compact edge platform for AI
iCorp Technologies AI & ML
Built around the Qualcomm QCS6490 octa-core SoC, Quectel’s QuecPi Alpha delivers up to 12 TOPS of on-device AI performance.

Read more...
Reference design for NB-IoT plus GNSS
Altron Arrow Design Automation
ST Microelectronics’ STDES-ST87M01IGN is a reference design for the ST87M01 NB-IoT + GNSS module, implemented on a 2-layer FR4 PCB (90 x 60 x 1,6 mm).

Read more...
Low-power SoC for IoT designs
iCorp Technologies DSP, Micros & Memory
Espressif’s ESP32-H4 is a dual-core 32-bit RISC-V SoC designed for battery-powered wireless products that require low energy consumption, strong security, and modern connectivity.

Read more...
NVDC power-path control to 1– 6 cell battery systems
iCorp Technologies Power Electronics / Power Management
SG Micro’s SGM41581 is an I2C-controlled narrow voltage direct charging buck boost charge controller designed to simplify robust power delivery in systems that must seamlessly operate from an adapter input or a battery pack.

Read more...
iCorp brings BeeLee’s compact switch and sensor components to local designers
iCorp Technologies Switches, Relays & Keypads
BeeLee’s product catalogue includes (among others) vibration sensors, tilt ball switches, reed switches, hall sensors, optocoupler (photo interrupter) devices, and liquid level switches.

Read more...
Wi-Fi 7 tri-band connectivity module
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
Quectel has introduced the FCE870Q, a compact short range wireless connectivity module designed for next generation IoT devices that require high throughput, low latency, and reliable operation in dense wireless environments.

Read more...









While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd | All Rights Reserved