Design Automation


Deep learning APIs for Espressif SoCs

27 October 2021 Design Automation

ESP-DL, recently introduced by Espressif Systems, provides APIs for neural network (NN) inference, image processing, maths operations and deep learning (DL) models. With ESP-DL, developers can use Espressif's SoCs for neural network inference easily and quickly.

Thus far, Espressif’s data show that, in comparison to the company’s ESP32 wireless MCU, when ESP-DL runs on an ESP32-S3 chip the acceleration of a 16-bit detection model is increased by 4,5 times, or 6,25 times in the case of a face recognition model. In addition, the 8-bit face recognition model is 2,5 times faster than the 16-bit model on the ESP32-S3. Furthermore, Espressif offers a tool that can help developers make their own model compatible with the company’s platform.

Since ESP-DL does not need any peripherals, it can be used as a project component. For example, if it is added to the esp-who/components/directory, ESP-DL can be used as a submodule of ESP-WHO, which contains several project-level examples of image-based applications. The accompanying figure below shows what ESP-DL consists of and how it is implemented as a project component.

ESP-DL provides tools that can help developers convert their own model (possibly developed with a third-party platform such as TensorFlow, PyTorch, MXNet, etc.) into an 8-bit or 16-bit model and evaluate the performance of the quantised model.

Model Zoo

ESP-DL also provides certain easy-to-use models such as human face detection, human face recognition, cat face detection, etc., in the so-called Model Zoo. These models can be used out-of-the-box. Other models, such as for colour detection and hand-pose recognition, will be released soon.

Customising a model

In the GitHub tutorial entitled ‘How to Customize a Model Step by Step’ you can find all relevant instructions with a runnable example which will help you implement your model quickly and easily.

Variety of APIs

ESP-DL contains sufficient APIs for developers to build their own model, such as neural networks (NN), image processing and matrix operations. Meanwhile, developers can customise layers and provide feedback if they have any special requirements regarding the API utility.

Software and hardware boost

ESP-DL implements quantised computation and brings about a more efficient kind of software by optimising the assembly and architecture of the C/C++ code. It is worth mentioning that the ESP32-S3, with its vector instructions, high-speed SPI interface and configurable cache memory, achieves a much faster acceleration in AI applications.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

High-accuracy positioning
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
Quectel has recently announced its LG580P, a multi-constellation, multi-band GNSS module designed for high-precision positioning that supports multi-band signals across L1, L2, L5, and L6.

Read more...
The world’s first RISC-V MCU to achieve PSA-L2
iCorp Technologies DSP, Micros & Memory
Espressif’s ESP32-C6 is the world’s first RISC-V MCU to achieve PSA-L2 security certification, security certification, underscoring the company’s commitment to delivering robust, secure, and reliable IoT solutions.

Read more...
Power inductors
iCorp Technologies Passive Components
he HTF-MP series is more suitable for complex multiphase power supply applications in design, effectively meeting the needs of ultra-thin and high-power devices.

Read more...
QuecPi smart development board
iCorp Technologies Computer/Embedded Technology
The QuecPi Alpha smart MOB development board is Quectel’s smart development board based on Qualcomm’s QCS6490 high-performance 64-bit octa-core processor.

Read more...
LibGSM – A powerful, modular GSM library
eiTech Systems Design Automation
Whether you are building SMS, MQTT, HTTP or other GSM-based applications, eiTech’s LibGSM library helps streamline development with its carefully structured design.

Read more...
Connectivity for industrial applications
iCorp Technologies DSP, Micros & Memory
Quectel has introduced the SG882G, its latest flagship Android/Linux smart module, designed to deliver exceptional computing power, multimedia capabilities, and seamless connectivity for industrial and consumer applications.

Read more...
NECTO Studio V7.2 IDE with code assistant
Design Automation
MIKROE recently announced that NECTO Studio 7.2 IDE now includes NECTO Code Assistant, an AI tool that enables users to create code for multi-Click projects.

Read more...
MPLAB unified compiler licenses
Design Automation
Offering an efficient way to manage multiple licenses, Microchip Technology has launched MPLAB XC unified compiler licenses for its MPLAB XC8, XC16, XC-DSC and XC32 C compilers.

Read more...
5G transparent antenna
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
Quectel Wireless Solutions recently announced the launch of its 5G transparent antenna, the YFCX001WWAH, an innovative solution designed to improve connectivity while maintaining seamless device design.

Read more...
LTE Cat 1 bis communication
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
The EG810M series is a series of LTE Cat 1 bis wireless communication modules specially designed by Quectel for M2M and IoT applications.

Read more...