Design Automation


Deep learning APIs for Espressif SoCs

27 October 2021 Design Automation

ESP-DL, recently introduced by Espressif Systems, provides APIs for neural network (NN) inference, image processing, maths operations and deep learning (DL) models. With ESP-DL, developers can use Espressif's SoCs for neural network inference easily and quickly.

Thus far, Espressif’s data show that, in comparison to the company’s ESP32 wireless MCU, when ESP-DL runs on an ESP32-S3 chip the acceleration of a 16-bit detection model is increased by 4,5 times, or 6,25 times in the case of a face recognition model. In addition, the 8-bit face recognition model is 2,5 times faster than the 16-bit model on the ESP32-S3. Furthermore, Espressif offers a tool that can help developers make their own model compatible with the company’s platform.

Since ESP-DL does not need any peripherals, it can be used as a project component. For example, if it is added to the esp-who/components/directory, ESP-DL can be used as a submodule of ESP-WHO, which contains several project-level examples of image-based applications. The accompanying figure below shows what ESP-DL consists of and how it is implemented as a project component.

ESP-DL provides tools that can help developers convert their own model (possibly developed with a third-party platform such as TensorFlow, PyTorch, MXNet, etc.) into an 8-bit or 16-bit model and evaluate the performance of the quantised model.

Model Zoo

ESP-DL also provides certain easy-to-use models such as human face detection, human face recognition, cat face detection, etc., in the so-called Model Zoo. These models can be used out-of-the-box. Other models, such as for colour detection and hand-pose recognition, will be released soon.

Customising a model

In the GitHub tutorial entitled ‘How to Customize a Model Step by Step’ you can find all relevant instructions with a runnable example which will help you implement your model quickly and easily.

Variety of APIs

ESP-DL contains sufficient APIs for developers to build their own model, such as neural networks (NN), image processing and matrix operations. Meanwhile, developers can customise layers and provide feedback if they have any special requirements regarding the API utility.

Software and hardware boost

ESP-DL implements quantised computation and brings about a more efficient kind of software by optimising the assembly and architecture of the C/C++ code. It is worth mentioning that the ESP32-S3, with its vector instructions, high-speed SPI interface and configurable cache memory, achieves a much faster acceleration in AI applications.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Creating your own Matter ecosystem
iCorp Technologies News
Espressif’s ESP RainMaker IoT cloud platform allows you to deploy your own private IoT cloud with full control over data and customisations. The ESP RainMaker solution provides a cloud backend based on ...

Read more...
New appointment to the Icorp team
iCorp Technologies News
iCorp Technologies has welcomed Ms Quatraine Domoney to it team in the role of National Technical and Sales Manager (TSM), based in the company’s Johannesburg head office.

Read more...
Creating your own Matter ecosystem
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
ESP RainMaker private IoT cloud platform, from Espressif, now supports a Matter Fabric to allow you to create your own Matter ecosystem.

Read more...
Wi-Fi7 PCIe combo module
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
The 8276M-PU from Fn-Link is a Tri-band Wi-Fi7 plus Bluetooth 5.3 combo module which can support up to 4096 QAM modulation at each band.

Read more...
Modem module for the LPWAN market
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
The BSM8001-01 is a SigFox verified modem for the low-power wide area network (LPWAN) market with an operating frequency in the ISM band at 868 MHz.

Read more...
iCorp appoints new manager
iCorp Technologies News
iCorp has announced the appointment of Mukesh Inderjeeth, who joins the company in the role of New Business Development Manager.

Read more...
Sigfox: A global open access radio frequency network
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
Sigfox South Africa is the country’s open access, massive IoT network dedicated to connecting devices, sensors and physical assets, with close to one million registered devices.

Read more...
CC200A-LB satellite module for IoT industries
iCorp Technologies Telecoms, Datacoms, Wireless, IoT
Quectel Wireless Solutions has recently announced the launch of the CC200A-LB satellite module for IoT industries, which utilises satellite IoT connectivity provided by ORBCOMM.

Read more...
GNSS with integrated LNAs and antennas
iCorp Technologies Editor's Choice Telecoms, Datacoms, Wireless, IoT
With integrated LNAs and SAW filters, the L89 R2.0 module achieves higher sensitivity and increased anti-interference capability.

Read more...
iCorp announces partnership with AiT
iCorp Technologies News
iCorp Technologies has announced it is proud to be the exclusive partner of AiT Semiconductor Incorporated in the southern African region.

Read more...