Difference: TinyML (5 vs. 6)

Revision 62023-09-02 - UliRaich

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

TinyML

Introduction

Line: 24 to 24
 Here we go through the ESP32 C++ examples

Michael O'Cleirigh has started a project on github trying to port these examples to MicroPython (https://github.com/mocleiri/tensorflow-micropython-examples). Since there are several ESP32 modules that include a simple camera, I2S microphones are supported in MicroPython and several accelerometers with I2C interface are available, it should be possible to run these examples on the ESP32.

Changed:
<
<

Setting up the PC and MicroPython for TensorFlow

>
>

The hardware

There are several esp32-cam boards integrating a camera with the ESP32 CPU. Some also provide an SD card interface, such that photos or videos from the camera can be recorded onto an SD card. Some of these boards have only 16 output pin and are therefore very limited in the number of GPIO lines available to interface external devices and others use 40 output pins. None of them has a microphone and/or an accelerometer on board. To my knowledge there is only one such board using the ESP32S3 chip with vector instructions speeding up neural network operations and that one is a 40 pin device. I therefore selected this device for my studies.

ESP32S3_kit.png

Setting up the PC and MicroPython for TensorFlow

  The following pages show how to set up the PC to run TensorFlow, how to create models and how to down-scale them for use on the ESP32. Then a custom version of MicroPython must be created including the esp32-camera driver and its MicroPython interface as well as ulab, a stripped down version of numpy and scipy as well as the tflm library and its MicroPython access routines.
Line: 36 to 42
 
Changed:
<
<
>
>
  -- Uli Raich - 2022-01-31

Comments

<--/commentPlugin-->
Added:
>
>
META FILEATTACHMENT attachment="ESP32S3_kit.png" attr="" comment="" date="1693646417" name="ESP32S3_kit.png" path="ESP32S3_kit.png" size="297059" user="UliRaich" version="1"
META FILEATTACHMENT attachment="ESP32S3_pinout.png" attr="" comment="" date="1693646914" name="ESP32S3_pinout.png" path="ESP32S3_pinout.png" size="359825" user="UliRaich" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback