Got shipped a TTGO TAudio 9 V1.6, manufactured by Lilygo. When powered, the device runs a lightshow on the LED array.
In the Lilygo Github repo the documentation on software is quite "thin". Yet, there is information on the hardware layout, connections, PINS, schematic etc. In the issues section of the supplier's repo some leads can be found.
This repo is meant to kind of repair this lack of documentation on this board and it's applications. Any suggestions and/or contributions are welcome!
This repo is NOT meant to develop applications or software. This will be done in other projects.
Here I describe ongiong tests of the board's features and discovery of relevant code examples and libraries. In the end, a set of libraries should be available for the on board hardware (functional chips):
- WM8978 audio codec
- MPU9250 motion processing unit including DMP
- WS2812 LED string
- SD card reader/writer
- WiFI
- BT/BLE
- battery / charging
- microphone
- headset output
- speakers outputs
- Serial port & Hello World COM10
- Play sound WM8978 over headphone jack TTGO_TAudio_arifshanji.ino (play mp3 stream from web)
- WiFi TTGO_TAudio_arifshanji.ino
- Play synthesized sound espTuto.ino from Faust project (ESP32 part) , C++ code also available
- LED array WS2812 / Adafruit_NeoPixel TTGO_TAudio_RGB_LED.ino (original light show firmware erased)
- Motion processing unit MPU9250 with accelerometer, magnetometer, gyroscope TTGO_TAudio_MPU9250.ino (added gyroscope test)
- I start a new project on Calibration and Physics of the accelerometer, magnetometer and gryroscope (uese Arduino)
check presence in repo of all code files
- Play sound WM8978
- over headphone control volume (main, L/R channels?) DONE use TTGO_TAudio_arifshanji.ino
- over board speakers, control volume (main, L/R channels?), requires proper hardware
- equalizer extendTTGO_TAudio_arifshanji.ino
- MPU gyroscope, DONE extend TTGO_TAudio_MPU9250.ino
- Microphone , control volume? DONE
- Recording function microphone?, line in?, i2S in ?
- SD card
- read / write
- Battery
- charging function?
- On/off switch
- Push buttons (4x)
- Audio in over BT ?
- Audio out over BT ? (this feature is not specific for this board, REMARK)
REMARK: is it possible to stream / synthesize sound on a board without a WM8978 and send it over BT to a wireless speaker?
Learn about code conversion. How to use C++ snippets or non-CMake C snippets in ESP-IDF:
- https://www.deeptronic.com/software-design/developing-esp32-application-with-esp-idf-and-c-in-windows
- https://github.com/goofy2k/ESPIDF-Code-Conversion (in progress)
Examples in Arduino libraries
- In schreibfaul1/ESP32-audioI2S (repo for Audio.h) https://github.com/schreibfaul1/ESP32-audioI2S
- In LilyGO/ TTGO-TAudio repo
- In issues of LilyGO/ TTGO-TAudio repo
- Faust project https://faust.grame.fr/ or Faust for ESP32: https://hal.archives-ouvertes.fr/hal-02988312/document (faust2esp32, https://faustdoc.grame.fr/tutorials/esp32/)
- Phil Schatzmann repos, pschatzmann https://github.com/pschatzmann
- Cellie @CelliesProjects https://github.com/CelliesProjects
- WM8978 docs (e.g. equalizer function)
- Google: TTGO-TAudio use cases / examples / projects
- 98/95 dB Stereo Codec with Speaker Driver!
- Get Started — Audio Development Framework documentation (ESP-ADF)
- Espressif Audio Development Guide
- ESP-ADF on Github
- ESP-ADF forum
- https://github.com/kriswiner/MPU9250 repo with lots of documentation and examples
- https://www.seeedstudio.com/blog/2020/06/17/how-to-use-an-mpu9250-accelerometer-and-gyroscope-with-arduino/
- https://github.com/wollewald/MPU9250_WE
- https://github.com/bolderflight/mpu9250
- one example working, but poor quality
- looking for nicer demo's
- added layout.xlsx and a screenshot with a description of the layout of the LED array ONE OF THE FOLLOWING EXAMPLES IS BASED ON RMT... be carefull
- https://github.com/Lucas-Bruder/ESP32_LED_STRIP
- https://github.com/samguyer/FastLED
- https://github.com/CalinRadoni/esp32_digitalLEDs
- https://github.com/ogochan/neopixel-idf
- https://blog.ja-ke.tech/2019/06/02/neopixel-performance.html VERY VERY informative about the basic control and different implementations
- https://github.com/Jakeler/NeoPixel-Performance the repo with the above blog
- https://github.com/climufat/TTGO_mp3_player, stripped down Liligo example. Only SD card and WM8978. No WiFi. C++ ESP-IDF NOK
- https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-reference/storage/sdmmc.html
- https://github.com/espressif/esp-idf/tree/b63ec47238fd6aa6eaa59f7ad3942cbdff5fcc1f/examples/storage/sd_card/sdmmc OK, example works !
https://www.reddit.com/r/esp32/comments/93xwx8/ttgo_taudio/ and https://github.com/whyengineer/esp32_snow
https://github.com/hpsaturn/ttgotaudio https://blog.georgmill.de/2018/06/06/esp32-audio-experiments-or-make-a-very-small-low-cost-and-portable-webradio/
- The docs on the Github page suggests a demo on playing mp3 sound from an SD card. Burning this firmware and running did not succeed.
- Erased the shipped firmware. Apparently that was driving the lightshow on the LED's.
- The info on the Github page https://github.com/LilyGO/TTGO-TAudio is pretty thin, so I am looking for examples on the web
- Found a demo in the issues (nr 12): Example Code - WM8978 Arduino playing Icecast streams
- Because of updates in the Audio.h library you need to use the code in a response by arifshanji (file available in repo)
- You need to download the correct Audio.h: https://github.com/schreibfaul1/ESP32-audioI2S. This is NOT available from the Arduino IDE
- Need a special USB driver (CH341SER) before serial interface can be used for firmware uploads.
The WM8978 is a low power stereo codec with integrated pre-amps for stereo differential mics and includes drivers for speakers, headphone and differential or stereo line output. External component requirements are reduced as no separate microphone or headphone amplifiers are required. Advanced on-chip digital signal processing includes a five-band equalizer, a mixed-signal automatic level control for the microphone or line input through the A/D converter, as well as a purely digital limiter function for record or playback. Additional digital filtering options are available in the ADC path to provide application filtering such as ‘wind noise reduction.’ The WM8978 codec can operate as a main or secondary device. An internal PLL can generate all required audio clocks for the codec from common reference clock frequencies, such as 12 and 13 MHz. Individual sections of the chip can also be powered down under software control.
- https://docs.espressif.com/projects/esp-idf/en/latest/esp32/get-started/
- https://blog.espressif.com/esp-idf-development-tools-guide-part-i-89af441585b also see the hello_world readme.md and links therein, such as
- https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-guides/build-system.html how to start a new project (and folder structure)
- Code conversion. How to use C++ code or non-CMake C code in the ESP-IDF environment:
Need to make an overview of relevant examples and libraries. Need to translate example on other hardware to the TTGO TAudio T9 V1.6
Often, examples depend on more than one hardware component. To prevent double entries in the tables, the examples are numbered such that cross references can be made. Also cross-references are not made double. They are only given for more supportive modalities, such as WiFi, BT, SD card reader.
👍 in Q means: working example available, these will be placed in the repo.
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | Arduino | this | see: TTGO_TAudio_arifshanji.ino | plays mp3 from web | E | 👍 | sketch derived from arifshanji in follow-up on issue on Lilygo repo |
| 2 | this | plays mp3 from SD | D | ◼️ | github.com/climufat | ||
| 3 | Arduino | this | WM8978.h, FaustSawtooth.h Faust_esp32Tuto in this repo | play synthesized audio | D | 👍 | Faust for ESP32 |
| 4 | lots of audio tools | github.com/pschatzmann | |||||
| 5 | M5Stack | WM8978.h | github.com/CelliesProjects | ||||
| 6 | Audio.h | I2S work | github.com/schreibfaul1 | ||||
| 7 | uses equalizer function | WM8978 docs | |||||
| 8 | C | unknown | WM8978.h | microphone in, data strored in SPIFFS | E | github.com/donny681 |
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | Arduino | this | MPU9250_asukiaaa.h | mag, accel,I added gyro | 👍 | github.com/asukiaaa/MPU9250 | |
| 2 | lots of documentation and examples | github.com/kriswiner | |||||
| 3 | nice article | seeedstudio.com | |||||
| 4 | Arduino | SparkFun 9DoF IMU Breakout | specific info on DMP | github.com/sparkfun |
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | Arduino | this | Adafruit NeoPixel.h | is less buitiful than the original firmware | 👍 | github.com/LilyGO | |
| 2 | --- | --- |
cross-references:
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | C++ | this | card.h ?? | reported to be working according to discussion in Lilygo issues, to be checked | github.com/MisterRager | ||
| 2 | C | ESP32 | sdmmc_host, sdmmc_cmd | reported to be working according to discussion in Lilygo issues, to be checked | 👍 | github.com/espressif |
cross-references: A1,A2,A8
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|
cross-references:
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|
cross-references: A8
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|
FIND EMOJIS on https://www.webfx.com/tools/emoji-cheat-sheet/ 👍 🔴 ⚫ ✅
=======
Got shipped a TTGO TAudio 9 V1.6, manufactured by Lilygo. When powered, the device runs a lightshow on the LED array.
In the Lilygo Github repo the documentation on software is quite "thin". Yet, there is information on the hardware layout, connections, PINS, schematic etc. In the issues section of the supplier's repo some leads can be found.
This repo is meant to kind of repair this lack of documentation on this board and it's applications. Any suggestions and/or contributions are welcome!
This repo is NOT meant to develop applications or software. This will be done in other projects.
Here I describe ongiong tests of the board's features and discovery of relevant code examples and libraries. In the end, a set of libraries should be available for the on board hardware (functional chips):
- WM8978 audio codec
- MPU9250 motion processing unit including DMP
- WS2812 LED string
- SD card reader/writer
- WiFI
- BT/BLE
- battery / charging
- microphone
- headset output
- speakers outputs
- Serial port & Hello World COM10
- Play sound WM8978 over headphone jack TTGO_TAudio_arifshanji.ino (play mp3 stream from web)
- WiFi TTGO_TAudio_arifshanji.ino
- Play synthesized sound espTuto.ino from Faust project (ESP32 part) , C++ code also available
- LED array WS2812 / Adafruit_NeoPixel TTGO_TAudio_RGB_LED.ino (original light show firmware erased)
- Motion processing unit MPU9250 with accelerometer, magnetometer, gyroscope TTGO_TAudio_MPU9250.ino (added gyroscope test)
- I start a new project on Calibration and Physics of the accelerometer, magnetometer and gryroscope (uese Arduino)
check presence in repo of all code files
- Play sound WM8978
- over headphone control volume (main, L/R channels?) use TTGO_TAudio_arifshanji.ino
- over board speakers, control volume (main, L/R channels?), requires proper hardware
- equalizer extendTTGO_TAudio_arifshanji.ino
- MPU gyroscope, extend TTGO_TAudio_MPU9250.ino
- Microphone , control volume?
- Recording function microphone?, line in?, i2S in ?
- SD card
- read / write
- Battery
- charging function?
- On/off switch
- Push buttons (4x)
- Audio in over BT ?
- Audio out over BT ? (this feature is not specific for this board, REMARK)
REMARK: is it possible to stream / synthesize sound on a board without a WM8978 and send it over BT to a wireless speaker?
Learn about code conversion. How to use C++ snippets or non-CMake C snippets in ESP-IDF:
- https://www.deeptronic.com/software-design/developing-esp32-application-with-esp-idf-and-c-in-windows
- https://github.com/goofy2k/ESPIDF-Code-Conversion (in progress)
Examples in Arduino libraries
- In schreibfaul1/ESP32-audioI2S (repo for Audio.h) https://github.com/schreibfaul1/ESP32-audioI2S
- In LilyGO/ TTGO-TAudio repo
- In issues of LilyGO/ TTGO-TAudio repo
- Faust project https://faust.grame.fr/ or Faust for ESP32: https://hal.archives-ouvertes.fr/hal-02988312/document (faust2esp32, https://faustdoc.grame.fr/tutorials/esp32/)
- Phil Schatzmann repos, pschatzmann https://github.com/pschatzmann
- Cellie @CelliesProjects https://github.com/CelliesProjects
- WM8978 docs (e.g. equalizer function)
- Google: TTGO-TAudio use cases / examples / projects
- https://github.com/kriswiner/MPU9250 repo with lots of documentation and examples
- https://www.seeedstudio.com/blog/2020/06/17/how-to-use-an-mpu9250-accelerometer-and-gyroscope-with-arduino/
- https://github.com/wollewald/MPU9250_WE
- https://github.com/bolderflight/mpu9250
- https://github.com/wollewald/MPU9250_WE
- one example working, but poor quality
- looking for nicer demo's
- added layout.xlsx and a screenshot with a description of the layout of the LED array
- https://github.com/climufat/TTGO_mp3_player, stripped down Liligo example. Only SD card and WM8978. No WiFi. C++ ESP-IDF NOK
- https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-reference/storage/sdmmc.html
- https://github.com/espressif/esp-idf/tree/b63ec47238fd6aa6eaa59f7ad3942cbdff5fcc1f/examples/storage/sd_card/sdmmc OK, example works !
https://www.reddit.com/r/esp32/comments/93xwx8/ttgo_taudio/ and https://github.com/whyengineer/esp32_snow
https://github.com/hpsaturn/ttgotaudio https://blog.georgmill.de/2018/06/06/esp32-audio-experiments-or-make-a-very-small-low-cost-and-portable-webradio/
- The docs on the Github page suggests a demo on playing mp3 sound from an SD card. Burning this firmware and running did not succeed.
- Erased the shipped firmware. Apparently that was driving the lightshow on the LED's.
- The info on the Github page https://github.com/LilyGO/TTGO-TAudio is pretty thin, so I am looking for examples on the web
- Found a demo in the issues (nr 12): Example Code - WM8978 Arduino playing Icecast streams
- Because of updates in the Audio.h library you need to use the code in a response by arifshanji (file available in repo)
- You need to download the correct Audio.h: https://github.com/schreibfaul1/ESP32-audioI2S. This is NOT available from the Arduino IDE
- Need a special USB driver (CH341SER) before serial interface can be used for firmware uploads.
The WM8978 is a low power stereo codec with integrated pre-amps for stereo differential mics and includes drivers for speakers, headphone and differential or stereo line output. External component requirements are reduced as no separate microphone or headphone amplifiers are required. Advanced on-chip digital signal processing includes a five-band equalizer, a mixed-signal automatic level control for the microphone or line input through the A/D converter, as well as a purely digital limiter function for record or playback. Additional digital filtering options are available in the ADC path to provide application filtering such as ‘wind noise reduction.’ The WM8978 codec can operate as a main or secondary device. An internal PLL can generate all required audio clocks for the codec from common reference clock frequencies, such as 12 and 13 MHz. Individual sections of the chip can also be powered down under software control.
- https://docs.espressif.com/projects/esp-idf/en/latest/esp32/get-started/
- https://blog.espressif.com/esp-idf-development-tools-guide-part-i-89af441585b also see the hello_world readme.md and links therein, such as
- https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-guides/build-system.html how to start a new project (and folder structure)
- Code conversion. How to use C++ code or non-CMake C code in the ESP-IDF environment:
Need to make an overview of relevant examples and libraries. Need to translate example on other hardware to the TTGO TAudio T9 V1.6
Often, examples depend on more than one hardware component. To prevent double entries in the tables, the examples are numbered such that cross references can be made. Also cross-references are not made double. They are only given for more supportive modalities, such as WiFi, BT, SD card reader.
👍 in Q means: working example available, these will be placed in the repo.
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | Arduino | this | see: TTGO_TAudio_arifshanji.ino | plays mp3 from web | E | 👍 | sketch derived from arifshanji in follow-up on issue on Lilygo repo |
| 2 | this | plays mp3 from SD | D | ◼️ | github.com/climufat | ||
| 3 | Arduino | this | WM8978.h, FaustSawtooth.h Faust_esp32Tuto in this repo | play synthesized audio | D | 👍 | Faust for ESP32 |
| 4 | lots of audio tools | github.com/pschatzmann | |||||
| 5 | M5Stack | WM8978.h | github.com/CelliesProjects | ||||
| 6 | Audio.h | I2S work | github.com/schreibfaul1 | ||||
| 7 | uses equalizer function | WM8978 docs | |||||
| 8 | C | unknown | WM8978.h | microphone in, data strored in SPIFFS | E | github.com/donny681 |
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | Arduino | this | MPU9250_asukiaaa.h | mag, accel,I added gyro | 👍 | github.com/asukiaaa/MPU9250 | |
| 2 | lots of documentation and examples | github.com/kriswiner | |||||
| 3 | nice article | seeedstudio.com | |||||
| 4 | Arduino | SparkFun 9DoF IMU Breakout | specific info on DMP | github.com/sparkfun |
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | Arduino | this | Adafruit NeoPixel.h | is less buitiful than the original firmware | 👍 | github.com/LilyGO | |
| 2 | --- | --- |
cross-references:
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|---|---|---|---|---|---|---|
| 1 | C++ | this | card.h ?? | reported to be working according to discussion in Lilygo issues, to be checked | github.com/MisterRager | ||
| 2 | C | ESP32 | sdmmc_host, sdmmc_cmd | reported to be working according to discussion in Lilygo issues, to be checked | 👍 | github.com/espressif |
cross-references: A1,A2,A8
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|
cross-references:
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|
cross-references: A8
| # | Platform | Board | Libraries | Remarks | Xrefs | Q | Reference |
|---|
FIND EMOJIS on https://www.webfx.com/tools/emoji-cheat-sheet/ 👍 🔴 ⚫ ✅
5da6bc2fc4f127e36894b6225494ee2ae118806f