From b0abf42c992f673f26597c5ae0e9397ca39415bf Mon Sep 17 00:00:00 2001 From: akdeb Date: Thu, 12 Jun 2025 17:24:15 +0100 Subject: [PATCH] readme update --- README.md | 29 ++++++++--------------------- docs/MultipleDevices.md | 15 +++++++++++++++ Usecases.md => docs/Usecases.md | 10 +++++----- 3 files changed, 28 insertions(+), 26 deletions(-) create mode 100644 docs/MultipleDevices.md rename Usecases.md => docs/Usecases.md (92%) diff --git a/README.md b/README.md index e0bb978..737259a 100644 --- a/README.md +++ b/README.md @@ -15,7 +15,7 @@ Realtime AI Speech powered by **OpenAI Realtime API** and **Gemini Live API**, E -## ⚡️ Features SOTA Realtime AI Speech Models on an ESP32 +## ⚡️ With SOTA Realtime AI Speech Models on an ESP32
@@ -26,7 +26,7 @@ Realtime AI Speech powered by **OpenAI Realtime API** and **Gemini Live API**, E
-## 📽️ Demo Video +## 📽️ Demo Video [(✨ Gemini demo)](https://youtu.be/_zUBue3pfVI)
@@ -40,6 +40,9 @@ Realtime AI Speech powered by **OpenAI Realtime API** and **Gemini Live API**, E
+Video links: [OpenAI Demo](https://youtu.be/o1eIAwVll5I) | [Gemini Demo](https://youtu.be/_zUBue3pfVI) + + ## 👷‍♀️ DIY Hardware Design Hardware Setup @@ -94,8 +97,6 @@ npm run dev 4. **Choose edge server option** -Elato Mode - - **ELATO MODE:** Got your own ESP32 DIY hardware device? We offer a fully hosted edge server for you to use! Register your device on the [settings page](https://www.elatoai.com/home/settings/device) and it will automatically connect to our edge server. Check out our [Pricing page](https://www.elatoai.com/#pricing) for more details. - **DEV MODE:** Alternatively, you can run your own edge server locally by following the instructions below and in the [Deno server README](server-deno/README.md). @@ -134,21 +135,7 @@ Build and upload the firmware to your ESP32 device. The ESP32 should open an `EL Once your Wifi credentials are configured, turn the device off and on again and it should connect to your Wifi and your server. Now you can talk to your AI Character! -## 🤖🤖🤖 Getting Started with multiple devices - -1. Register your device by adding your ESP32 Device's MAC Address and a unique user code to the `devices` table in Supabase. -> **Pro Tip:** To find your ESP32-S3 Device's MAC Address, build and upload `test/print_mac_address_test.cpp` using PlatformIO and view the serial monitor. - - -2. Register your user account to this device by adding your unique user code to the [Settings page](http://localhost:3000/home/settings) in the NextJS Frontend. This links your device to your account. - - -3. Set DEV_MODE to `False` in your `frontend-nextjs/.env.local` env variable. - -> **Pro Tip:** If you're testing locally, you can keep enabled the `DEV_MODE` macro in the `Config.h` file of your firmware and the Deno server env variable to use your local IP addresses for testing. - - -4. Now you can register multiple devices to your account by repeating the process above. +## [🤖🤖🤖 Getting Started with multiple devices](./docs/MultipleDevices.md) ## Project Architecture @@ -159,7 +146,7 @@ ElatoAI consists of three main components: 3. **ESP32 IoT Client** (`PlatformIO/Arduino`) - to receive the websocket connections from the Edge Server Functions and send audio to the OpenAI and Gemini API via the Deno edge server. -## 🌟 Features +## 🌟 Full list of features 1. **Realtime Speech-to-Speech**: Instant speech conversion powered by OpenAI's Realtime API and Gemini's Live API. 2. **Create Custom AI Agents**: Create custom agents with different personalities and voices. @@ -198,7 +185,7 @@ ElatoAI consists of three main components: ## 📈 Core Use Cases -We have a [Usecases.md](Usecases.md) file that outlines the core use cases for the [Elato AI device](https://www.elatoai.com/products) or any other custom conversational AI device. +We have a [Usecases.md](./docs/Usecases.md) file that outlines the core use cases for the [Elato AI device](https://www.elatoai.com/products) or any other custom conversational AI device. ## High-Level Flowchart diff --git a/docs/MultipleDevices.md b/docs/MultipleDevices.md new file mode 100644 index 0000000..ab41980 --- /dev/null +++ b/docs/MultipleDevices.md @@ -0,0 +1,15 @@ +## 🤖🤖🤖 Getting Started with multiple devices + +1. Register your device by adding your ESP32 Device's MAC Address and a unique user code to the `devices` table in Supabase. +> **Pro Tip:** To find your ESP32-S3 Device's MAC Address, build and upload `test/print_mac_address_test.cpp` using PlatformIO and view the serial monitor. + + +2. Register your user account to this device by adding your unique user code to the [Settings page](http://localhost:3000/home/settings) in the NextJS Frontend. This links your device to your account. + + +3. Set DEV_MODE to `False` in your `frontend-nextjs/.env.local` env variable. + +> **Pro Tip:** If you're testing locally, you can keep enabled the `DEV_MODE` macro in the `Config.h` file of your firmware and the Deno server env variable to use your local IP addresses for testing. + + +4. Now you can register multiple devices to your account by repeating the process above. \ No newline at end of file diff --git a/Usecases.md b/docs/Usecases.md similarity index 92% rename from Usecases.md rename to docs/Usecases.md index 2c7e337..f1b60fe 100644 --- a/Usecases.md +++ b/docs/Usecases.md @@ -1,10 +1,10 @@ # [WIP] Here are some use cases for the Elato AI device -Build Custom AI Toys +Build Custom AI Toys *Cute AI plush toys for kids, elderly, and more!* -## Healthcare & Companionship: +## Healthcare ideas: 1. **Kid-friendly hospital buddies**: Plush toys that help kids feel less scared during hospital stays with stories and games when they need them most. @@ -16,7 +16,7 @@ 5. **Meditation guides**: Calming voices that walk you through relaxation exercises whenever you need a mental break. -## Learning & Play: +## Learning & play: 1. **Language conversation partners**: Practice your Spanish, French or any language with a patient friend who never gets tired of helping you get better. @@ -26,7 +26,7 @@ 4. **Social skills practice**: A safe space for kids to practice conversations, especially helpful for children on the autism spectrum. -## Helpful Assistants: +## Helpful assistants: 1. **Simple communication hubs**: Easy voice tools for people who struggle with technology to call family with simple commands. @@ -34,7 +34,7 @@ 3. **Custom helpers**: Voice systems designed specifically for people with mobility challenges. -## Creative Applications: +## Creative applications: 1. **Interactive exhibits**: Imagine talking to Einstein at a science museum or a dinosaur at a natural history exhibit.