DemoCompress2.mp4
This repository is the main part of the project and thesis for deploying Johnny a full AI agent assistant running on your pc and reachable from your car with a dedicated hardware.
It is part of the following
Cheshire Cat, the framework
Local whisper cat his local transcriber Plugin
Chattino The Arduino/Esp32 Client for embebbed and for the car application
Chatty The Python Client for pc usage and more
(The original Thesis) TESI_IN_PDF_ITALIAN ONLY
The thesis explores and verifies the state of the art for IoT, experimenting with and prototyping a Cybercar with a voice assistant on the vehicle. It uses edge computing for keyword spotting and cloud computing for hosting an open-source, multilingual, and customizable AI chatbot on a consumer GPU (GTX 1080 Ti). This system can interact with the user vocally and, when connected to the car's internal bus, can perceive the car's status.
A proof of concept, a prototype and a case study are presented, in addition to all the necessary hardware and software documentation. The study shows that it is possible with current technologies to make a common car smart, up to a level and depth that depends on the access to the internal dynamics of the car, accessible from the OBD-II debug port and using the protocols available on the bus.
A brief introduction to the project and the context of the thesis.
Description of the overall system architecture, including hardware and software components.
Details on the implementation of the system, both on the edge and cloud sides.
Description of the case study, including specifications and results.
Final considerations and potential future developments of the project.
Complete documentation can be found in the docs
directory.
All hardware details can be found in the hardware
directory.
Source code and instructions for the software can be found in the software
directory.
Descriptions and results of the conducted experiments can be found in the experiments
directory.
Will be added soon
This repository is licensed under the GPL 3.0 License.