alperbahcekapili / roach Goto Github PK
View Code? Open in Web Editor NEWSmart and noble assistant for next generation cars.
Smart and noble assistant for next generation cars.
At each step of user's stt result, a function matching should be run. For example if we have the following functions in the car:
Name: Open music
Name: Open the windows
Description: Opens the car windows
Possible Phrases: ["Open the left window for me", "Open the driver's window"]
and if the user says: "I am bored. Play a song", then open the music function should be matched. Then this function should be called at the background.
Having an exit function that terminates the dialog would be good.
Assistant should be informed about the match before generating an answer.
Technical Details:
There should be vectordatabase which stores all possible phrases and their functions' name, descriptions in the metadata fields.
A similarity search should be executed at each step.
Similarity treshold (st) can be set via experimentation.
We can store functions and their informations in a json file under backend folder.
In order to show the latest-matched functions, we can add indicators to assistant's messages to visualize which function is matched/no function is matched.
We need to do adjustments to visualize the state of the car as well
Chatting logic should be started upon sleepy driver detected.
After signal:
Car's state should be generated as if the values are being read by sensors in the car.
Example data:
{ "left-front-window":100 "right-front-window":100 "left-rear-window":95, "right-rear-window":95, "speaker-level":0, "temperature-inside":20 }
This data should be generated at each 0.1 seconds and matching-functions should invoke changes in the car interior. To do that, another backend endpoint can be created. At each timestep t, front-end can send a request to visualize the state of the car in the frontend.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.