openbase / bco.psc Goto Github PK
View Code? Open in Web Editor NEWA project which allows the smart control by 3d pointing rays.
License: GNU General Public License v3.0
A project which allows the smart control by 3d pointing rays.
License: GNU General Public License v3.0
Use case:
A person interacts with a virtual agent multimodally and says "Turn the volume of that speaker up" and points at a speaker. He/she then moves over to a different room, says "Turn the color of that light to green" and points at a light.
The use case shows that fixed filters regarding object type or location given on the start of the application may be too restrictive. Instead the identification-component could provide an rsb server interface that allows to specify object filters during runtime such as:
In the use case the filtering could restrict the objects to only objects in the room in which the person is located and another component could then select the most applicable speaker/light to do the described action on.
One could experiment using instead of the angular distance from the center of the bounding box the same distance compared to the maximal possible angular distance in the same direction.
This way the deviation for larger objects would not be punished as much as for smaller objects.
getMaximalPointOnBox() of AbstractDistanceMeasure already helps with the implementation.
The rst types in use should be extended such that selected objects as well as pointing rays can be identified to a certain tracked posture. This can be done by adding the current index of a the tracked posture to the corresponding pointing ray collections in skeleton-merging.
This way it becomes possible to also identify a person by adding face recognition to the tracked head position or by using other existing person tracking methods. It is highly relevant for multimodal interactions with the system involving multiple persons.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.