Comments (5)
@mauronano I see you created a separate issue for this, I've responded there with some details.
from hololensforcv.
In short, you can't. I had to write a custom little DLL to handle that since the depth camera intrinsics object is not the standard one, but a custom interface to an otherwise opaque structure. There's actually a lot of other issues when trying to do this in Unity. I've spent the past four months working on it, and it's still not exactly right. There's a bunch of coordinate transforms that need to be taken into account because the HoloLens uses coordinate systems typically used by roboticists, while Unity uses another one entirely. It makes using the matrices and projection information that much harder. Not to mention, the two samples for the Kinect, that seem like a good reference, aren't actually how the HoloLens data works in the end.
from hololensforcv.
@FracturedShader could you suggest a workflow to align depth frames with the ones from the color camera?( i mean the standard high resolution color camera, not those made accessible along with the depth and IR sensors)
I think first step would be acquire synchronized frames from the cameras, but i'm not sure how to achieve that since they are from different source groups; then get the intrinsics of the depth camera, and i would appreciate some hints about this part too.
from hololensforcv.
@FracturedShader can u refer to the other issue ?
from hololensforcv.
@cyrineee, sure, that was issue #64
from hololensforcv.
Related Issues (20)
- Can I use this in Unity HOT 1
- How can I get world space ray from pv frame ? HOT 2
- TOF short_throw recording FPS not stable
- new Mat() access denied
- Access to raw eye tracking data
- HoloLensForCV.SensorFrameStreamer.Enable() - unauthorised access exception HOT 2
- FrameToOrigin
- OpenCV lib corrupt HOT 1
- Errors while building the project
- wrong url in readme HOT 1
- Can we use this for making an app for commercial use?
- Access to active brightness buffer (clean IR reading)?
- Cannot build ArUco Marker Tracker
- Applying mask on live stream
- nullptr_ service socket when trying to access Short Throw ToF Reflectivity sensor
- This repo is missing important files HOT 2
- Real world pixel size/spacing
- How to unproject a 2D point in an captured image back to its accurate location in the physical world?
- cant catch the Exception in the Concurrency Runtime HOT 1
- Can I use the Hololense2 to capture the depth RGB images? for the purpose of deep learning training.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hololensforcv.