Comments (3)
Hey there!
- Our method supports RGBD input only. Potentially, you can put some other pre-trained depth estimator and run the method. For example, AdaBins (supports higher image resolution), or official AdaBins implementation for depth estimation might be a good start
- So you would run the method, then you'll get segments of the scene, and then you merge them (we'll provide a script for that). After, you'll be able to render the reconstructed scene in real-time
from gaussian-slam.
-
Thanks @VladimirYugay that sounds perfect and thanks for the additional comment about AdaBins. This will be really helpful to advance my current project. Another question of my side would be.
-
Regarding the room scene demonstrated in the video, am I correct in understanding that it was not recorded and live-stitched as depicted? Instead, only a pre-rendered room is presented in the step-by-step procedure, correct? Thus, would it be possible for me to capture photos or videos and subsequently utilize the described method and merging process to visualize the scene? I'm also seeking clarification on whether it's currently feasible to view an image frame and instantly create Gaussian Splatting from this input in real-time, followed by performing SLAM on a sequential frame-by-frame basis?
-
Do you already know, if it will be possible to release the code under Apache 2.0 or MIT license?
Thanks in advance and happy holidays.
from gaussian-slam.
-
I am glad that it helped!
-
We recorded the video of the scene after the segments were stitched. Potentially, you can implement stitching in parallel as SLAM reconstructs the segments, but we didn't do it due to time constraints. Regarding a custom RGB video, I think it is doable. I can imagine that it would work as follows: you record a video, run dense depth prediction on it for every frame, run SLAM on it (you will be able to plug any tracker that you want e.g. Orb-SLAM, Droid-SLAM, etc.), stitch the segments, and then obtain the scene which is renderable in real-time.
-
Regarding licensing it's a pain point right now - I just don't know. It is also the main reason why we can't release everything straight away.
from gaussian-slam.
Related Issues (20)
- code release date HOT 4
- Вы крутые HOT 3
- Question about Table 1 and Table 2 in paper. HOT 4
- There are expressions about Lreg in the paper HOT 1
- Depth Supervision HOT 2
- What is minimum GPU requirement? HOT 1
- Update Project Page Link on Readme HOT 3
- 3D mesh export HOT 2
- how to visualize the result? HOT 3
- Tracking failure causes NaN HOT 1
- Custom Dataset HOT 4
- Run in online mode HOT 2
- Visualization of 3D Gaussians HOT 2
- Rendering opacity image HOT 1
- Installation Failed !! HOT 9
- About depthL1 metric HOT 2
- Camera frustum planes computation bug? HOT 2
- About the initialization of the pose for tracking optimization on Replica dataset HOT 4
- Is each sample point seeded with two gaussians? HOT 2
- Run it with d435i camera HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gaussian-slam.