v-pnk / cadloc Goto Github PK
View Code? Open in Web Editor NEWBenchmark for visual localization on imperfect 3D mesh models from the Internet
Home Page: https://v-pnk.github.io/cadloc/
License: BSD 3-Clause "New" or "Revised" License
Benchmark for visual localization on imperfect 3D mesh models from the Internet
Home Page: https://v-pnk.github.io/cadloc/
License: BSD 3-Clause "New" or "Revised" License
Hello dear author!
These two works are excellent, which is very novel for researchers working in fields related to visual localization!
I would like to consult two questions as follows:
Firstly, the 12 Scenes dataset is used as experimental data in MeshLoc. This dataset utilizes the RGB-D SLAM method to reconstruct a 3D model of the scene. MeshLoc makes use of the depth map obtained from the rendered model to recover the connection between the features on the query image and the 3D coordinates corresponding to the world coordinate system. So can I understood that the textures on the 3D model don't work? It is the geometric accuracy of the 3D model (e.g. point cloud depth accuracy and mesh construction method) that plays a role, as well as the method of rendering?
Secondly, in the article Visual Localization using Imperfect 3D Models from the Internet, CAD models are used, which is a very novel idea! Have the authors ever thought of using NERF as a rendering to complete the image retrieval, and using imperfect models (e.g. CAD models) to complete a rough localization result, and then later using this NERF network with fixed parameters to invert and optimize the rough localization result?
Looking forward to your reply! Thanks very much!
Hi, I've tried to check the Tref proveded in the benchmark page. It works well for Notre Dame A which is in obj file, however for other collada files (.dae), the transform matrix seems not quite correct as I apply the matrix in Meshlab. This also seems not correct when I export the model from Sketchup to obj file.
So my question is: how can I perform transformation correctly to those collada files in order to align them to the reference ply mesh?
Thanks for sharing the benchmark!
I've got a question on your MeshLoc visual localization process. In the paper you've mentioned that if we only have a 3D model of the scene and no database images, we use the rendered images as the database images. So the image retrieval stage used the rendered images rather than real images?
I wonder how this method performances since low textured CAD model may lead to bad retrieval results.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.