Comments (3)
The one being hard-coded is for the models. We follow HMR and other hand/body regressors to use a fixed focal length (1000.0) in this case with a weak perspective camera.
You can also use the groundtruth intrinsics in meta info, but you might need to re-train the model. Furthermore, we tried to train with groundtruth intrinsics for the MANO parameter regression, but it is rather unstable. I think the problem was that, the model has to then adapt to different focal length changes due to the cropping and resizing effect using different bounding boxes.
from arctic.
Also, why is ground truth intrinsics used during evaluation on egocentric images (why not hard coded values or using ground truth for allocentric images as well?)
arctic/src/datasets/arctic_dataset.py
Lines 406 to 410 in f91ca2b
from arctic.
I wrote this last year. I remember the reason was because an intrinsics matrix with use_gt_k=False
will cause large misalignment when meshes are projected onto the pixel space for egocentric setting. This is because weak perspective camera assumes far away meshes, but for egocentric setting it is close up.
Therefore, we use the groundtruth intrinsics here so that the 2d projection of the meshes on the images will be more aligned.
Now, since we are using groundtruth intrinsics here, we need to make sure the intrinsics does not change for feasibility in model training. Therefore, we do not apply scaling in data augmentation, which is why augm_dict["sc"] = 1.0
. Since image scale does not change, the intrinsics will not change.
from arctic.
Related Issues (20)
- Purpose of `toggle_parameters` HOT 1
- Joint visibility labeling HOT 2
- Error in raw data proccessing HOT 1
- Leaderboard submission HOT 2
- How to get from hand kp3d to kp2d? HOT 13
- Questions for the image resize details HOT 1
- Updated intrinsics for the cropped images? HOT 3
- Marker positions in 3D or 2D HOT 7
- Hand-Object Tracking HOT 3
- Is there a way to generation full body motion together with the Arctic hand motions? HOT 1
- Problem regarding translation HOT 5
- Visualize Contact Areas HOT 1
- SMPLX shape HOT 1
- Possible inconsistency in the MoCap labels? HOT 1
- Background Images? HOT 3
- Does MANO parameters equal to SMPLX hand parameters? HOT 2
- Some more details about the pretrained models HOT 3
- how to export contact info HOT 6
- Cropped image size && mask image size HOT 2
- Hand-object mesh mismatch with the manopth HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arctic.