Question about cam projection. about vibe HOT 3 CLOSED

Hi @jackspp,

Thanks for your interest. The estimated camera is weak perspective, but if you assume a focal length you can convert it to perspective camera. That line is used to convert weak perspective to perspective camera. It is common to assume a fixed focal length to perform perspective projection. We borrowed that part from SPIN implementation.

from vibe.

Hi @mkocabas sorry to bother you again.
I have a question about the pred_camera[:, 1:3], which is used later in

from vibe.

Hi @jackspp,

Thanks for your interest. The estimated camera is weak perspective, but if you assume a focal length you can convert it to perspective camera. That line is used to convert weak perspective to perspective camera. It is common to assume a fixed focal length to perform perspective projection. We borrowed that part from SPIN implementation.

Hi @mkocabas sorry to bother you again.
I found the cam params converge worse, and i use weak perspective in my code, in which kpy_2d = scale(kyp3d[, :2] + txy ). I think the key reason is the focal length of the dataset is different with each image, and it range from 400 mm to 800 mm. So maybe the network cannot regress the scale well?
As u said "It is common to assume a fixed focal length to perform perspective projection. " . I wonder if the performance would be improved if i use perspective projection instead of weak perspective?

from vibe.