Error while camera pose testing about geonet HOT 11 CLOSED

Hi, can you confirm if your python and tensorflow versions are consistent with ours?

from geonet.

Python version is 2.7.12 and tensorflow is 1.1.0

from geonet.

Can you post your test command here? Please make sure the seq_length is consistent between data preparation and test stage. Also, try to run the code within a single GPU.

from geonet.

The full command is as follows python geonet_main.py --mode=test_pose --dataset_dir=/ravikt/geonet_data/processed/ --init_ckpt_file=/ravikt/geonet/geonet_posenet/model --batch_size=1 --seq_length=5 --pose_test_seq=8 --output_dir=/ravikt/geonet_data/predictions/
The code ran error free on the processed data on a single gpu with --seq_length=5. However, I did not get any output predictions. The image loading part in geonet_test_pose.py assumes the directory structure to be of the form sequences/08/image_2, but the after running prepare_train_data.py we do not obtain the data in that format. I am doubtful if the code is able to read the images at all. Do I need to to put all the images in separate image_2 folder ?

The processed data is in jpg, After I changed .png in

from geonet.

I guess the data preprocessing is incorrect. Can you post your data preprocessing command here as well? Also, check your formatted data storage. If these files are generated properly, I'm pretty sure you will get reasonable results.

from geonet.

python prepare_train_data.py --dataset_dir=/home/ravikt/geonet_data/original/ --dataset_name=kitti_odom --dump_root=/home/ravikt/geonet_data/processed/ --seq_length=5 --img_height=128 --img_width=416 --num_threads=16 --remove_static

the processed data has the following directory structure

├── sequences
│   ├── 00
│   ├── 01
│   ├── 02
│   ├── 03
│   ├── 04
│   ├── 05
│   ├── 06
│   ├── 07
│   └── 08
├── train.txt
└── val.txt

The directory structure inside 08 is as follows. times.txt is from the original KITTI odom dataset

.
├── image_0
│   ├── 000002_cam.txt
│   ├── 000002.jpg
│   ├── 000003_cam.txt
│   ├── 000003.jpg
 .    .
 .    .
│   ├── 004068_cam.txt
│   ├── 004068.jpg
└── times.txt

from geonet.

You should pass the original KITTI odometry dataset to the --data_dir argument instead of the processed dataset. This was clarified in the readme file.

from geonet.

I did pass the originals. The first post in this issue has output error messages for both seq_length of 3 and 5. Those errors are encountered at

However, your readme clearly states "For replicating our results in all of the three tasks (monocular depth, camera pose and optical flow), you need to download the following datasets, and preprocess them into certain formats"

Are you suggesting that preprocessed data is only for training phase and the original data for testing ?

from geonet.

Yes, please read the test part of our readme file more carefully. Your last posted command suggests the usage of the formatted dataset. There also exists inconsistency between different commands you posted. Again, use a single GPU and the original dataset for test.

from geonet.

Ok, The last posted command is only for data preprocessing, since you asked if the formatted data is generated correctly.
I am running the test on original dataset using the following
python geonet_main.py --mode=test_pose --dataset_dir=/ravikt/geonet_data/original/ --init_ckpt_file=/ravikt/geonet/geonet_posenet/model --batch_size=1 --seq_length=5 --pose_test_seq=9 --output_dir=/ravikt/geonet_data/predictions/
it gives
File "/ravikt/geonet/GeoNet/geonet_test_pose.py", line 60, in test_pose inputs[b] = image_seq ValueError: could not broadcast input array from shape (128,416,5) into shape (128,416,15)

from geonet.

Hi @yzcjtr . Thank you for the patient answers. I will have look again on the codes and readme.

from geonet.