Giter Club home page Giter Club logo

nlos-track's Introduction

NLOS Tracking

Project Website arXiv Dataset Download

Official codes of CVPR 2023 Paper | Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking

Prepreation

Environment

Create a new environment and install dependencies with requirement.txt:

conda create -n NLOS_Tracking

conda activate NLOS_Tracking

conda install --file requirements.txt

Data

The NLOS-Track dataset can be downloaded from kaggle.

The file structure in project root should be as follow:

project_root
|   README.md
|   requirements.txt
|   train.py
+---data
+---utils
+---configs
|   ...
+---dataset
    +---render
    |   +---0000
    |   |      configs.yaml
    |   |      route.mat
    |   |      video_128.npy
    |   |      001.png
    |   |      002.png
    |   |      ...
    |   +---0001
    |       ...
    +---real-shot
        +---0000
        |      route.mat
        |      video_128.npy
        +---0001
            ...

Data Loading and Visualization

Follow the code blocks in data_playground.ipynb to load and visualize the dataset.

Usage

Train

Before training, fill the missing items in configuration files.

Create a new configuration file in ./configs for training:

python train.py --cfg_file=new_cfg --model_name=PAC_Net

or directly use default.yaml by default:

python train.py --model_name=PAC_Net --pretrained -b 64 -lr_b 2.5e-4 --gpu_ids=0,1 --port=8888

Test

Follow the code blocks in test.ipynb to test a trained model.

Citation

@article{wang2023nlosTrack,
  author   = {Wang, Yihao and Wang, Zhigang and Zhao, Bin and Wang, Dong and Chen, Mulin and Li, Xuelong},
  title    = {Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking},
  journal  = {CVPR},
  year     = {2023},
}

nlos-track's People

Contributors

againstentropy avatar batman47steam avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

nlos-track's Issues

Questions related to the metrics

In compute_track_metrics functions, all these metrics have been averaged on the sequence length T (pcm / T, area / T, dtw / T). but in the compute_batch_metrics, it seems that the result is not averaged over batch dimensions, it returns the sum of these metrics in a batch. I'm not sure if this is why larger batch sizes lead to higher values for these metrics. I also trained with batch_size = 6, the pcm, area, and dtw metrics is much lower than batch_size = 32
image

image

Furthermore, could you please explain how the RMS_x and RMS_v metrics are calculated?

Negative values in the npy file

Hi, In the simulation dataset, for example, 944, there are some negative values in video_128.npy and video_128_noisy.npy, was an additional data enhancement operation performed?

image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.