Giter Club home page Giter Club logo

nanotrack's Introduction

NanoTrack

network

  • NanoTrack is a lightweight and high speed tracking network which mainly referring to SiamBAN and LightTrack. It is suitable for deployment on embedded or mobile devices. In fact, it can run at >120FPS on Apple M1 CPU. macs

  • Experiments show that NanoTrack algorithm has good performance on tracking datasets.

    Trackers Backbone ModeSize VOT2018 EAO VOT2019 EAO GOT-10k-Val AO GOT-10k-Val SR DTB70 Success DTB70 Precision
    NanoTrack MobileNetV3 2.2MB 0.311 0.247 0.604 0.724 0.532 0.727
    CVPR2021 LightTrack MobileNetV3 7.7MB 0.418 0.328 0.75 0.877 0.591 0.766
    WACV2022 SiamTPN ShuffleNetV2 62.2MB 0.191 0.209 0.728 0.865 0.572 0.728
    ICRA2021 SiamAPN AlexNet 118.7MB 0.248 0.235 0.622 0.708 0.585 0.786
    IROS2021 SiamAPN++ AlexNet 187MB 0.268 0.234 0.635 0.73 0.594 0.791
  • We provide Android demo and MacOS demo based on ncnn inference framework.

  • We also provide PyTorch code. It is friendly for training with much lower GPU memory cost than other models. NanoTrack only uses GOT-10k dataset to train, which only takes two hours on GPU3090.

Mac

PC demo

    1. Modify your own CMakeList.txt
    1. Build (Apple M1 CPU)
    $ sh make_macos_arm64.sh 
    

Android

Android demo

    1. Modify your own CMakeList.txt
    1. Download(password: 6cdd) OpenCV and NCNN libraries for Android

Reference

https://github.com/Tencent/ncnn

https://github.com/Z-Xiong/LightTrack-ncnn

https://github.com/FeiGeChuanShu/ncnn_Android_LightTrack

nanotrack's People

Contributors

honglinchu avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

nanotrack's Issues

error: ‘class ncnn::Extractor’ has no member named ‘opt’

hi,professor:
i compile your example code nanotrack-macos, i got an error:
error: ‘class ncnn::Extractor’ has no member named ‘opt’
ex_backbone.opt.use_vulkan_compute = true;

why got this compile error?
i use ncnn-20220420-full-source.zip, ncnn is compile from this source code.
please HELP!

编译问题

林哥你好,我是ubuntu的系统,那么这行命令应该怎么修改呢:cmake -DCMAKE_SYSTEM_PROCESSOR=arm64 -DCMAKE_OSX_ARCHITECTURES=arm64 .. \

nanotrack_backbone_sim-opt.param and .bin

nanotrack_backbone_X255.pt and nanotrack_backbone_T127.pt,how to convert them to nanotrack_backbone_sim-opt.bin and nanotrack_backbone_sim-opt.param?
How to convert two pt files into one bin and param files?

some question about backbone net input size?

hi,professor:
i fllow your code, and try convert to tensorrt code, i convert backbone net to onnx format ok, i use netron , then input size is
image
,but i debug your ncnn-macos code, i find code below:
ncnn::Mat ncnn_img = ncnn::Mat::from_pixels(z_crop.data, ncnn::Mat::PIXEL_BGR2RGB, z_crop.cols, z_crop.rows);
printf("ncnn_img.w:%d,ncnn_img.h:%d\n",ncnn_img.w,ncnn_img.h);

the result is ncnn_img.w=127, ncnn_img.h=127;
so, what the real size for backbone input node??
how can i deal with this problem?
PLEASE HELP!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.