jiawen-zhu / hqtrack Goto Github PK
View Code? Open in Web Editor NEWTracking Anything in High Quality
License: MIT License
Tracking Anything in High Quality
License: MIT License
Dear authors, will the training code for VMOS be released?
The default AOT model is DeAOTL model. What if we need to switch to light-weight models such as DeAOTT? Can we download directly from https://github.com/yoxu515/aot-benchmark/blob/main/MODEL_ZOO.md? Is there anything we need to change inside the code?
Thank you!
Hello,
I was trying to run the demo.py file but I had the error below:
: cannot connect to X server
I ran it in a docker environment. Do you have any suggestion? Thank you!
Hey dude,
Compare to https://github.com/gaomingqi/Track-Anything
I mean except HQ Sam and your tracker backbone, in previous one they were using Xmem for tacking.
Also those https://github.com/z-x-yang/Segment-and-Track-Anything
https://github.com/qiaoyu1002/Inpaint-Anything
Thanks
Thanks for the technical report and demo code!
Do you have preliminary results on the MOT17/MOT20 benchmarks? Or do your plan to publish them in the final paper?
Hi!
Very cool work! It would be nice to create a demo on the Hugging Face Hub!
Some of the benefits of sharing your models through the Hub would be:
versioning, commit history and diffs
repos provide useful metadata about their tasks, languages, metrics, etc that make them discoverable
multiple features from TensorBoard visualizations, PapersWithCode integration, and more
wider reach of your work to the ecosystem
This is a step-by-step guide explaining the process in case you're interested.
Please let us know if you would be interested and if you have any questions. ๐
Hello,
I was trying to run the demo.py file but I had the error above, so I figured that in the code it is written as vit_l model which is not shared so I changed it as below :
model_type = 'vit_h' sam_checkpoint = os.path.join(base_path, '..', 'segment_anything_hq/pretrained_model/sam_hq_vit_h.pth')
Great job, by the way.
Please provide info about the speed of the model in the Readme, e.g. frame rate of inference, on a reference GPU, so that people can more quickly decide whether it's suitable for their use cases. Thanks.
It is taking very much long time for testing the tracker and packing the results while running bash run.sh
when I want to install Pytorch-Correlation-extension I get this error:
python setup.py install
TypeError: expected string or bytes-like object
Thank you for any help/hint !
Hi! What is the recommended compute for inference and eventually training? Also, if high, will there be a light version released for real time or low compute usecases, similar to sam-hq releasing ViT-Tiny HQ-SAM model in https://github.com/SysCV/sam-hq
Hi Authors,
I just wanted to let you know that I follow your guide to reproduce the paper and code. but I run "python run_tracker_vot.py"
The whole program always holds on to this line code:
handle = vots_utils.VOT("mask",multiobject=True)
and can not continue it?
Do you know the reason for this issue?
I have configured the project, also I have modified the trackers.ini file as:
[HQTrack] # <tracker-name>
label = HQTrack
command = run_tracker_vot
protocol = traxpython
paths = /home/os_name/PycharmProjects/hq_track/VOTS23_workspace
Now when I am running the project using the following command:
~/PycharmProjects/hq_track/VOTS23_workspace$ bash run.sh
I am getting the exception as:
| | 0% [00:00<?]Unable to connect to tracker
Traceback (most recent call last):
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/utilities/cli.py", line 445, in main
do_evaluate(args)
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/utilities/cli.py", line 228, in do_evaluate
run_experiment(experiment, tracker, workspace.dataset, config.force, config.persist)
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/experiment/__init__.py", line 345, in run_experiment
experiment.execute(tracker, sequence, force=force, callback=progress)
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/experiment/multirun.py", line 146, in execute
with self._get_runtime(tracker, sequence, self._multiobject) as runtime:
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/experiment/__init__.py", line 185, in _get_runtime
if not runtime.multiobject:
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/tracker/trax.py", line 539, in multiobject
self._connect()
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/tracker/trax.py", line 549, in _connect
self._process = TrackerProcess(self._command, self._envvars, log=log, socket=self._socket, timeout=self._timeout)
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/tracker/trax.py", line 294, in __init__
raise e
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/vot/tracker/trax.py", line 287, in __init__
self._client = Client(
File "/home/os_name/PycharmProjects/hq_track/venv_hqtrack/lib/python3.8/site-packages/trax/client.py", line 66, in __init__
raise TraxException("Unable to connect to tracker")
trax.TraxException: Unable to connect to tracker
HQTrack/baseline | | 0% [00:00<?]
Packaging results for tracker HQTrack
| | 0% [00:00<?]Results are not complete for experiment baseline, sequence animal
Scanning |โ | 1% [00:00<00:21]Results are not complete for experiment baseline, sequence ants1
Results are not complete for experiment baseline, sequence bag
Results are not complete for experiment baseline, sequence basketball
Results are not complete for experiment baseline, sequence basketball-11
Results are not complete for experiment baseline, sequence beaker
Results are not complete for experiment baseline, sequence bear-6
Scanning |โโโโโโโ | 5% [00:00<00:04]Results are not complete for experiment baseline, sequence bicycle
Results are not complete for experiment baseline, sequence bicycle-7
Results are not complete for experiment baseline, sequence bird-15
Results are not complete for experiment baseline, sequence bird-2
Scanning |โโโโโโโโโโโ | 8% [00:00<00:04]Results are not complete for experiment baseline, sequence birds1
Results are not complete for experiment baseline, sequence boat
Results are not complete for experiment baseline, sequence bolt1
Results are not complete for experiment baseline, sequence book
Results are not complete for experiment baseline, sequence book-3
Scanning |โโโโโโโโโโโโโโโโ | 11% [00:00<00:03]Results are not complete for experiment baseline, sequence bottle
Results are not complete for experiment baseline, sequence bubble
Results are not complete for experiment baseline, sequence bull
Results are not complete for experiment baseline, sequence bus
Results are not complete for experiment baseline, sequence bus-2
Scanning |โโโโโโโโโโโโโโโโโโโโโ | 15% [00:00<00:02]Results are not complete for experiment baseline, sequence car
Results are not complete for experiment baseline, sequence car-9
Results are not complete for experiment baseline, sequence carchase
Results are not complete for experiment baseline, sequence cat
Results are not complete for experiment baseline, sequence cattle-13
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโ | 18% [00:00<00:03]Results are not complete for experiment baseline, sequence chameleon-20
Results are not complete for experiment baseline, sequence clownfish
Results are not complete for experiment baseline, sequence colorfish
Results are not complete for experiment baseline, sequence conduction1
Results are not complete for experiment baseline, sequence crab-18
Results are not complete for experiment baseline, sequence crab-6
Results are not complete for experiment baseline, sequence crabs1
Results are not complete for experiment baseline, sequence dancingshoe
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 24% [00:00<00:02]Results are not complete for experiment baseline, sequence deer
Results are not complete for experiment baseline, sequence diabolo
Results are not complete for experiment baseline, sequence diving
Results are not complete for experiment baseline, sequence dog
Results are not complete for experiment baseline, sequence dog-7
Results are not complete for experiment baseline, sequence dog1
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 28% [00:01<00:02]Results are not complete for experiment baseline, sequence dolphins
Results are not complete for experiment baseline, sequence domino_damselfish
Results are not complete for experiment baseline, sequence dragon
Results are not complete for experiment baseline, sequence drone
Results are not complete for experiment baseline, sequence drone1
Results are not complete for experiment baseline, sequence drone_across
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 32% [00:01<00:02]Results are not complete for experiment baseline, sequence duck
Results are not complete for experiment baseline, sequence f1
Results are not complete for experiment baseline, sequence fernando
Results are not complete for experiment baseline, sequence fish1
Results are not complete for experiment baseline, sequence fish2
Results are not complete for experiment baseline, sequence fishnet
Results are not complete for experiment baseline, sequence flag
Results are not complete for experiment baseline, sequence flag-3
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 38% [00:01<00:01]Results are not complete for experiment baseline, sequence flamingo1
Results are not complete for experiment baseline, sequence flyboard
Results are not complete for experiment baseline, sequence fox
Results are not complete for experiment baseline, sequence freesbiedog
Results are not complete for experiment baseline, sequence frisbee
Results are not complete for experiment baseline, sequence gametarget-7
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 42% [00:01<00:01]Results are not complete for experiment baseline, sequence goldfish
Results are not complete for experiment baseline, sequence goldfish-3
Results are not complete for experiment baseline, sequence gorilla-13
Results are not complete for experiment baseline, sequence gymnastics1
Results are not complete for experiment baseline, sequence gymnastics3
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 45% [00:01<00:01]Results are not complete for experiment baseline, sequence hand
Results are not complete for experiment baseline, sequence hand-9
Results are not complete for experiment baseline, sequence hand2
Results are not complete for experiment baseline, sequence hand3
Results are not complete for experiment baseline, sequence handball2
Results are not complete for experiment baseline, sequence hat-1
Results are not complete for experiment baseline, sequence hat-5
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 50% [00:01<00:01]Results are not complete for experiment baseline, sequence helicopter
Results are not complete for experiment baseline, sequence houseride
Results are not complete for experiment baseline, sequence iceskater2
Results are not complete for experiment baseline, sequence juggling
Results are not complete for experiment baseline, sequence kangaroo
Results are not complete for experiment baseline, sequence kite-10
Results are not complete for experiment baseline, sequence leaves
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 55% [00:01<00:01]Results are not complete for experiment baseline, sequence licenseplate
Results are not complete for experiment baseline, sequence lion-12
Results are not complete for experiment baseline, sequence marathon
Results are not complete for experiment baseline, sequence matrix
Results are not complete for experiment baseline, sequence monkey-3
Results are not complete for experiment baseline, sequence monkey-9
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 59% [00:01<00:01]Results are not complete for experiment baseline, sequence moorish_idol
Results are not complete for experiment baseline, sequence motorcycle
Results are not complete for experiment baseline, sequence motorcycle-1
Results are not complete for experiment baseline, sequence motorcycle-18
Results are not complete for experiment baseline, sequence nature
Results are not complete for experiment baseline, sequence orangefish
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 63% [00:02<00:01]Results are not complete for experiment baseline, sequence panda
Results are not complete for experiment baseline, sequence parkour
Results are not complete for experiment baseline, sequence person-12
Results are not complete for experiment baseline, sequence person-5
Results are not complete for experiment baseline, sequence pig-2
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 67% [00:02<00:01]Results are not complete for experiment baseline, sequence pool-15
Results are not complete for experiment baseline, sequence rabbit
Results are not complete for experiment baseline, sequence rabbit-10
Results are not complete for experiment baseline, sequence rabbits
Results are not complete for experiment baseline, sequence racing-16
Results are not complete for experiment baseline, sequence robot
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 71% [00:02<00:00]Results are not complete for experiment baseline, sequence robot-1
Results are not complete for experiment baseline, sequence robot-19
Results are not complete for experiment baseline, sequence robot-5
Results are not complete for experiment baseline, sequence rollerman
Results are not complete for experiment baseline, sequence run
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 74% [00:02<00:00]Results are not complete for experiment baseline, sequence sailing
Results are not complete for experiment baseline, sequence seagull
Results are not complete for experiment baseline, sequence seastar
Results are not complete for experiment baseline, sequence sepia-13
Results are not complete for experiment baseline, sequence sepia-8
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 78% [00:02<00:00]Results are not complete for experiment baseline, sequence shaking
Results are not complete for experiment baseline, sequence shark-2
Results are not complete for experiment baseline, sequence sheep-9
Results are not complete for experiment baseline, sequence singer3
Results are not complete for experiment baseline, sequence sitcom
Results are not complete for experiment baseline, sequence skateboard-8
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 82% [00:02<00:00]Results are not complete for experiment baseline, sequence skiing
Results are not complete for experiment baseline, sequence snake
Results are not complete for experiment baseline, sequence soccer1
Results are not complete for experiment baseline, sequence soldier
Results are not complete for experiment baseline, sequence squirrel
Results are not complete for experiment baseline, sequence stripedfish
Results are not complete for experiment baseline, sequence surfboard-12
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 87% [00:03<00:00]Results are not complete for experiment baseline, sequence tank-16
Results are not complete for experiment baseline, sequence tank-9
Results are not complete for experiment baseline, sequence tennis
Results are not complete for experiment baseline, sequence tiger-4
Results are not complete for experiment baseline, sequence train-7
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 90% [00:03<00:00]Results are not complete for experiment baseline, sequence transparent_fish
Results are not complete for experiment baseline, sequence uav1
Results are not complete for experiment baseline, sequence umbrella-19
Results are not complete for experiment baseline, sequence umbrella-9
Results are not complete for experiment baseline, sequence volleyball
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 94% [00:03<00:00]Results are not complete for experiment baseline, sequence volleyball-18
Results are not complete for experiment baseline, sequence volleyball-19
Results are not complete for experiment baseline, sequence whitefish
Results are not complete for experiment baseline, sequence wiper
Results are not complete for experiment baseline, sequence wubble_bubble
Results are not complete for experiment baseline, sequence yoyo-7
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 98% [00:03<00:00]Results are not complete for experiment baseline, sequence zebra-10
Results are not complete for experiment baseline, sequence zebra-16
Results are not complete for experiment baseline, sequence zebrafish1
Scanning |โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 100% [00:03<00:00]
Unable to continue, experiments not complete
I request you to kindly help me in solving this exception.
Can you provide a example code for running this tracker in a video in python?
Something like:
from HQTrack import tracker, plot_tracker
file_name = ""
frame_iterator = iter(generate_frames(file_path))
for frame in frame_iterator:
track_result = tracker.track(frame)
plot_tracker(track_result)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.