Project Page
| Paper
| ReadPaper
| UniKPT data(coming soon) |Video
Jie Yang1,2, Ailing Zeng1, Ruimao Zhang2, Lei Zhang1
1International Digital Economy Academy 2The Chinese University of Hong Kong, Shenzhen
- 2023.10.13 : We release the arxiv version.
UniPose has strong fine-grained localization and generalization abilities across image styles, categories, and poses.
- Release inference code and demo [Expected on October 30th].
- Release checkpoints [Expected on October 30th].
- Release UniKPT dataloader and annotations[Expected on October 30th].
- Release training codes.
โข UniPose is the first end-to-end prompt-based keypoint detection framework.
โข It supports multi-modality prompts, including textual and visual prompts to detect arbitrary keypoints (e.g., from articulated, rigid, and soft objects).
If you find this repository useful for your work, please consider citing it as follows:
@article{yang2023unipose,
title={UniPose: Detection Any Keypoints},
author={Yang, Jie and Zeng, Ailing and Zhang, Ruimao and Zhang, Lei},
journal={arXiv preprint arXiv:2310.08530},
year={2023}
}
@inproceedings{yang2023neural,
title={Neural Interactive Keypoint Detection},
author={Yang, Jie and Zeng, Ailing and Li, Feng and Liu, Shilong and Zhang, Ruimao and Zhang, Lei},
booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
pages={15122--15132},
year={2023}
}
@inproceedings{yang2022explicit,
title={Explicit Box Detection Unifies End-to-End Multi-Person Pose Estimation},
author={Yang, Jie and Zeng, Ailing and Liu, Shilong and Li, Feng and Zhang, Ruimao and Zhang, Lei},
booktitle={The Eleventh International Conference on Learning Representations},
year={2022}
}