Giter Club home page Giter Club logo

srcf's Introduction

LICENSE Python PyTorch

A Simple and Robust Correlation Filtering method for text-based person search

We provide the code for reproducing results of our ECCV 2022 paper A Simple and Robust Correlation Filtering method for text-based person search. Compared with the original paper, we obtain better performance due to some modifications. Following our global response map, we also add the same mutual-exclusion-loss to separate body part response map. Meanwhile, we merge the global filter and dictionary filter module. The adjusted method achieves a new state-of-the-art performance and it improves to 64.88 on Top-1 without Re-Rank (CUHK-PEDES).

Getting Started

Requirements

  • PyTorch 1.4 or higher
  • transformers (install with pip install transformers)
  • numpy, torchvision

Dataset Preparation

Organize them in dataset folder as follows:

|-- dataset/
|   |-- <CUHK-PEDES>/
|       |-- imgs
            |-- cam_a
            |-- cam_b
            |-- ...
|       |-- reid_raw.json

Download the CUHK-PEDES dataset from [here](https://github.com/ShuangLI59/Person-Search-with-Natural-Language-Description) and then run the `process_CUHK_data.py` as follow:
cd SRCF
python ./dataset/process_CUHK_data.py

Building BERT

mkdir bert_weight

Downland the weight and config, put them into SRCF/bert_weight

Training and Testing

bash run/train.bash 

Evaluation

bash run/test.bash

Results on CUHK-PEDES

CUHK-PEDES performance
Top-1 64.88
Top-5 83.02
Top-10 88.56

Citation

If this work is helpful for your research, please cite our work:

@InProceedings{Suo_ECCV_A,
author = {Suo, Wei and Sun, MengYang and Niu, Kai, et.al},
title = {A Simple and Robust Correlation Filtering method for text-based person search},
booktitle = {The European Conference on Computer Vision (ECCV)},
month = {August},
year = {2022}
}

References

SSAN

srcf's People

Contributors

suo-wei avatar

Stargazers

chenyushan avatar YukiWoo avatar WOOJUNG SON avatar Hogan avatar  avatar Han Yingjie avatar WX1999 avatar Alena avatar lihuran1998 avatar  avatar  avatar Fei Shen avatar Feng Chen avatar hugyyy avatar  avatar Lin Min avatar ampulla avatar  avatar  avatar Tianyi Yan avatar manbo avatar

Watchers

 avatar

srcf's Issues

Drawing visual and textual response maps

Hi,
In your paper, I see that you have drawn the response maps in Figure 4 and 5.

May I ask how did you draw those maps? Did you use a third-app tool or the code that included in your research? Thank you very much.

question of accuracy

May I ask if top-1 in the paper refers to top-1 of similarity_all in the code?
请问论文中top-1的精度就是指代码里similarity_all的top-1吗?

No module named 'model.text_feature_extract'

Hi, thanks for your sharing, i meet the following problem:

File "src/train.py", line 8, in
from model.model import TextImgPersonReidNet
File "/media/data/zyk10086/SRCF/src/model/model.py", line 6, in
from model.text_feature_extract import TextExtract
ModuleNotFoundError: No module named 'model.text_feature_extract'

What is the pytorch_pretrained_bert package?

Great work, and thanks for your sharing!
When I reproduce this work, the following error occurs.

Traceback (most recent call last):
  File "E:\Share\jupyterDir\SRCF-main\SRCF-main\src\test.py", line 8, in <module>
    from data.dataloader import get_dataloader
  File "E:\Share\jupyterDir\SRCF-main\SRCF-main\src\data\dataloader.py", line 9, in <module>
    from data.dataset import CUHKPEDEDataset, CUHKPEDE_img_dateset, CUHKPEDE_txt_dateset
  File "E:\Share\jupyterDir\SRCF-main\SRCF-main\src\data\dataset.py", line 17, in <module>
    from pytorch_pretrained_bert.tokenization import BertTokenizer
ModuleNotFoundError: No module named 'pytorch_pretrained_bert'

And I cannot find this package in all files.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.