BRINet for referring image segmentation

This repository contains code for 'Bi-directional Relationship Inferring Network for Referring Image Segmentation', CVPR 2020.

If you find this work useful in your research, please consider citing:

@inproceedings{BRINet_CVPR2020,
  author = {Hu, Zhiwei and Feng, Guang and Sun, Jiayu and Zhang, Lihe and Lu, Huchuan},
  title = {Bi-directional Relationship Inferring Network for Referring Image Segmentation},
  booktitle = {CVPR},
  year = {2020}
}

Paper link

The paper can be found in Baidu drive (fetch code:5606).

Code

Requirement

• Python 3.5
• Tensorflow 1.8
• PyDenseCRF

Setup

Partial coda and data preparation are borrowed from TF-phrasecut-public. Please follow their instructions to make your setup ready. DeepLab backbone network is based on tensorflow-deeplab-resnet as well as the pretrained model for initializing weights of our model.

Sample code

Training

python main_cmsa.py -m train -w deeplab -d Gref -t train -g 0 -i 800000

Testing

python main_cmsa.py -m test -w deeplab -d Gref -t val -g 0 -i 800000