MXNet implementation for:

Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

Note:

• This repo is under development.

• Code for ablation study (by Symbol API)
• Trained models (ablation)
• Code for the rest exps (by Gluon API)
• Trained models (rest exps)

• Loss: Softmax
• Learning rate: Cosine (warm-up: 5 epochs, lr: 0.4)
• MXNet API: Symbol API

Note:

• Top-1 / Top-5, single center crop accuracy is shown in the table. (testing script)
• All residual networks in ablation study adopt pre-actice version[1] for convenience.

• Learning rate: Cosine (warm-up: 5 epochs, lr: 0.4)
• MXNet API: Gluon API

@article{chen2019drop,
  title={Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution},
  author={Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
  journal={arXiv preprint arXiv:1904.05049},
  year={2019}
}

• PyTorch Implementation with imagenet training log and pre-trained model by d-li14
• MXNet Implementation with imagenet training log by terrychenism
• Keras Implementation with cifar10 results by koshian2

• Thanks MXNet, Gluon-CV and TVM!
• Thanks @Ldpe2G for sharing the code for calculating the #FLOPs (link)
• Thanks Min Lin (Mila), Xin Zhao (Qihoo Inc.), Tao Wang (NUS) for helpful discussions on the code development.

[1] He K, et al "Identity Mappings in Deep Residual Networks".

[2] Christian S, et al "Rethinking the Inception Architecture for Computer Vision"

[3] Zhang H, et al. "mixup: Beyond empirical risk minimization.".

The code and the models are MIT licensed, as found in the LICENSE file.