Giter Club home page Giter Club logo

cosi159_pruningimprovement's Introduction

Improvement based on "Pruning Filters For Efficient ConvNets"

Unofficial PyTorch implementation of pruning VGG on CIFAR-10 Data set

Reference: Pruning Filters For Efficient ConvNets, ICLR2017

Requirements

  • torch (version: 1.2.0)
  • torchvision (version: 0.4.0)
  • Pillow (version: 6.1.0)
  • matplotlib (version: 3.1.1)
  • numpy (version: 1.16.5)

Usage

Arguments

  • --train-flag: Train VGG on CIFAR Data set
  • --save-path: Path to save results, ex) trained_models/
  • --load-path: Path to load checkpoint, add 'checkpoint.pht' with save_path, ex) trained_models/checkpoint.pth
  • --resume-flag: Resume the training from checkpoint loaded with load-path
  • --prune-flag: Prune VGG
  • --prune-layers: List of target convolution layers for pruning, ex) conv1 conv2
  • --prune-channels: List of number of channels for pruning the prune-layers, ex) 4 14
  • --independent-prune-flag: Prune multiple layers by independent strategy
  • --retrain-flag: Retrain the pruned nework
  • --retrain-epoch: Number of epoch for retraining pruned network
  • --retrain-lr: Number of epoch for retraining pruned network

Drop out & VGG-19

You can follow the procedure of prune filter in the .ipynb file but switch the network to the corresponding network file: drop_out_network.py and VGG_19_network.py

Quantization

quantization.py file apply quantization to the original VGG-16 model. we created a new network trying to fit the pruned and retrained network into the original model which unfortunately failed.

Write Up

https://drive.google.com/drive/folders/1vxF0YL90rF_19sQyHhwGfC_WtgVl7NmW?usp=drive_link

cosi159_pruningimprovement's People

Contributors

yijiesong816 avatar xinyishang avatar

Watchers

 avatar

Forkers

yijiesong816

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.