Giter Club home page Giter Club logo

the-lottery-ticket-hypothesis-binary-neural-networks-pruning's Introduction

The-Lottery-Ticket-Hypothesis-Binary-Neural-Networks-Pruning

Made With python 3.7

This repository contains a Pytorch implementation of the paper Multi-prize Lottery Ticket Hypothesis.

Requirements

pip3 install -r requirements.txt

Quick Start

Using datasets/models included with this repository :

python3 main.py
  • --lr : Learning rate
    • Default : 1.2e-3
  • --epochs : Number of cycle of pruning that should be done.
    • Default : 50
  • --test_freq : Frequency for Validation
    • Default : 50
  • --batch_size : Batch size
    • Default : 60
  • --dataset : Choice of dataset
    • Options : mnist, cifar10
    • Default : mnist
  • --arch_type : Type of architecture
    • Options : fc1 - Simple fully connected network, lenet5 - LeNet5, AlexNet - AlexNet, resnet18 - Resnet18, vgg16 - VGG16
    • Default : fc1
  • --prune_percent : Percentage of weight to be pruned after each cycle.
    • Default : 5
  • --mini_batch : Experiment on mini-batch
    • Default : False
  • --score : Using score matrix to determine the pruning mask
    • Default : False
  • --binarize : Model binarization
    • Default : False

Repository Structure

The-Lottery-Ticket-Hypothesis-Binary-Neural-Networks-Pruning
├── models
│   ├── cifar10
│   │   ├── AlexNet.py
│   │   ├── fc1.py
│   │   ├── LeNet5.py
│   │   ├── resnet.py
│   │   ├── SmallVGG.py
│   │   └── vgg.py
│   └── mnist
│       ├── AlexNet.py
│       ├── fc1.py
│       ├── LeNet5.py
│       ├── resnet.py
│       ├── SmallVGG.py
│       └── vgg.py
├── dumps
├── main.py
├── plots
├── README.md
├── requirements.txt
├── saves
└── utils.py

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.