Giter Club home page Giter Club logo

squeezenext.pytorch's Introduction

SqueezeNext: Hardware-Aware Neural Network Design

Introduction

The codes are PyTorch re-implement version for paper: SqueezeNext: Hardware-Aware Neural Network Design. (SqueezeNext)

Gholami A, Kwon K, Wu B, et al. SqueezeNext: Hardware-Aware Neural Network Design[J]. 2018. arXiv:1803.10615v1

We implement this work from amirgholami/SqueezeNext.

Structure

Here, we use a variation of the latter approach by using a two stage squeeze layer. In each SqueezeNext block, we use two bottleneck modules each reducing the channel size by a factor of 2, which is followed by two separable convolutions. We also incorporate a final 1 ร— 1 expansion module, which further reduces the number of output channels for the separable convolutions.

Block

SqNxt

Requirements

  • jupyter notebook
  • Python3
  • PyTorch 0.4

Results

We just test four models in three datasets: Cifar10, Cifar100 and Tiny ImageNet

Cifar-10

Models train(Top-1) validation(Top-1) width depth
SqNxt_23_1x 98.7 91.9 1.0x 23
SqNxt_23_2x 99.9 93.1 2.0x 23
SqNxt_23_1x_v5 99.4 91.9 1.0x 23
SqNxt_23_2x_v5 99.8 93.1 2.0x 23

Cifar-100

Models train(Top-1) validation(Top-1) width depth
SqNxt_23_1x 94.1 69.3 1.0x 23
SqNxt_23_2x 99.7 73.1 2.0x 23
SqNxt_23_1x_v5 94.7 70.1 1.0x 23
SqNxt_23_2x_v5 99.8 73.2 2.0x 23

Tiny ImageNet

Models train(Top-1) validation(Top-1) width depth
SqNxt_23_1x 71.1 53.5 1.0x 23
SqNxt_23_2x 77.2 56.7 2.0x 23
SqNxt_23_1x_v5 70.9 52.7 1.0x 23
SqNxt_23_2x_v5 72.4 56.7 2.0x 23

squeezenext.pytorch's People

Contributors

luuuyi avatar

Watchers

James Cloos avatar Qu Lei avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.