amlab-amsterdam / l0_regularization Goto Github PK
View Code? Open in Web Editor NEWLearning Sparse Neural Networks through L0 regularization
License: MIT License
Learning Sparse Neural Networks through L0 regularization
License: MIT License
Would it be possible to get a README file that explicitly describes how to run the experiments from the paper?
Please remove .data[0] and put .item() because of this post and Accumulating losses
It seems that there is a little bug in the code which causes the training to stop after one epoch at line 172. The args,type_net in train_wide_resnet.py is not defined. I think that the args,type_net argument should be added right after defining the argument parser in line 17.
The wide-resnet experiments provided in the repository does not appear to replicate the results in the paper.
Upon running the experiment, neither the expected L0 norm or the expected flops changes at all
This is corroborated by the following excerpt from the paper The State of Sparsity in Deep Neural Networks (https://arxiv.org/pdf/1902.09574.pdf).
Would greatly appreciate any feedback on how to utilize this repository to replicate L0 regularization on Wide Resnets for the CIFAR datasets.
Dear authors,
Please have a look at third term in equation(26) in the paper. I don't think the normalization (Q(1)-Q(0)) should be included. Please check if I were wrong.
Best,
Tianjian
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.