d-li14 / dhm Goto Github PK
View Code? Open in Web Editor NEW[CVPR 2020] Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives
Home Page: https://arxiv.org/abs/2003.10739
License: MIT License
[CVPR 2020] Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives
Home Page: https://arxiv.org/abs/2003.10739
License: MIT License
thanks for the amazing paper. the git said : while no computatonal overheads are introduced after discarding those auxiliary branches during inference.
do you mean we can pick out the corresponding weights(main branch) from the trained weight???
Hope your replay! Thanks
To stabilize the training process and avoid further regularization
effect, we fork auxiliary classifiers from each node of
the backbone network with probabilities toggling between
zero and one in our main experiments, following a binary
sampling strategy along the axis of network forward propagation.
I am not sure what these words means. From the code https://github.com/d-li14/DHM/blob/master/imagenet.py#L326, it seems you just calculate all the combinations of mimicking losses.
Hi there, great paper! I had a question regarding this line in the paper:
Locations of such intermediate layers are dynamically drawn from a given discrete probability distribution at each training epoch.
I am a bit confused, how do you actually find out which intermediate layers to add auxiliary classifiers to? I also don't see a code snippet for that, I only see auxiliary classifiers from head_3 and head_4 hardcoded. Can you please help understand this line?
Thank You again!
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.