Comments (2)
Thanks for pointing this out and the fix! I will merge it in 2 weeks.
Thomas
from nngeometry.
Actually I think this is the correct behavior, since [nn.Linear(100, 100)] * 10
will stack the same layer (same object instance) 10 times, sharing the same parameters, as opposed to e.g. [nn.Linear(100, 100) for i in range(10)]
which will instantiate 10 different layers, with their own parameters.
However the current implementation cannot handle sharing parameters between layers. For instance, recurrent networks won't work.
from nngeometry.
Related Issues (20)
- Error with FIM for resnet18 HOT 1
- shapes pbs (x2) HOT 1
- what's the meaning of implementing the hook_compute_diag function? HOT 3
- An error encountered when running code HOT 2
- What is the use of classif_logits variant? HOT 1
- How to compute FIM with nn.DataParallel(model)? HOT 2
- Is there 'regression' option in FIM_MonteCarlo? HOT 6
- matrix visualization HOT 1
- compute KFAC matrix on big network HOT 3
- Information to include in the FIM() loader argument HOT 1
- RuntimeError: Shape is invalid for input of size HOT 4
- Simple Model: RuntimeError: One of the differentiated Tensors appears to not have been used in the graph. HOT 2
- Scaling of parameter space representations HOT 2
- compute FIM of partial parameters HOT 1
- Error with float64 tensors HOT 2
- Adding support for Conv1d layers HOT 2
- Make differentiating inputs optional HOT 2
- Error: `I do not know what to do with layer Embedding(50304, 512)` HOT 4
- [suggestion] Ignore unsupported modules option HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nngeometry.