Comments (3)
Hey
I have now added a model M0 on the master branch that is faster to train than the previous models. Running a command to train 1 epoch takes ~10s on my laptop with it, so hopefully it will speed things up a little. The model isn't really a 'smallest possible' and could be scaled down more, but since the majority of the time is spent on loading and preprocessing the data, I don't think a smaller one would matter so much for total runtime at this point.
We are working on speeding up the data loading process, hopefully that feature will be added soon.
I can have a look at making a p0 model soon as well.
Best,
K
from genocae.
@kausmees that is great, thanks so much, I will try it out soon!
but since the majority of the time is spent on loading and preprocessing the data
Would that be true for a simulated dataset of 3 individuals with 1 SNP and phenotype as well? Those are what I use for testing :-)
from genocae.
@kausmees that new model is great! It brought a full GitHub Actions test run to 3 minutes!
Happily closing this Issue 👍
from genocae.
Related Issues (20)
- Suggest + volunteer: text files are not executable HOT 4
- Suggest + volunteer: rename HumanOrigins249_tiny.eigenstratgeno to HumanOrigins249_tiny.bed HOT 2
- Conversion to PLINK format failed for .bed file HOT 3
- Suggest: improve CLI error messages HOT 1
- Idea: use Swish instead of ELU? HOT 1
- What is the cause for 'ValueError: Dimensions must be equal'? HOT 3
- Could AasaJohanssonUU be added as a Collaborator? HOT 3
- GCAE cannot run 'project' with a phenotype, how to fix? HOT 1
- GCAE gives error when running 'project' with a phenotype HOT 14
- Use 'project' without a 'HO_superpopulation' file HOT 4
- Use 'evaluate' without the `HO_superpopulation` file HOT 6
- GenoCAE build fails due to upstream update HOT 1
- Docker script does not build anymore? HOT 4
- evaluate with superpops: how is the average calculated? HOT 2
- Docker building error due to python requirements HOT 1
- `2022-06-23 09:25:59.298713: W tensorflow/core/framework/cpu_allocator_impl.cc:82] Allocation of 19113388800 exceeds 10% of free system memory.` HOT 3
- Projecting non-population metadata HOT 6
- Extracting feature importance
- Error while building docker container
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from genocae.