pp1cb_ss21's People
pp1cb_ss21's Issues
Stratified splitting of the data
Right now, the splitting is done only on a protein level and without stratification.
This means that each fold contains roughly (except if the number of samples is not divisible by the number of folds) the same number of proteins. However, these folds are not stratified, meaning that it may be the case that one fold only consists of disordered proteins, and another one consists of structured proteins only.
Stratification might be achieved using sklearns StratifiedKFold, but we have to ensure that proteins are not split.
If noone has an idea how to do this, we could alternatively just implement a sanity check, for example plotting a z-score histogram for each fold.
Collate_fn
In order to train a NN, we should load out the dataset into the PyTorch DataLoader. However, the length of X and y are not equal, so one has to pre-process or pad them.
To do so, we can define collate_fn function which rewrites the default alignment based on samples length.
This should be done in the disorer_dataset.py and passed as an argument to DataLoader() in the cross-validation loop.
More about collate_fn can be found here
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.