Comments (3)
I think you're being overly pessimistic @tobyxdd
Reading their documentation and trying the code out on publicly available datasets the code seems to work much better than previous solutions.
they even specifically mention that they tried to solve overfitting problems and tested on multiple datasets for validation.
The training data is diverse enough to be a good generalization for general- human vision.
However cross-person training still not being possible is a real problem , I would still say full training isn't needed for this to work on another person , just fine-tuning that would take less than 5% of the initial training time , judging by how this is built up.
from mind-vis.
I'm afraid this is not as advanced as you might think.
First of all this only reads what a person's eyes are currently seeing, not what they are "picturing" in mind. Secondly, these models rely heavily on pre-trained images and I seriously doubt they can handle any content significantly different from the training set. And lastly, yes, you must re-train the model for each individual.
from mind-vis.
And lastly, yes, you must re-train the model for each individual.
Thanks. I asked this detail because I'm curious what still would be needed to be done after the surgery to have a neuralink or anything similar. It seems no matter what the surgery can give me, I still have to do a lot per individual job to get it to work for "me", which may limit the usage of such inplants.
from mind-vis.
Related Issues (20)
- Does the amount of training data in MBM_pretrain_stage matter a lot? HOT 4
- Weights and biases for SC-MBM HOT 1
- Training correlations when applied MBM model to another dataset HOT 2
- Bugs when running 'StageB_ldm_finetune.py' HOT 7
- Encountered problem while running Stage B HOT 1
- Understanding the code and architecture HOT 1
- Question about experimental result HOT 1
- Visualize the stimuli
- Pre-trained model HOT 1
- Where to get the Human Connectome Projects (HCP) is right? HOT 1
- How to get the HCP_visual_voxel.npz file?
- Save half training?
- How can I get the "HCP_visual_voxel.npz" for pre-training? HOT 3
- The link is inaccessible
- Use of Test Set for Fine-Tuning
- One question for the Sparse-Coded
- A Question about Low Correlations in the "stageA2_mbm_finetune" Execution on the GOD Dataset HOT 5
- A question about the parameter settings in the stageA2mbm_finetune.py
- Elaboration on Sampler code
- Questions about the design of the experimental task
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mind-vis.