Comments (10)
Hi, @albertyou2
Thanks, regarding to your questions:
How to create training dataset?What 's the format of the datas?
-> the dataset should contain train images and train labels. Mostly, I used matlab to read images and then combine them into a single tensor, whose dimension is Height x Width x Channel x Nsamples. Along with train data, the labels should have dimension 1 x Nsamples. Generally, we need to whiten the data. But it is not always better than doing nothing from my experiments. After that, you can save them to a hdf5 file with matlab.
Now i want train my custom images,I have no idea how to transform them to .h5 file
-> As illustrated above, you need to organize the images to a single tensor, and then combine their cluster labels to create a hdf5 file. Then create your own folder in the datasets folder with name of your dataset, and name the hdf5 file to 'data4torch.h5'. Then you are all set to run the code.
could you please give a step by step training instructions()?I think this will help other people too.
-> Yes, I will elaborate how to train on your own dataset. Thanks for reminding.
from jule.torch.
@jwyang Thanks for your reply !
I will have a try .
from jule.torch.
Since this is unsupervised clustering, why do we need the labels? why not just the images? For testing purposes?
How can I setup a dataset with just images and no labels? is that possible? cheers and thank you
from jule.torch.
Yes, the labels are used for evaluation only. To cluster images without labels, just set the label randomly and comment evalPerf() if you want.
from jule.torch.
Would you be able to share some code how to transform the data from images to NxCxWxH tensor and into hdf5 dataset?
from jule.torch.
Thanks for the suggestions, I will do that, and push the code to this repository soon.
from jule.torch.
Hi~@jwyang I have the same problem. How to transform the data from images to NxCxWxH tensor and into hdf5 dataset? I can't find the code as you said above.
from jule.torch.
Hi, @ShansYu, yes, you are right, I have not yet uploaded the code for transformation. My previous code is based on matlab, and missed after I reinstall my system. It should be very simple to load images from folder based on torch. Please refer to this demo code. You can create a tensor to hold all images data, and another tensor to hold labels you have the labels.
from jule.torch.
@jwyang Thanks for your reply ! I will have a try.
from jule.torch.
@ShansYu sounds good!
from jule.torch.
Related Issues (20)
- How to get the clustered data after training? HOT 3
- It is difficult to train in Large dataset. HOT 3
- How to use cpu to run the torch code. HOT 3
- class torch.LongTensor cannot be indexed, cvt2TabelLabels error HOT 3
- Can I run this code If my data have no label? HOT 6
- There is a problem when run my data HOT 7
- There is a probelm when I run my data HOT 1
- "bad argument #2 to '?'" error on CIFAR dataset HOT 4
- implementation of run_step_fast
- How to extract feature ? HOT 1
- How to build dataset HOT 5
- urgent question,please HOT 8
- Affinity for clusters
- best solution for CPU-only (knn) HOT 1
- Using labels in organize_samples
- doubt regarding the final loss HOT 2
- dataset
- install lua-knn failed!
- deep_recon function not found
- Test Datasets HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jule.torch.