Comments (2)
Hi mrT23
First of all, thank you very much for your fast and helpful answer.
The reason I was interested in the labels list is, that I want to apply some post-processing steps with NLP techniques to filter out the most distinct labels.
So if I understood you correctly, this means that, although some of the labels are non-sense, this has no implications as these indexes anyway refer to highly unlikely (because undertrained) labels. But in any case, it still holds that the network's output matches the index-to-class schema provided.
If that's the case this is perfectly fine for me. I totally agree that 5500 labels are more than sufficient and that the labels we get from running inference on your network are helpful.
I really appreciate your effort to provide a pretrained network on OI, given the problems with the dataset that you mentioned. To my knowledge, there are no other such networks available. So, from my side, we can close that issue and I'd reopen it if I found a discrepancy.
from asl.
Hi aurschmi.
The short answer - thanks for the review. i believe its fine.
The long answer:
Open Images is a complicated dataset. hard to download, hard to pre-process and hard to train.
for example , not all the download links are still alive. another example - many classes don't have in practice relevant pictures in the train set.
Out of the 9604 possible classes, i think the actual train (and test set) only contain about ~5500 valid classes, so the detector won't predict all classes. trust me, 5500 is plenty.
i recommend you to experiment with the detector on actual images. a good recipe for doing inference - for each image, choose the best ~20 labels that crossed a threshold of 0.95-0.99. you will see that it output good results. if you find a consistent discrepancy in the detector's output, let us know.
from asl.
Related Issues (20)
- How can I normalize these datasets NUS-WIDE and Open Image?
- Some questions about the 'clamp' operation
- Can this be used for multilabel dataset in classification HOT 1
- Unit tests are invalid
- 怎么样多卡训练,谢谢。
- question about data augmentation HOT 3
- What is the best practice to increase the number of tags of an existing model without retraining the whole model again?
- How to pass weights to ASL?
- the problem of shifted probability HOT 1
- 如何能够实现自适应的超参数?
- Some questions about openimages v6 datasets? HOT 1
- Do you have Tensorflow implementation? HOT 1
- Hello
- In my task,it alwasy return nan,May be it is not as wide use as BCE? HOT 3
- Maybe a Bug HOT 1
- How to multi-GPU training
- ResNet101+ASL in MS-COCO HOT 7
- target by object area
- bug: this class equals to nn.CrossEntropyLoss with labelsoothing
- Adaptive Asymmetry
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from asl.