Comments (6)
Thanks to the help from @andfoy, I am now able to get the same mIoU numbers as mentioned in Readme using the pre-trained weights. The issue was that I was using the latest version of SRU. On suggestion from @andfoy, I switched to the version of SRU as of this commit. Once I switched to this version, running the below mentioned command gave me the following results.
Command Used for evaluating the model
python -u -m dmn_pytorch.train --data referit_data --dataset unc --val testA --backend dpn92 --num-filters 10 --lang-layers 3 --mix-we --snapshot ./snapshots/dmn_unc_weights.pth --epochs 0 --eval-first --high-res
Result of Evaluation(using above command)
UNC testA
Maximum IoU: 0.5212885141373 - Threshold: 0.2250000000000
UNC testB
Maximum IoU: 0.4338888525963 - Threshold: 0.1750000000000
UNC+ testA
Maximum IoU: 0.4425530731678 - Threshold: 0.3750000000000
UNC+ testB
Maximum IoU: 0.3249503076077 - Threshold: 0.2750000000000
Referit test
Maximum IoU: 0.5280885696411 - Threshold: 0.4250000000000
Gref val
Maximum IoU: 0.3764866888523 - Threshold: 0.2000000000000
As one can see that the above numbers are similar to that provided in the readme file. So using the version of SRU provided in the ReadMe file instead of using the latest version fixed the issue that I was facing and enables me to reproduce the results mentioned in ReadMe.
from dms.
@andfoy Great thanks for your timely reply. I followed the instruction to update the SRU to 2.1.3 which already support Prnvrtc 9.2. But my problem is still there.
python -u -m dmn_pytorch.train_gai --data referit_data --dataset referit --val val --backend dpn92 --num-filters 10 --lang-layers 3 --mix-we --save-folder weights --snapshot dmn_referit_weights.pth --epochs 0 --eval-first
Evaluation done. Elapsed time: 1035.489 (s)
Maximum IoU: 0.1528985351324 - Threshold: 0.0000000000000
I couldn't add --high-res because of out of memory problem, I had nvidia 2080 with 8G memory. I don't know the reason why it's so easy to leak.
Thanks for your consideration.
from dms.
P.S: Dependency:
Python 3.6,8
Pytorch 1.0.1
CUDA 10
sru 2.1.3
prnvrtc 9.2
Window 10
from dms.
I followed the instruction to update the SRU to 2.1.3 which already support Prnvrtc 9.2
Actually, you need to install the SRU version from this commit:
pip install -U git+https://github.com/taolei87/sru.git@43c85ed --no-deps
I couldn't add --high-res because of out of memory problem, I had nvidia 2080 with 8G memory.
Try reducing the image size of your inputs, using --size
(it defaults to 512 pixels on the largest side). Using the high-res pretrained weights on a low-res fashion won't work, as those weights use the Upsampling module, whereas low-res mode does not.
from dms.
Followed your instruction and reinstall sru-0.0.1, remove encode() with 348 line.
python -u -m dmn_pytorch.train_gai --data referit_data --dataset referit --val val --backend dpn92 --num-filters 10 --lang-layers 3 --mix-we --save-folder weights --snapshot dmn_referit_weights.pth --epochs 0 --eval-first --high-res
Still mIoU around 0.15. @andfoy
from dms.
I resize from 512 to 384, it works well.
from dms.
Related Issues (19)
- [Errno 2] No such file or directory: 'data/unc/corpus.pth' HOT 4
- ECCV objectives
- DataPrepare HOT 9
- I cannot not obtain your data. HOT 1
- Question of REFER HOT 6
- AttributeError: 'Program' object has no attribute '_program' HOT 2
- How much GPU does this work usually require? HOT 17
- The result problem HOT 4
- What impact it will have to adjust the size HOT 2
- Weights Fine Tuning HOT 40
- Dissect ViLSTM
- Why net.train() in evaluate function? HOT 2
- How to visualize the output? HOT 2
- Testing on Custom Dataset HOT 24
- No such file or directory: 'data\\unc\\corpus.pth'? what is this corpus.pth? Need download? HOT 2
- Cannot produce results using the pretrained model HOT 3
- help me, can't download the referit_splits.tar.bz2 HOT 2
- Pretrained weights link seems to be down HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dms.