Comments (6)
We're working on all of these points.
from habitat-challenge.
Hi Devendra, that's not expected behavior of EvalAI and will be fixed. We will try our best to provide you error logs.
from habitat-challenge.
Hi @devendrachaplot , your submission to the minival phase is timing out as it isn't able to run through all the episodes in 30 mins.
(We will fix the error message at our end to be more meaningful.)
Please close this issue if this resolves your query.
from habitat-challenge.
It is easy to bring your run-time down? We can bump the time-out limit but it will reduce your iteration cycles when you get to test-std (which is 100x larger than minival).
from habitat-challenge.
It will be great if the time-out limit can be increased! The local evaluation takes around 16 mins on my machine. Is there a way to see the output of the model? Our submission prints FPS. I am trying to figure out the ratio of FPS from my machine to remote evaluation.
from habitat-challenge.
Thanks, the time limit issue was mostly because of inconsistent docker base image (https://github.com/facebookresearch/habitat-challenge/issues/33#issuecomment-629741382). Fixing the base docker image reduced the runtime by around 50%.
Also, just for your reference, the remote eval (with the fixed docker base image) is now taking around 2x time as compared to my local evaluation on with 1080 Ti GPU (14 mins vs 7 mins).
from habitat-challenge.
Related Issues (20)
- distance_to_goal calculation results in infinity, pitch control is not working effectively in continuous action space HOT 5
- Custom Env class HOT 1
- Can not run pretrained weights of ObjectNav HOT 3
- Allow sliding HOT 1
- Settings for 2023
- submission killed by server
- Error when try to local evaluate : "6. Evaluate your docker container locally" HOT 2
- Could not submit a docker at EvalAI page HOT 4
- challenge 2023 HOT 1
- Inapproriate Settings about Continuous Action Space in habitat-chllenge 2023
- Eval.ai submission is not evaluating HOT 2
- deadline of challenge 2023
- miscalculated the deadline
- wrong deadline setting on hosts of challenge 2023!!!
- wrong deadline setting on hosts of challenge 2023!!!
- wrong deadline setting on hosts of challenge 2023!!! HOT 10
- The final list of the challenge phase HOT 3
- ConnectionResetError: [Errno 104] Connection reset by peer HOT 1
- AssertionError: Object attributes not uniquely matched to shortened handle. HOT 1
- AttributeError: Can't get attribute 'VectorEnvFactoryConfig'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from habitat-challenge.