Comments (4)
Hi Devendra,
Can you try resubmitting again, I would suggest submitting on minival, the logs for minival will show you how long the submission is taking. There is an overhead in the evaluation setting as we are using gRPC to communicate between your agent docker and environment docker, this requires sending frames from environment docker to agent docker which slows down the process of evaluation, although I don't expect the overhead to be this significant.
Once you have verified that the logs on minival work well you can try and submit to test-standard and you should get a record of how many episodes your agent finished successfully.
from habitat-challenge.
Do rebuild the your docker before resubmitting, to be safe run a docker system prune -a
before rebuilding.
from habitat-challenge.
@devendrachaplot can you try submitting again after running the system prune and rebuilding.
from habitat-challenge.
@abhiskk I submitted again on minival and it finished. I do not see a record of how many episodes were completed. Am I still supposed to see that if the submission finished successfully?
I also submitted to test-std again which will take a while to complete. What is the time limit for test-std for ObjectNav? Just for reference, I submitted a forward only agent to the ObjectNav test-std which does not do any computation, and it took around 34 hrs to complete.
from habitat-challenge.
Related Issues (20)
- distance_to_goal calculation results in infinity, pitch control is not working effectively in continuous action space HOT 5
- Custom Env class HOT 1
- Can not run pretrained weights of ObjectNav HOT 3
- Allow sliding HOT 1
- Settings for 2023
- submission killed by server
- Error when try to local evaluate : "6. Evaluate your docker container locally" HOT 2
- Could not submit a docker at EvalAI page HOT 4
- challenge 2023 HOT 1
- Inapproriate Settings about Continuous Action Space in habitat-chllenge 2023
- Eval.ai submission is not evaluating HOT 2
- deadline of challenge 2023
- miscalculated the deadline
- wrong deadline setting on hosts of challenge 2023!!!
- wrong deadline setting on hosts of challenge 2023!!!
- wrong deadline setting on hosts of challenge 2023!!! HOT 10
- The final list of the challenge phase HOT 3
- ConnectionResetError: [Errno 104] Connection reset by peer HOT 1
- AssertionError: Object attributes not uniquely matched to shortened handle. HOT 1
- AttributeError: Can't get attribute 'VectorEnvFactoryConfig'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from habitat-challenge.