Comments (5)
You're welcome! We're happy to hear of your (continued) interest.
Participants are free to use lower resolutions for their models/methods. We are simply specifying what resolution is available at test time.
from habitat-challenge.
Thank you for such a prompt response. My concern is if I, for example, train with the simulator running at 128x96 and then test at 640x480 and manually resize with OpenCV, the anti-aliasing/downsampling may not achieve the same result. Perhaps my concern is unfounded and the model will be robust to this change. Time will tell.
I think last year other config files were available at test time? or perhaps I am getting mixed up with another competition.
from habitat-challenge.
No, that's a reasonable question.
train with the simulator running at 128x96 and then test at 640x480 and manually resize with OpenCV, the anti-aliasing/downsampling may not achieve the same result.
Yes, that could lead to differences. I would expect them to be minor. I assume you don't want to train with 640x480 --> downsized to 128x96 because that would be slower to train?
I think last year other config files were available at test time?
I don't think so, but perhaps @mathfac or @abhiskk can confirm.
from habitat-challenge.
@edbeeching, previous year challenge was run with a fixed resolution 256x256, you can check it here.
Training with 640x480 instead of 128x96 shouldn't hit performance significantly, as a render call will be needed anyway.
I would advice next options:
- Train with 640x480 and downsample to 128x96 during training to have same frame transformation.
Or - Train with 128x96, and run evaluation on val split with 640x480 and downsampling and check that success metrics doesn't change much.
from habitat-challenge.
@mathfac
Thank you for confirmation, I must of been thinking of another competition.
I was expecting the rendering to be slower with the higher resolutions, as per the table on the habitat-sim github page, https://github.com/facebookresearch/habitat-sim#performance.
Thank you for the advice, I will compare the two options and see what works best.
from habitat-challenge.
Related Issues (20)
- distance_to_goal calculation results in infinity, pitch control is not working effectively in continuous action space HOT 5
- Custom Env class HOT 1
- Can not run pretrained weights of ObjectNav HOT 3
- Allow sliding HOT 1
- Settings for 2023
- submission killed by server
- Error when try to local evaluate : "6. Evaluate your docker container locally" HOT 2
- Could not submit a docker at EvalAI page HOT 4
- challenge 2023 HOT 1
- Inapproriate Settings about Continuous Action Space in habitat-chllenge 2023
- Eval.ai submission is not evaluating HOT 2
- deadline of challenge 2023
- miscalculated the deadline
- wrong deadline setting on hosts of challenge 2023!!!
- wrong deadline setting on hosts of challenge 2023!!!
- wrong deadline setting on hosts of challenge 2023!!! HOT 10
- The final list of the challenge phase HOT 3
- ConnectionResetError: [Errno 104] Connection reset by peer HOT 1
- AssertionError: Object attributes not uniquely matched to shortened handle. HOT 1
- AttributeError: Can't get attribute 'VectorEnvFactoryConfig'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from habitat-challenge.