Comments (9)
@kirk86 I found time to investigate this feature request, and that's my conclusion. FYI.
from kaggle-cli.
How many MB/s should we see when uploading? There's no progress bar or ETA, so you can't tell if uploading submission crashed.
Also, some tips on making uploading submissions faster:
- zip the submission file! (I suggest a feature enhance to nag/warn you if you upload an unzipped submission file. Perhaps a
kaggle competitions submit -z ...
enhance?) - use rounding. Don't write more digits than necessary. (Also makes your life easier when diff'ing or comparing submissions)
from kaggle-cli.
I would like to work on this. @kirk86 How did you compare the download/upload ? and which file were you downloading during the test ?
from kaggle-cli.
@invokerk hi, to be honest with you at the moment I don't recall exactly which file I've used but I did sth along the following lines. Just pick a kaggle competition and download the data directly from their website, then do the same using kaggle-cli. Also, do the same for the submission file, i.e. the upload. This will give you pretty much an idea of how long does it take on average for an upload/download.
from kaggle-cli.
It could delay at login, fetch download/submit page, download/submit action. The delay times depend on Kaggle's server. It could be mitigated by cache the login and page fetching, reducing requests.
from kaggle-cli.
@floydwch thanks a lot. I just have another question. How can you set up kaggle-cli if you're behind a proxy? Thanks.
from kaggle-cli.
Kaggle-cli employs MechanicalSoup
as the browser, and MechanicalSoup
employs Requests
to handle the HTTP.
According to http://docs.python-requests.org/en/master/user/advanced/#proxies , it seems to have the chance to support proxy as a argument. However, Requests
supports setting proxy by environment variable, in the meanwhile, you can just try this way.
from kaggle-cli.
in the meanwhile, you can just try this way.
yeah I've noticed that. In the meantime it would be really nice to have it as an option, don't you think?
from kaggle-cli.
Since we have already implemented browser caching (see 1176fd7), I'm going to close this issue, if there is still some weird deley, please feel free to reopen issue.
from kaggle-cli.
Related Issues (20)
- Use kaggle-cli to download your old submission from a competition HOT 1
- 'Response' object has no attribute 'soup' HOT 3
- Directly saving password may be unsafe.
- submit fails if you're not on a team HOT 1
- no feedback if you haven't accepted competition rules
- dataset not found
- ConfigParser instance has no attribute 'read_file' HOT 1
- No such file or directory
- Dataset download
- submit should nag if submission file is not a zip/gz/rar/7z (because upload BW is so low)
- Kaggle-cli installation dependency botocore fails HOT 1
- kaggle-cli 0.12.13 has requirement lxml<4.1,>=4.0.0, but you'll have lxml 4.2.1 which is incompatible. HOT 1
- Some incompatible packages?
- Is this tool still being maintained? HOT 2
- Error when running pip install kaggle-cli HOT 2
- Unable to Submit HOT 2
- What python versions does this work with? HOT 1
- make sure the development packages of libxml2 and libxslt are installed
- 400 - Bad Request during a submission HOT 1
- error when using $ kg download -u <username> -p <password> -c <competition> HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kaggle-cli.