Project: pyMetalink URL: https://github.com/metalink-dev/pymetalink E-mail: [email protected]
Copyright: (C) 2007-2016, Neil McNab, Hampus Wessman License: MIT
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Description: pyMetalink is a library for python to support advanced download features
Example:
import metalink.download
files = metalink.download.get("file.metalink", os.getcwd())
CHANGELOG:
- Tested
- Initial Python 3.x support
- License change to MIT approved by all authors, can still be combined with GPL software
- Catches GPG NEWSIG response
- Packaged as pure Python package for easy_install and pip
- Support for RFC 3230 - Instance Digests in HTTP
- Support for RFC 6249 - Metalink/HTTP: Mirrors and Hashes
- Bugfixes for segmented downloads
- Native Jigdo download support
- Added download time
- Now requires Python 2.5 or newer because Metalink RFC requires SHA-256
- Added support for Metalink v4 (IETF RFC)
- Bugfix for when HTTP 302 redirect code is issued during download
- Added custom HTTP header support
- Added option to parse an HTML file for .metalink files to check
- Added a beta feature for media streaming
- Various bugfixes
- PGP bugfix
- Jigdo to Metalink convertor
- Other bugfixes
- XML parsing speed and memory improvements
- Checking function is now multithreaded for speed improvements
- Displays download bitrates
- Grabs proxy info from environment variables and Windows registry
- Fix for faulty file locking, this causes corrupted downloads
- Uses gzip compression when available on server (non-segmented downloads only)
- Fixed memory leak when computing a checksum
- Bugfixes for download resuming
- Will now download any file type and auto-detect metalink files
- Added support for metalink "Accept" HTTP header
- Fixed default key import directory
- Fixes for use with UNIX/Linux
- bugfixes in checker code
- Modified to remove the pyme dependency
- Removed missing imports
- Added first attempt at PGP signature checking
- Minor bugfixes
- Support for resuming segmented downloads
- Modified for better Python 2.4 support
- Code cleanup
- FTP close connection speed improvement
- Added documentation for how to use as a library
- Sort by country pref first (if set), then pref value in metalink
- segmented download FTP size support
- support for user specified OS and language preferences
- finished FTP proxy support
- Bugfix for when type attr not present
- Support for FTP segmented downloads
- If type="dynamic", client checks origin location
- Now handles all SHA hash types and MD5
- Minor bug fixes
- Speed and bandwidth improvements for checking mode
- Added checking of chunk checksums
- If chunk checksums are present, downloads are resumed
- Proxy support (experimental, HTTP should work, FTP and HTTPS not likely)
- Bugfix when doing size check on HTTP servers, more reliable now
- Support for segmented downloads! (HTTP urls only, falls back to old method if only FTP urls)
- Added support for checking the file size on FTP servers
- Made error when XML parse fails a little clearer.
- Fixed bug when no "size" attribute is present
- Added totals output
- Bugfixes for FTP handling, bad URL handling
- rsync doesn't list as a URL Error
- reduced timeout value
This is the initial release.
TODO
- resume download support for non-segmented downloads
- download priority based on speed
- use maxconnections
- dump FTP data chunks directly to file instead of holding in memory