Giter Club home page Giter Club logo

mget's Introduction

多线程并行下载大文件,突破GFW限速!

由于GFW对国外网站限速,导致下载国外的文件非常缓慢,但GFW仅能对连接限速,而不能对IP限速,因此,只要采用多线程下载一个文件的不同部分,就可以实现高速下载文件。你的带宽有多高,就能下多快。

使用方法:

[usage] sh ./mget.sh url thread_num save_out_file

[example] sh ./mget.sh http://xxxxxx.mp4 20 target.mp4

as GFW or some server have speed limit for connection,but not for host. so we can archive a multi thread downloader to get different part of a big file,then we merge it.

mainly use the Content-Range feature of HTTP

example:

first,the GFW will let you download at a high speed.

then, it will be slow

at last, turns to about 20-40 kBps until the end.

while you use the mget. if you want better speed,you just add the thread number. if your ISP support 20MB/s then you should use 500-1000 threads to download the file.

if this project helps you, pls give me a star.

老铁,点个赞呗!

changelog.

2020-03-07
增加重新下载功能:由于许多连接会失败,许多连接下载到最后会速度为0,此时超过3秒没有下载到1M的话,就会全部重新下载.
自动检查所有下载的部分是否完整,如果不完整,就会重新下载.
速度很慢的时候,会重新启动下载,让整个过程保持高速。

mget's People

Contributors

9crk avatar

Stargazers

 avatar mlxiao93 avatar sanmmmm avatar  avatar luoqc avatar Ape2017 avatar zhangtian avatar  avatar  avatar x4Cx58x54 avatar  avatar  avatar  avatar  avatar  avatar Vayne avatar Poul avatar  avatar cedar avatar Zero Fanker avatar ig avatar  avatar Zhou Qi avatar  avatar  avatar  avatar 邹世靖 avatar  avatar  avatar Zhai Can avatar Mage avatar  avatar

Watchers

James Cloos avatar  avatar Zhou Qi avatar

mget's Issues

求教,以下链接如何下载呢?

你好,我使用的是mac,如何使用命令下载以下文件呢?
https://desktop-release.notion-static.com/Notion 20Setup 202.0.8.exe
最后的文件名是有空格的。
我直接从下载管理器复制过来的地址是这样:
https://desktop-release.notion-static.com/Notion%20Setup%202.0.8.exe

我尝试使用以下命令,但失败了:
$ ./mget.sh https://desktop-release.notion-static.com/Notion%20Setup%202.0.8.exe 100 Notion%20Setup%202.0.8.exe

非常感谢!

下载报错

mget.sh: line 19: /1000: syntax error: operand expected (error token is "/1000")
请问 下载的时候出现这个问题是怎么回事

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.