monocongo / download_bulk Goto Github PK

Create a script that will allow for the download of a collection of files with URLs of the form , for example on the page http://ubu.com/sound/burroughs_junky.html there is a list of files:

http://ubusound.memoryoftheworld.org/burroughs_william/junky/William-S-Burroughs_Junky_01-Junky-I.mp3
http://ubusound.memoryoftheworld.org/burroughs_william/junky/William-S-Burroughs_Junky_02-Junky-II.mp3
http://ubusound.memoryoftheworld.org/burroughs_william/junky/William-S-Burroughs_Junky_03-Junky-III.mp3

so a script that will allow for downloading these needs to loop over a list of URLs to download which include the integer digit and Roman numeral. We'll allow for this by allowing the user to specify the start and end of the digit range and to substitute a string such as "" for the Roman numeral section. For example the command line options might be something like this:

$ python script.py --prefix http://ubusound.memoryoftheworld.org/burroughs_william/junky/William-S-Burroughs_Junky_ --postfix \-Junky-<roman>.mp3 --first 1 --last 36 --dest /home/james/audio/burroughs_junky

We will need to use a backslash on any prefix or postfix arguments that begin with a dash (for correct parsing by argparse and subsequent code to remove the attendant double backslashes.