bdoms / tumblr_backup Goto Github PK

View Code? Open in Web Editor NEW

88.0 7.0 23.0 28 KB

A Python script for saving your Tumblr blog to your hard drive as HTML or CSV.

Python 100.00%

python csv html tumblr tumblr-api

tumblr_backup's Introduction

Tumblr Backup

Tumblr Backup is a tool for making a local backup of your Tumblr account.

Setup

There is one dependency: version 4 of Beautiful Soup. If you already have it installed globally then you can grab the single .py file and it should work.

Otherwise, install via pip:

pip install -r requirements.txt

Parsers

This script is capable of using the default parser included with Python, html.parser. However, it will use the faster lxml libary if it can be imported. See the BeautifulSoup docs for details and the pros and cons of each.

Use

To backup your account, just include the URL of your Tumblr website:

python tumblr_backup.py example.tumblr.com

If you use a custom domain, then that will also work:

python tumblr_backup.py www.example.com

By default, a new folder with post data saved in individual HTML files will be created, and resources like images will be saved in appropriately named subfolders. The alternative is to save the post data in a single CSV file, behavior which you can specify via the command line option csv like so:

python tumblr_backup.py --csv=true example.tumblr.com

You can also specify a different directory to save to with the command line option save_folder:

python tumblr_backup.py --save_folder=/path/to/folder example.tumblr.com

Specify the post number to start from (useful with bad internet connection to continue from the last posts group):

python tumblr_backup.py --start_post=N example.tumblr.com

Supported Post Types

Tumblr has a lot of different types of posts. The ones currently supported by Tumblr Backup are:

Regular
Photo
Quote
Link

Notes

Private accounts requiring authentication are not currently supported.

The default encoding is UTF-8. If you wish to change this, you can simply modify or override the global ENCODING variable.

tumblr_backup's People

Contributors

Stargazers

Watchers

tumblr_backup's Issues

urllib2.HTTPError: HTTP Error 403: Forbidden

This issue causes the script to terminate. Apologies for not being able to understand the output enough to recommend a solution. It looks like a picture from the blog is causing trouble (Error 403); perhaps Tumblr is throttling the script?

Downloading a photo. This may take a moment.
Traceback (most recent call last):
    File "/Users/fr/Public/tumblr_backup-master/tumblr_backup.py", line 283, in <module>
            backup(account, use_csv, save_folder)
    File "/Users/fr/Public/tumblr_backup-master/tumblr_backup.py", line 257, in backup
            savePost(post, save_folder, header=header)
    File "/Users/fr/Public/tumblr_backup-master/tumblr_backup.py", line 101, in savePost
            image_response = urllib2.urlopen(image_url)
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 126, in urlopen
            return _opener.open(url, data, timeout)
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 400, in open
            response = meth(req, response)
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 513, in http_response
            'http', request, response, code, msg, hdrs)
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 438, in error
            return self._call_chain(*args)
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 372, in _call_chain
            result = func(*args)
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 521, in http_error_default
            raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 403: Forbidden

Hope this helps!

No source link for pictures?

It seems that the script does not include the source when saving posts that are made of a single picture. Any way this could be fixed? It's a tragic loss of information! Otherwise, great stuff 👍

fails for me

not sure if I am missing any dependencies or something.
happens the same whether I am using CSV mode or not.
here is the output :-

python tumblr_backup.py --csv=true cybergypsy
CSV mode activated.
Data will be saved to cybergypsy/cybergypsy.csv
Getting basic information.
Getting posts 0 to 7.
Traceback (most recent call last):
File "tumblr_backup.py", line 195, in
backup(account, use_csv)
File "tumblr_backup.py", line 173, in backup
savePost(post, save_folder, use_csv=use_csv, save_file=save_file)
File "tumblr_backup.py", line 54, in savePost
title = unescape(post.find("regular-title").string)
AttributeError: 'NoneType' object has no attribute 'string'

The latest post is saved , that's all.
hope that helps.
thanks.

Trouble getting script to run

When using the basic example command (python tumblr_backup.py ablog.tumblr.com) I'm greeted with this error:

File "tumblr_backup.py", line 13, in <module>
    from BeautifulSoup import BeautifulStoneSoup
ImportError: No module named BeautifulSoup

Not a python guy, but the import seems to not be valid. I saw that the beautifulsoup directory was empty, so i tried putting it in there myself, but still the same error.

Maybe installation instructions in the readme is enough?

Unicode error when backing up

Hi, I'm trying to backup my blog and running into the following error. Looks like a normal Unicode formatting error. I'll try forking it and changing it to run .encode() to convert to utf-8 prior to the f.write or writer.writerow call...


zac@hosaka ../tumblrBackup $ python tumblr_backup.py zaschell
Getting basic information.
Getting posts 0 to 49.
Traceback (most recent call last):
  File "tumblr_backup.py", line 275, in <module>
    backup(account, use_csv)
  File "tumblr_backup.py", line 255, in backup
    savePost(post, save_folder, header=header)
  File "tumblr_backup.py", line 129, in savePost
    f.write("<blockquote>" + quote + "</blockquote>")
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2018' in position 42: ordinal not in range(128)
zac@hosaka ../tumblrBackup $ python tumblr_backup.py --csv=true zaschell
CSV mode activated.
Data will be saved to zaschell/zaschell.csv
Getting basic information.
Getting posts 0 to 49.
Traceback (most recent call last):
  File "tumblr_backup.py", line 275, in <module>
    backup(account, use_csv)
  File "tumblr_backup.py", line 253, in backup
    savePost(post, save_folder, use_csv=use_csv, save_file=save_file)
  File "tumblr_backup.py", line 190, in savePost
    writer.writerow(row)
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2018' in position 30: ordinal not in range(128)

Python 3 causes errors, would be useful info in readme

Not sure how big a deal this is when people can always run it with an older version, but I think it's worth mentioning in the readme that this requires Python 2.

Thanks for the nice script!, saved me a lot of hassle <3