xeron / danbooru-ruby-grabber Goto Github PK

This is follow up for #13.

Better way to fix this will be usage of addressable gem.

https://github.com/sporkmonger/addressable

Use JSON API + rewrite code with low-level class for API.

Привет!
Сейчас теги сохраняются отдельно в файл, но в состав KDE входит такая штука как nepomuk, которая поддерживает теги для файлов.
Было бы замечательно, если граббер мог качать картинки и сразу проставлять теги к ним, в идеале на выбор - например мне не нужны все теги, а только копирайты/персонажи/авторы.
Похожий функционал был реализован в Danbooru Client (http://kde-apps.org/content/show.php?content=114343) на питоне, но автор, похоже, забросил своё творение...

Downloading a large set of images (3000+) and hit a connection timeout. When I run the same command again to download, it starts redownloading all files (overwriting files already downloaded). The previously downloaded files appear in files.bbs.

Am I missing an argument to tell it to skip previously downloaded files?

Using defaults:

./danbooru.rb -b yandere -u userid -p password tag

Find way to avoid new Danbooru API "no posts count" problem danbooru/danbooru#590

Была бы очень полезной возможность скачивать изображения из пулов, указывая айди пула или, если это возможно реализовать, его название.
На всякий случай, чтобы пояснить о чем я, оставлю ссылку на список пулов на данбуру: http://danbooru.donmai.us/pool/index

Due to new API danbooru's pool getting is broken. New format (same for XML):

The base URL is GET /pools/$id.json where $id is the pool id.

As the above title says, this is mostly regarding banned artists, but also affects some other tags where I believe the API for danbooru doesn't give any image URL result. Would it be possible to fix this by grabbing the md5 from the API for a blocked post? Because if so the file URL is just that plus the file extension.

As an example here is a post from a banned artist: https://danbooru.donmai.us/posts/2438399 and the file url is just /data/5fd14d16134e9698fb1d7eeeadc2b81f.jpg. Alternatively I have no idea how you feel about this, but if you just look at the page HTML for a blocked post the "data-file-url" element contains the file URL as well which maybe you can use.

It will simplify installation process and usage. Worth to think about compatibility with people who use cloned repo.

New option to set a base dir. That will allow people to download images into any location.

As said in the title, it seems like your script will download an image again if the tags for it changes, rather than just updating it. I observed this with yande.re only, so I've no idea if it affects other booru sites. I am using the storage dir option if that matters. It also makes a dupe symlink and entry in the files.bbs file.

Just an example image I found that had undergone a tag change and then got downloaded again: http://privatepaste.com/8c3ec5d562

Currently it results in (at least on Windows):

C:\Users\Henry\Downloads\danbooru-ruby-grabber-master\danbooru-ruby-grabber-master>danbooru.rb -b konachan user:opai
Tags are user:opai.
C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:253:in `mkdir': Not a directory @ dir_s_mkdir - user:opai (Errno::ENOTDIR)
        from C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:253:in `fu_mkdir'
        from C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:227:in `block (2 levels) in mkdir_p'
        from C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:225:in `reverse_each'
        from C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:225:in `block in mkdir_p'
        from C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:211:in `each'
        from C:/Ruby23-x64/lib/ruby/2.3.0/fileutils.rb:211:in `mkdir_p'
        from C:/Users/Henry/Downloads/danbooru-ruby-grabber-master/danbooru-ruby-grabber-master/lib/booru/posts.rb:42:in `download_by_tags'
        from C:/Users/Henry/Downloads/danbooru-ruby-grabber-master/danbooru-ruby-grabber-master/danbooru.rb:106:in `<main>'

Examples:

ruby danbooru.rb -b konachan -d ~/Pictures 'allison_&_lillia'
ruby danbooru.rb -b konachan -d ~/Pictures 'robotics;notes'

These create a folder with the tag, the file files.bbs inside, and exits.