Giter Club home page Giter Club logo

yuque-crawl's Introduction

yuque-crawl

语雀文档抓取工具(爬虫) 可以保存任意用户整个语雀知识库为Markdown格式 (包含完整目录结构和索引)

使用: 安装 python3

https://www.python.org/downloads/

执行安装运行模块 pip install requests

执行抓取:

python3 main.py 语雀文档地址

demo: python3 main.py https://www.yuque.com/burpheart/phpaudit

yuque-crawl's People

Contributors

burpheart avatar haierkeys avatar

Stargazers

Suave avatar XiDP avatar  avatar  avatar  avatar wade avatar xincan avatar  avatar  avatar  avatar Anion avatar  avatar  avatar zt avatar 夜梓月 avatar pilipala avatar  avatar Andy Shiyi Liu avatar  avatar 紫云 avatar Pan_Yujie avatar 明修 avatar 阿沈是也 avatar 珈蓝 avatar humyna avatar WenPeng.OuYang avatar zjjss avatar  avatar  avatar  avatar ddwGeGe avatar 辉鸭蛋 avatar  avatar  avatar  avatar Voyager avatar 任顾远 avatar  avatar  avatar Lancer avatar huasheng avatar Junhao Chen avatar  avatar  avatar  avatar  avatar  avatar 三多 avatar Howe avatar Jeans avatar Zanyatta avatar Musou avatar  avatar zhuhongchao avatar 吴帅帅 avatar wanghaocun avatar  avatar misaya avatar  avatar me4ta avatar  avatar folkson avatar  avatar 华子 avatar yuanfang avatar Cdeerxy avatar  avatar Einstar avatar  avatar Fred avatar Kenyatta Anderson avatar AVA avatar  avatar SLIGHTLEE avatar shiyu avatar  avatar XXQQ avatar  avatar Lalis avatar marksec avatar crazy402 avatar m00sec avatar FlawlessLEE avatar qixiaobo avatar Xuewen Yan avatar PayNeXC avatar caigou1 avatar Qifeng avatar  avatar Center avatar zepang avatar 絢辻詞 avatar  avatar  avatar alchu4n avatar  avatar 51pwn avatar stillfish avatar  avatar L0ne1y avatar

Watchers

 avatar  avatar  avatar hirak0 avatar

yuque-crawl's Issues

图片外链问题

很好的项目,生成md非常方便,但是如果md中的图片链接如果可以支持转换成图床的就更好了,我写了一个可以把语雀手动导出md的图片链接批量转换成图床链接的转换器,作者可以借鉴借鉴,欢迎fork学习参考一下,期待添加图床的功能。https://github.com/Undertone0809/md-img-converter

部分文档执行失败

如图

"
Traceback (most recent call last):
File "E:\app\语雀爬虫\yuque-crawl\main.py", line 90, in
get_book()
File "E:\app\语雀爬虫\yuque-crawl\main.py", line 38, in get_book
if (os.path.exists("download/" + str(docsjson['book']['id'])) == False):
~~~~~~~~^^^^^^^^
KeyError: 'book'
"

20231221211546

再下载部分文档的时候提示以下报错

部分收藏库提示以下报错信息:
E:\yuque-crawl>python3 main.py https://www.yuque.com/aceld/lfhu8y Traceback (most recent call last): File "main.py", line 87, in <module> get_book(sys.argv[1]) File "main.py", line 65, in get_book if (temp[doc['parent_uuid']].endswith("/")): KeyError: 'uPPZE7JwsEFElXBW'

感谢,超级好用

主要是表达一下感谢,我找了好多个,就这个用起来又快又方便,谢谢

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.