qnzhou / thingiversecrawler Goto Github PK
View Code? Open in Web Editor NEWA simple script to batch download things from thingiverse.com
License: MIT License
A simple script to batch download things from thingiverse.com
License: MIT License
As per title, the summary CSV is created with the column headers in:
thing_id, file_id, file, license, link
But no other output is generated.
The terminal displays the thing IDs, there are no errors displayed.
Dear,
Absolutely love the ThingiverseCrawler you made! But I was wondering if there is a way to automatically download models that are tagged as a specific object or category. For instances automatically downloading all models from cats or chairs.
Sincerely,
Judith
Thingiverse has been updating their site heavily lately, which may be the reason why, but I can't get the download_model.py script to actually download anything. I have tried Python 2 & 3, and I managed to get to the following error using Python 3.
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "multiprocessing\pool.py", line 119, in worker
File "multiprocessing\pool.py", line 44, in mapstar
File "C:\Users\Bradley\Documents\Extracts\python-3.5.1-embed-win32\ThingiverseCrawler\download_model.py", line 18, in download_single_file
r = call(command.split());
File "subprocess.py", line 560, in call
File "subprocess.py", line 950, in init
File "subprocess.py", line 1220, in _execute_child
FileNotFoundError: [WinError 2] The system cannot find the file specified
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "./ThingiverseCrawler/download_model.py", line 64, in
main();
File "./ThingiverseCrawler/download_model.py", line 60, in main
pool.map(download_single_file, entries[start:end]);
File "multiprocessing\pool.py", line 260, in map
File "multiprocessing\pool.py", line 608, in get
FileNotFoundError: [WinError 2] The system cannot find the file specified
The thingiverse_crawler.py is still working, and the grab_context.py seemed to work on about half of the files in summary.csv. I'm very new to python and am just learning to use it for webscrapping. I'm just not sure how to get past this error and start downloading some .stl files.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.