Giter Club home page Giter Club logo

imagenet-downloader's Issues

All images not downloaded

Hi ,
I used download_images.py script for downloading the class forklift from Imagenet . The dataset consists of 1465 images and it shows 100% at the end. When I check the doenloaded dataset , it does not contain all images and also some images are not getting opened. What could be the possible reason ?

python download_images.py -c forklift -o ./forklift/

my output is

[LOG]: Classname: forklift
[LOG]: WordNet ID: n03384352
[LOG]: Downloading 1465 images out of a total of 1465
[LOG]: output folder: ./forklift/

0%| | 4/1465 [00:04<25:07, 1.03s/it]('Could not retrieve url: ', 'http://www.mcmahon-services.com.au/images/plant/plant-forklift2.jpg', ' | skipping')
0%|▏ | 6/1465 [00:07<27:58, 1.15s/it]('Could not retrieve url: ', 'http://www1.istockphoto.com/file_thumbview_approve/3351229/2/istockphoto_3351229_large_forklift_and_container_in_wide_angle.jpg', ' | skipping')
1%|▌ | 18/1465 [00:15<16:21, 1.47it/s]('Could not retrieve url: ', 'http://www.nissanfanseite.de/Nissan-USA/Nissan_Forklift/US-Forklift-TX-Truck-Series-2006.jpg', ' | skipping')
1%|▌ | 21/1465 [00:20<22:48, 1.06it/s]('Could not retrieve url: ', 'http://www.goldenagetruckmuseum.com/images/list_of_trucks/fork_lift.jpg', ' | skipping')
2%|▊ | 31/1465 [00:31<16:39, 1.43it/s]('Could not retrieve url: ', 'http://www.newandusedforklifts.com/images/newforklift.jpg', ' | skipping')
2%|█ | 36/1465 [00:46<42:35, 1.79s/it]('Could not retrieve url: ', 'http://www.supplierlist.com/photo_images/33167/Forklift.jpg', ' | skipping')
3%|█▏ | 43/1465 [02:24<1:39:39, 4.21s/it]('Could not retrieve url: ', 'http://www.made-in-china.com/image/2f0j00BvsEjbZDLaqSM/Battery-Forklift-Truck-Model-FB25-MQZ2-.jpg', ' | skipping')
5%|█▉ | 71/1465 [02:56<19:44, 1.18it/s]('Could not retrieve url: ', 'http://www.mfisales.net/MFIPics/BudaForkliftLG.jpg', ' | skipping')
5%|██ | 75/1465 [03:00<22:18, 1.04it/s]('Could not retrieve url: ', 'http://www.bcsystems.net.au/images/Electric_Forklift_Truck.jpg', ' | skipping')
6%|██▎ | 84/1465 [03:09<24:07, 1.05s/it]('Could not retrieve url: ', 'http://wb4.indo-work.com/sgimage/15/34215_forklift.jpg', ' | skipping')
6%|██▍ | 85/1465 [03:10<24:37, 1.07s/it]('Could not retrieve url: ', 'http://wb4.indo-work.com/pdimage/27/639427_forklift-diesel.jpg', ' | skipping')
('Could not retrieve url: ', 'http://www.barloworld.com/content/main/ar2007/images/revop_handling_FORKLIFT.jpg', ' | skipping')
6%|██▌ | 91/1465 [03:15<19:18, 1.19it/s]('Could not retrieve url: ', 'http://www.masonsource.net/images/lull_product_944e_app_mid.jpg', ' | skipping')
7%|██▋ | 96/1465 [03:17<14:08, 1.61it/s]('Could not retrieve url: ', 'http://www.jandntransport.com.au/media/8-forklift%20training%2001.jpg', ' | skipping')
7%|██▊ | 99/1465 [03:19<18:47, 1.21it/s]('Could not retrieve url: ', 'http://www.fcd.net.au/images/ForkLift_2.JPG', ' | skipping')
8%|███ | 111/1465 [03:28<18:52, 1.20it/s]('Could not retrieve url: ', 'http://www.serviant.com/sitebuildercontent/sitebuilderpictures/forklift.jpg', ' | skipping')
9%|███▍ | 128/1465 [03:43<21:01, 1.06it/s]('Could not retrieve url: ', 'http://www.brennydahlblock.com/images/Historical/forklift2.gif', ' | skipping')
9%|███▌ | 131/1465 [03:54<45:57, 2.07s/it]('Could not retrieve url: ', 'http://www.buseytruckequipment.com/forklift.gif', ' | skipping')
9%|███▌ | 132/1465 [03:54<32:50, 1.48s/it]('Could not retrieve url: ', 'http://officespam.chattablogs.com/archives/forklift-bomb.GIF', ' | skipping')
13%|█████▏ | 192/1465 [04:51<16:06, 1.32it/s]('Could not retrieve url: ', 'http://www.eastsidesafety.com/images/picture1111.bmp', ' | skipping')
13%|█████▎ | 193/1465 [04:52<12:05, 1.75it/s]('Could not retrieve url: ', 'http://www.mhinfo.com/mhi_new/images/forklift.jpg', ' | skipping')
14%|█████▏ | 199/1465 [07:10<2:58:04, 8.44s/it]('Could not retrieve url: ', 'http://www.teelertire.com/images/tee_02.jpg', ' | skipping')
14%|█████▏ | 200/1465 [07:10<2:05:13, 5.94s/it]('Could not retrieve url: ', 'http://sirkelmotors.com.na/image_preview.php?filename=/domains/demo.namcars.com/html/uploads/car/408127378_1.jpg&width=420&height=480', ' | skipping')
14%|█████▋ | 210/1465 [07:25<27:24, 1.31s/it]('Could not retrieve url: ', 'http://www.paletofisi.com/forklift.gif', ' | skipping')
15%|██████ | 221/1465 [07:39<21:01, 1.01s/it]('Could not retrieve url: ', 'http://www.lenar.com.au/attachment-images/forklift.jpg', ' | skipping')
16%|██████▏ | 228/1465 [07:54<30:15, 1.47s/it]('Could not retrieve url: ', 'http://www.mikerothontraining.co.uk/sitebuildercontent/sitebuilderpictures/lorry-with-forklift.jpg', ' | skipping')
17%|██████▋ | 247/1465 [08:10<12:43, 1.60it/s]('Could not retrieve url: ', 'http://www.users.bigpond.com/forkpro/images/fork3.jpg', ' | skipping')
17%|██████▍ | 250/1465 [10:23<6:44:51, 19.99s/it]('Could not retrieve url: ', 'http://www.advancedocuments.com.au/images/forklift.jpg', ' | skipping')
18%|███████ | 260/1465 [10:33<25:03, 1.25s/it]^C('Could not retrieve url: ', 'http://leepartsequip.com/pro_images/ACF29C.JPG', ' | skipping')
18%|██████▍ | 270/1465 [1:22:15<17:53:02, 53.88s/it]('Could not retrieve url: ', 'http://img.en.china.cn/0/0,0,394,17058,507,402,0a9ad059.jpg', ' | skipping')
19%|███████▎ | 284/1465 [1:22:36<44:31, 2.26s/it]('Could not retrieve url: ', 'http://www.ambassador.uk.com/images/truck5.jpg', ' | skipping')
20%|███████▍ | 286/1465 [1:22:38<37:13, 1.89s/it]('Could not retrieve url: ', 'http://www.vitkovicecylinders.com/products/img/forklift_trucks2.jpg', ' | skipping')
23%|████████▊ | 340/1465 [1:24:01<17:48, 1.05it/s]('Could not retrieve url: ', 'http://rod-mcalpin.com/images/forklift56.JPG', ' | skipping')
24%|█████████ | 348/1465 [1:24:11<21:23, 1.15s/it]('Could not retrieve url: ', 'http://primecommodities.net/images/FORKLIFT%20TRUCKS%20-%20CPC20%20%20CPCD20.JPG', ' | skipping')
24%|█████████ | 350/1465 [1:24:11<12:41, 1.46it/s]('Could not retrieve url: ', 'http://img1.tradeget.com/forklifters/77R9IYPL1swaraj_forklift_trucks.jpg', ' | skipping')
24%|█████████▏ | 354/1465 [1:24:24<33:37, 1.82s/it]('Could not retrieve url: ', 'http://cartoday.org/wp-content/uploads/2007/08/agres-final.jpg', ' | skipping')
25%|█████████▎ | 360/1465 [1:24:30<21:13, 1.15s/it]('Could not retrieve url: ', 'http://dwp.bigplanet.com/steps2success/nss-folder/pictures/forklift.jpg', ' | skipping')
26%|█████████▋ | 374/1465 [1:27:00<30:31, 1.68s/it]('Could not retrieve url: ', 'http://www.caew-boces.wnyric.org/fileupload/news/news__forklift2web.jpg', ' | skipping')
27%|██████████▏ | 391/1465 [1:29:47<31:21, 1.75s/it]('Could not retrieve url: ', 'http://ieee-pes-td.com/wp-content/uploads/2008/04/floor-4-forklift-parade.jpg', ' | skipping')
30%|███████████▍ | 441/1465 [1:31:33<24:08, 1.41s/it]('Could not retrieve url: ', 'http://www.gierston.com/images/forklift.jpg', ' | skipping')
30%|███████████▌ | 445/1465 [1:31:44<51:28, 3.03s/it]('Could not retrieve url: ', 'http://vtsolar.arch.vt.edu/images/progress/other/forklift.jpg', ' | skipping')
31%|███████████▉ | 460/1465 [1:34:33<35:33, 2.12s/it]('Could not retrieve url: ', 'http://www.riverside-rl.co.uk/images/forklift.jpg', ' | skipping')
32%|████████████▎ | 475/1465 [1:34:52<17:04, 1.03s/it]('Could not retrieve url: ', 'http://www.ncscos.com/Photos/LongBeach/images/forklift%20on%20dockbananas_jpg.jpg', ' | skipping')
33%|████████████▌ | 484/1465 [1:35:11<33:31, 2.05s/it]('Could not retrieve url: ', 'http://home.gci.net/~pvcces/homepage/Clark%2080%20forklift%203.jpg', ' | skipping')
38%|██████████████▎ | 551/1465 [1:37:03<16:34, 1.09s/it]('Could not retrieve url: ', 'http://www.vitkovicecylinders.com/products/img/forklift_trucks1.jpg', ' | skipping')
39%|██████████████▋ | 567/1465 [1:37:33<18:21, 1.23s/it]('Could not retrieve url: ', 'http://www.shellgas.co.uk/images/FLT_boxes.jpg', ' | skipping')
39%|██████████████▉ | 577/1465 [1:37:47<34:23, 2.32s/it]('Could not retrieve url: ', 'http://www.dunhillatlanta.com/images/forklift.jpg', ' | skipping')
40%|███████████████ | 580/1465 [1:37:50<18:40, 1.27s/it]('Could not retrieve url: ', 'http://www.csc.calpoly.edu/~buckalew/forklift.jpg', ' | skipping')
40%|███████████████▎ | 591/1465 [1:38:03<13:56, 1.05it/s]('Could not retrieve url: ', 'http://gtadomain.gtagaming.com/images/sa/vehicles/forklift.jpg', ' | skipping')
41%|███████████████▌ | 599/1465 [1:38:09<13:13, 1.09it/s]('Could not retrieve url: ', 'http://www.peninsulahabitat.org/partnerships/graphics/gs_raymond_forklift.jpg', ' | skipping')
41%|███████████████▌ | 602/1465 [1:38:21<33:23, 2.32s/it]('Could not retrieve url: ', 'http://www.bridgestone-ek.co.jp/picture/P_naiyo/3Vehicles/ForkliftSetsubi.jpg', ' | skipping')
43%|████████████████▎ | 627/1465 [1:39:11<30:13, 2.16s/it]('Could not retrieve url: ', 'http://plasma.physics.ucla.edu/lapd/upgrade.dir/loading_forklift.JPG', ' | skipping')
44%|████████████████▋ | 641/1465 [1:39:33<14:32, 1.06s/it]('Could not retrieve url: ', 'http://www.brevardcounty.us/fire_rescue/assets/i/photo/forklift.jpg', ' | skipping')
44%|███████████████▊ | 643/1465 [1:41:46<6:32:44, 28.67s/it]('Could not retrieve url: ', 'http://personal.earlsoft.co.uk/lego/4563/forklift.png', ' | skipping')
44%|███████████████▉ | 649/1465 [1:41:55<1:04:45, 4.76s/it]('Could not retrieve url: ', 'http://www.cottenauctions.com/terra/images/forklift_small.jpg', ' | skipping')
46%|█████████████████▌ | 675/1465 [1:45:09<37:07, 2.82s/it]('Could not retrieve url: ', 'http://www.nissanfanseite.de/Nissan-USA/Nissan_Forklift/US-Forklift-BX-Cushion-Series-2006.jpg', ' | skipping')
47%|█████████████████▋ | 684/1465 [1:45:22<21:13, 1.63s/it]('Could not retrieve url: ', 'http://wb4.indo-work.com/pdimage/25/657425_forklift-battery.jpg', ' | skipping')
48%|██████████████████ | 696/1465 [1:45:46<14:37, 1.14s/it]('Could not retrieve url: ', 'http://plaslux.com/forklift.jpg', ' | skipping')
48%|██████████████████ | 698/1465 [1:45:47<10:34, 1.21it/s]('Could not retrieve url: ', 'http://www.ncdc.gov.uk/media/images/t/9/Forklift_640_1.jpg', ' | skipping')
48%|██████████████████▏ | 701/1465 [1:45:48<08:40, 1.47it/s]('Could not retrieve url: ', 'http://krisabel.ctv.ca/prototypes/masterlift1.jpg', ' | skipping')
50%|███████████████████▏ | 739/1465 [1:47:00<23:36, 1.95s/it]('Could not retrieve url: ', 'http://www.jutecoo.com/Forklift.jpg', ' | skipping')
51%|███████████████████▍ | 748/1465 [1:49:21<42:20, 3.54s/it]('Could not retrieve url: ', 'http://www.nissanfanseite.de/Nissan-USA/Nissan_Forklift/US-Forklift-Rider-Reach-Trucks-2006.jpg', ' | skipping')
('Could not retrieve url: ', 'http://www.eqdepotil.com/assets/images/autogen/a_new__rearmt_princeton_1.jpg', ' | skipping')
52%|███████████████████▋ | 760/1465 [1:49:34<13:37, 1.16s/it]('Could not retrieve url: ', 'http://www.huntergas.com.au/frontpic4.jpg', ' | skipping')
54%|████████████████████▎ | 784/1465 [1:50:21<30:32, 2.69s/it]('Could not retrieve url: ', 'http://arrow3i.com/ip.jpg', ' | skipping')
54%|████████████████████▌ | 793/1465 [1:50:38<14:44, 1.32s/it]('Could not retrieve url: ', 'http://www.actionpowersports.ca/images/Electric%20Forklift.jpg', ' | skipping')
56%|█████████████████████▎ | 824/1465 [1:51:44<17:51, 1.67s/it]('Could not retrieve url: ', 'http://www.equitrain.ca/pic_forklift.jpg', ' | skipping')
56%|█████████████████████▍ | 826/1465 [1:51:46<12:56, 1.21s/it]('Could not retrieve url: ', 'http://www.sonomahammer.com/inventory/clark%20forklift.jpg', ' | skipping')
58%|█████████████████████▉ | 847/1465 [1:52:09<07:55, 1.30it/s]('Could not retrieve url: ', 'http://www2.army.mod.uk/img/hqschinf/itc_catterick/hq_itc/qms_dept/forklift1.jpg', ' | skipping')
58%|██████████████████████ | 850/1465 [1:52:20<34:51, 3.40s/it]('Could not retrieve url: ', 'http://www.zapworld.com/files/clearance/forklift.jpg', ' | skipping')
61%|███████████████████████ | 890/1465 [1:53:29<16:46, 1.75s/it]('Could not retrieve url: ', 'http://www.roadmasters.org/images/fl_instructor.jpg', ' | skipping')
62%|██████████████████████▏ | 905/1465 [1:54:43<1:25:10, 9.13s/it]('Could not retrieve url: ', 'http://www.reithindustrial.com/industrial-truck/used-fork-lift.jpg', ' | skipping')
65%|████████████████████████▋ | 951/1465 [1:55:49<08:52, 1.04s/it]('Could not retrieve url: ', 'http://205.212.167.2/statewide/forklift-3.jpg', ' | skipping')
67%|█████████████████████████▎ | 975/1465 [1:58:48<30:40, 3.76s/it]('Could not retrieve url: ', 'http://www.industrysearch.co.uk/products/images/np18552_8.gif', ' | skipping')
68%|█████████████████████████▊ | 994/1465 [1:59:26<13:15, 1.69s/it]('Could not retrieve url: ', 'http://www.developersrevolt.com/image/mopar-dodge-viper-forklift.jpg', ' | skipping')
69%|█████████████████████████▎ | 1004/1465 [1:59:34<08:02, 1.05s/it]('Could not retrieve url: ', 'http://www.delphi-force.com/forklift/forklift.gif', ' | skipping')
69%|█████████████████████████▌ | 1012/1465 [1:59:48<12:36, 1.67s/it]('Could not retrieve url: ', 'http://www.life-skills-plus.com/images/forklift_accident.jpg', ' | skipping')
70%|█████████████████████████▋ | 1019/1465 [1:59:55<07:33, 1.02s/it]('Could not retrieve url: ', 'http://images.yogee.com.au/lego-Mini-Forklift-2.jpg', ' | skipping')
70%|█████████████████████████▊ | 1022/1465 [2:00:06<20:33, 2.78s/it]('Could not retrieve url: ', 'http://coastathletics.org/2005/fun_web_05/Fun%20Stuff%20II/images/forklift%20problem.jpg', ' | skipping')
70%|█████████████████████████▉ | 1028/1465 [2:00:15<12:35, 1.73s/it]('Could not retrieve url: ', 'http://www.iceequipment.com/usedlist/trucks/cat-forklift.jpg', ' | skipping')
71%|██████████████████████████▎ | 1044/1465 [2:01:05<11:39, 1.66s/it]('Could not retrieve url: ', 'http://www.proforkliftservice.net/images/forlift-array/pro-forklift-hyster.jpg', ' | skipping')
71%|██████████████████████████▍ | 1046/1465 [2:01:06<08:45, 1.25s/it]('Could not retrieve url: ', 'http://www.marshallauctionservice.com/images/forklift.jpg', ' | skipping')
72%|██████████████████████████▊ | 1061/1465 [2:01:29<08:38, 1.28s/it]('Could not retrieve url: ', 'http://eerc.ra.utk.edu/etcfc/pix/AlcoaPlant/LindeForklift.jpg', ' | skipping')
73%|██████████████████████████▉ | 1066/1465 [2:01:36<08:35, 1.29s/it]('Could not retrieve url: ', 'http://www.life-skills-plus.com/images/forklift2.jpg', ' | skipping')
73%|███████████████████████████ | 1070/1465 [2:01:41<08:01, 1.22s/it]('Could not retrieve url: ', 'http://www.yale-europe.com/writeable/newsitems/upload/YALE%20TYRES.jpg', ' | skipping')
73%|███████████████████████████ | 1074/1465 [2:01:54<12:44, 1.96s/it]('Could not retrieve url: ', 'http://nettcollege.com/images/forklift_truck_training.jpg', ' | skipping')
74%|███████████████████████████▎ | 1079/1465 [2:02:01<08:50, 1.37s/it]('Could not retrieve url: ', 'http://www.combination.ph/images/Products_Images/Forklift/ForkLift-Komatsu-FD20.jpg', ' | skipping')
74%|███████████████████████████▍ | 1086/1465 [2:02:07<05:23, 1.17it/s]('Could not retrieve url: ', 'http://www.sfcc.tv/images/forklift.gif', ' | skipping')
75%|███████████████████████████▋ | 1098/1465 [2:02:19<05:34, 1.10it/s]('Could not retrieve url: ', 'http://data.primeportal.net/iraq/forklift1.JPG', ' | skipping')
75%|███████████████████████████▉ | 1106/1465 [2:04:42<29:43, 4.97s/it]('Could not retrieve url: ', 'http://keith.lazuka.org/images/raft/raft-forklift.jpg', ' | skipping')
76%|████████████████████████████▏ | 1115/1465 [2:04:56<10:46, 1.85s/it]('Could not retrieve url: ', 'http://www.thingamababy.com/photos/uncategorized/2007/09/06/forklift.jpg', ' | skipping')
77%|████████████████████████████▍ | 1125/1465 [2:05:11<11:53, 2.10s/it]('Could not retrieve url: ', 'http://www.cottenauctions.com/tharps/images/forklift_small.jpg', ' | skipping')
78%|████████████████████████████▊ | 1139/1465 [2:07:39<08:03, 1.48s/it]('Could not retrieve url: ', 'http://www.gladwelltraining.co.uk/images/forklift.jpg', ' | skipping')
79%|█████████████████████████████▎ | 1163/1465 [2:08:25<09:39, 1.92s/it]('Could not retrieve url: ', 'http://gardencenternursery.wsu.edu/container/images/ForkLiftLoadingTruck.jpg', ' | skipping')
84%|███████████████████████████████▏ | 1237/1465 [2:12:13<03:23, 1.12it/s]('Could not retrieve url: ', 'http://www.firstaccesssafety.com/images/Forklift-truck-lag.jpg', ' | skipping')
85%|███████████████████████████████▌ | 1248/1465 [2:12:26<05:23, 1.49s/it]('Could not retrieve url: ', 'http://data.primeportal.net/iraq/forklift2.JPG', ' | skipping')
86%|███████████████████████████████▋ | 1254/1465 [2:14:41<27:08, 7.72s/it]('Could not retrieve url: ', 'http://www.dgs.state.pa.us/surp_prop/lib/surp_prop/federal_weekly_equipment/forklift3.jpg', ' | skipping')
88%|████████████████████████████████▍ | 1282/1465 [2:15:19<02:31, 1.20it/s]('Could not retrieve url: ', 'http://sherbourne.net/images/ForkliftHelps.JPG', ' | skipping')
92%|██████████████████████████████████ | 1349/1465 [2:17:04<03:15, 1.68s/it]('Could not retrieve url: ', 'http://www1.istockphoto.com/file_thumbview_approve/490286/2/istockphoto_490286_forklift.jpg', ' | skipping')
93%|██████████████████████████████████▍ | 1366/1465 [2:17:35<03:37, 2.20s/it]('Could not retrieve url: ', 'http://officespam.chattablogs.com/archives/forklift-lifting-a-forklift-thumb.GIF', ' | skipping')
94%|██████████████████████████████████▉ | 1381/1465 [2:17:58<02:00, 1.44s/it]('Could not retrieve url: ', 'http://coveryourlift.indoff.com/media/CVYL/catalog/clearcap1.jpg', ' | skipping')
95%|███████████████████████████████████▏ | 1393/1465 [2:18:18<02:47, 2.33s/it]('Could not retrieve url: ', 'http://www.northlincsmentalhealth.nhs.uk/images/Sandfield-model-forklift.jpg', ' | skipping')
95%|███████████████████████████████████▏ | 1394/1465 [2:18:19<02:00, 1.70s/it]('Could not retrieve url: ', 'http://my.universe.sc/imgs/forklift_5.jpg', ' | skipping')
97%|███████████████████████████████████▉ | 1424/1465 [2:19:21<00:43, 1.05s/it]('Could not retrieve url: ', 'http://www.arpsafe.co.uk/pictures/forklift%2021.JPG', ' | skipping')
97%|████████████████████████████████████ | 1428/1465 [2:19:26<00:42, 1.15s/it]('Could not retrieve url: ', 'http://www.dgs.state.pa.us/surp_prop/lib/surp_prop/federal_weekly_equipment/forklift2.jpg', ' | skipping')
98%|████████████████████████████████████▏| 1431/1465 [2:19:32<00:47, 1.40s/it]('Could not retrieve url: ', 'http://www.lakepointemarine.com/images/forklift.gif', ' | skipping')
98%|████████████████████████████████████▎| 1438/1465 [2:19:38<00:24, 1.11it/s]('Could not retrieve url: ', 'http://www.thestudio75.co.nz/gallery/images/forklift.jpg', ' | skipping')
98%|████████████████████████████████████▍| 1443/1465 [2:19:41<00:15, 1.44it/s]('Could not retrieve url: ', 'http://www.macquip.co.nz/tn_forklift203.jpg', ' | skipping')
99%|████████████████████████████████████▋| 1454/1465 [2:19:50<00:09, 1.21it/s]('Could not retrieve url: ', 'http://heddev.com/miata/images/Rack%20on%20forklift%201%20med.jpg', ' | skipping')
100%|█████████████████████████████████████| 1465/1465 [2:20:00<00:00, 1.07it/s]

Charmap code can't decode byte

Traceback (most recent call last):
File "download_images.py", line 18, in
urls = f.readlines()
File "C:\Users\Mahathi\AppData\Local\Programs\Python\Python37-32\lib\encodings\cp1252.py", line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 3779: character maps to

NameError: name 'raw_input' is not defined

after cloning this into a my local folder I opened cmd command from that directory and typed python browse_classes.py -->dog and got result

Traceback (most recent call last):
  File "browse_classes.py", line 13, in <module>
    query = raw_input("-->")
NameError: name 'raw_input' is not defined

Am I missing something here?

PS: I put parentheses in lines 17 and 18 to match with Python 3.x

Suggestion: Timeout for url

Hi,

I realized a lot of the URLs do take quite a long time to finally state they can not be reached. If you'd use urllib.urlopen instead of urlretrieve you can define a timeout. Like this:

try:
    request = urllib.urlopen(url, timeout=500)
    with open(os.path.join(output_folder, fname), 'wb') as f:
        f.write(request.read())		
except Exception as ex:
    print "Could not retrieve url: ", url, " | skipping" 
    print ex

I would write a pull request but I am using urllib2 and python2.7 and lack a bit of motivation to install python3 to test it adequately.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.