dgnsrekt / fomo-social-harvester Goto Github PK

Runtime error:
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/pool.py", line 119, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.6/multiprocessing/pool.py", line 44, in mapstar
return list(map(*args))
File "/root/fomo-social-harvester/fomo_social_harvester/scraper/twitter.py", line 83, in parse_twitter_count
raise TwitterParsingError(f'Element Not found {name}')
scraper.twitter.TwitterParsingError: Element Not found vulcano
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/root/.local/share/virtualenvs/fomo-social-harvester-sYfiUG5X/lib/python3.6/site-packages/luigi/worker.py", line 203, in run
new_deps = self._run_get_new_deps()
File "/root/.local/share/virtualenvs/fomo-social-harvester-sYfiUG5X/lib/python3.6/site-packages/luigi/worker.py", line 140, in _run_get_new_deps
task_gen = self.task.run()
File "/root/fomo-social-harvester/fomo_social_harvester/twitter_pipe.py", line 64, in run
member_records = p.map(twitter.parse_twitter_count, twitter_links)
File "/usr/lib/python3.6/multiprocessing/pool.py", line 266, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib/python3.6/multiprocessing/pool.py", line 644, in get
raise self._value
scraper.twitter.TwitterParsingError: Element Not found vulcano

Runtime error:
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/pool.py", line 119, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.6/multiprocessing/pool.py", line 44, in mapstar
return list(map(*args))
File "/root/fomo-social-harvester/fomo_social_harvester/scraper/link_scraper.py", line 179, in parse_coins_link_information
element, links = get_elements_and_links_from_url(url)
File "/root/fomo-social-harvester/fomo_social_harvester/scraper/link_scraper.py", line 82, in get_elements_and_links_from_url
element = html.find(selector)[0]
IndexError: list index out of range
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/root/.local/share/virtualenvs/fomo-social-harvester-sYfiUG5X/lib/python3.6/site-packages/luigi/worker.py", line 203, in run
new_deps = self._run_get_new_deps()
File "/root/.local/share/virtualenvs/fomo-social-harvester-sYfiUG5X/lib/python3.6/site-packages/luigi/worker.py", line 140, in run_get_new_deps
task_gen = self.task.run()
File "/root/fomo-social-harvester/fomo_social_harvester/base_pipe.py", line 66, in run
records = p.map(parse_coins_link_information, links) # TODO: CHANGE
File "/usr/lib/python3.6/multiprocessing/pool.py", line 266, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib/python3.6/multiprocessing/pool.py", line 644, in get
raise self._value
IndexError: list index out of range