mylar3 / mylar3 Goto Github PK

Describe the bug
At line 168

However on line 174

Environment (please complete the following information):

• OS: [all]
• Branch / commit: [python3-dev & master]

Job "RSS Feeds (trigger: interval[0:30:00], next run at: 2020-01-15 20:45:07 UTC)" raised an exception
Traceback (most recent call last):
  File "/home/mylar3/.local/lib/python3.8/site-packages/apscheduler/executors/base.py", line 125, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/opt/mylar.py3/mylar/rsscheckit.py", line 99, in run
    mylar.search.searchforissue(rsscheck='yes')
  File "/opt/mylar.py3/mylar/search.py", line 1761, in searchforissue
    foundNZB, prov = search_init(comic['ComicName'], result['Issue_Number'], str(ComicYear), SeriesYear, Publisher, IssueDate, StoreDate, result['IssueID'], AlternateSearch, UseFuzzy, ComicVersion, SARC=result['SARC'], IssueArcID=result['IssueArcID'], mode=mode, rsscheck=rsscheck, ComicID=result['ComicID'], filesafe=Comicname_filesafe, allow_packs=AllowPacks, oneoff=OneOff, torrentid_32p=TorrentID_32p, digitaldate=DigitalDate, booktype=booktype)
  File "/opt/mylar.py3/mylar/search.py", line 339, in search_init
    findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, Publisher, IssueDate, StoreDate, searchprov, send_prov_count, IssDateFix, IssueID, UseFuzzy, newznab_host, ComicVersion=ComicVersion, SARC=SARC, IssueArcID=IssueArcID, RSS="yes", ComicID=ComicID, issuetitle=issuetitle, unaltered_ComicName=unaltered_ComicName, oneoff=oneoff, cmloopit=cmloopit, manual=manual, torznab_host=torznab_host, digitaldate=digitaldate, booktype=booktype)
  File "/opt/mylar.py3/mylar/search.py", line 1392, in NZB_SEARCH
    if int(intIss) == int(comintIss) or all([cmloopit == 4, findcomiciss is None, pc_in is None]) or all([cmloopit == 4, findcomiciss is None, pc_in == 1]):
TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'

Full log attached - weirdly the traceback only appears when running from command line, not in the debug (but occurred immediately after the last line in the log)
mylar.log

01-Mar-2020 20:51:30 - DEBUG :: mylar.NZB_SEARCH.624 : SEARCH-QUEUE : Sending request to DDL site for : Action Comics 1018
01-Mar-2020 20:51:33 - ERROR :: mylar.excepthook.315 : SEARCH-QUEUE : Uncaught exception: Traceback (most recent call last):
File "F:\mylar3\mylar\logger.py", line 337, in new_run
old_run(*args, **kwargs)
File "D:\Python37-32\lib\threading.py", line 870, in run
self._target(*self._args, **self.kwargs)
File "F:\mylar3\mylar\helpers.py", line 3114, in search_queue
ss_queue = mylar.search.searchforissue(item['issueid'])
File "F:\mylar3\mylar\search.py", line 1873, in searchforissue
foundNZB, prov = search_init(ComicName, IssueNumber, str(IssueYear), SeriesYear, Publisher, IssueDate, StoreDate, actissueid, AlternateSearch, UseFuzzy, ComicVersion, SARC=SARC, IssueArcID=IssueArcID, mode=mode, rsscheck=rsscheck, ComicID=ComicID, filesafe=Comicname_filesafe, allow_packs=allow_packs, oneoff=oneoff, manual=manual, torrentid_32p=TorrentID_32p, digitaldate=DigitalDate, booktype=booktype)
File "F:\mylar3\mylar\search.py", line 360, in search_init
findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, Publisher, IssueDate, StoreDate, searchprov, send_prov_count, IssDateFix, IssueID, UseFuzzy, newznab_host, ComicVersion=ComicVersion, SARC=SARC, IssueArcID=IssueArcID, RSS="no", ComicID=ComicID, issuetitle=issuetitle, unaltered_ComicName=unaltered_ComicName, allow_packs=allow_packs, oneoff=oneoff, cmloopit=cmloopit, manual=manual, torznab_host=torznab_host, torrentid_32p=torrentid_32p, digitaldate=digitaldate, booktype=booktype)
File "F:\mylar3\mylar\search.py", line 626, in NZB_SEARCH
bb = b.search()
File "F:\mylar3\mylar\getcomics.py", line 68, in search
return self.search_results()
File "F:\mylar3\mylar\getcomics.py", line 86, in search_results
soup = BeautifulSoup(open(self.local_filename), 'html.parser')
File "D:\Python37-32\lib\site-packages\bs4_init.py", line 286, in init
markup = markup.read()
File "D:\Python37-32\lib\encodings\cp1252.py", line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 30254: character maps to

carepackage (1).zip

Describe the request
Make (also) the different tabs under Settings read values from config.ini "dynamically", in lack of a better word.

I was about to post this bug report;

Selecting 'This Week' and Adding a Comic changes the Status to Wanted. But if I select the Comic, the page with "(Comic information is currently being loaded)" is spinning forever.

tail -f /usr/local/mylar3/log/mylar.log
`01-Mar-2020 16:06:20 - INFO :: mylar.addbyid.433 : CP Server Thread-3 : Attempting to add directly by ComicVineID: 120102
01-Mar-2020 16:06:23 - INFO :: mylar.addComictoDB.125 : Thread-14 : Now adding/updating: Unearth
01-Mar-2020 16:06:23 - INFO :: mylar.addComictoDB.178 : Thread-14 : Sucessfully retrieved details for Unearth
01-Mar-2020 16:06:23 - INFO :: mylar.addComictoDB.184 : Thread-14 : Previous version detected as None - seeing if update required
01-Mar-2020 16:06:23 - ERROR :: mylar.excepthook.315 : Thread-14 : Uncaught exception: Traceback (most recent call last):
File "/usr/local/mylar3/mylar/filers.py", line 109, in folder_create
comlocation = os.path.join(mylar.CONFIG.DESTINATION_DIR, helpers.replace_all(chunk_folder_format, values))
File "/usr/local/lib/python3.7/posixpath.py", line 80, in join
a = os.fspath(a)
TypeError: expected str, bytes or os.PathLike object, not NoneType

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/mylar3/mylar/logger.py", line 337, in new_run
old_run(*args, **kwargs)
File "/usr/local/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/mylar3/mylar/importer.py", line 217, in addComictoDB
comlocation = dothedew.folder_create()
File "/usr/local/mylar3/mylar/filers.py", line 112, in folder_create
if 'TypeError' in e:
TypeError: argument of type 'TypeError' is not iterable
`

Environment (please complete the following information):

• OS: FreeNAS-11.3-RELEASE w/ jail FreeBSD 11.3-RELEASE-p5
• Branch / commit: Version: 966f175 (python3-dev)

Additional information
python -V Python 3.7.6

Request
So, yeah, basically - this error was because I had two different browsers open, both had loaded the Settings page, and I accidentally altered some settings in one browser and saved the config.

Then time went by, and I went to the other browser and altered another setting, in another Settings tab. When I did this, the Comic Location Path was already "loaded" with the old value, None. Thus when I saved the configuration in this new browser, the Comic Location Path was overwritten with "None".

This made mylar3 unable to write to the directory of where it should add the Comic.

So. Yeah. What to say:

• I'll definitely refresh/click the Settings page before I do any edit now. Or stick to just one browser when I am editing settings :)

But maybe;

• If mylar3 does not have a valid Comic Location Path, produce a human readable error message?

 ERROR<!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
    <title>500 Internal Server Error</title>
    <style type="text/css">
    #powered_by {
        margin-top: 20px;
        border-top: 2px solid black;
        font-style: italic;
    }

    #traceback {
        color: red;
    }
    </style>
</head>
    <body>
        <h2>500 Internal Server Error</h2>
        <p>The server encountered an unexpected condition which prevented it from fulfilling the request.</p>
        <pre id="traceback">Traceback (most recent call last):
  File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/_cprequest.py", line 638, in respond
    self._do_respond(path_info)
  File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/_cprequest.py", line 697, in _do_respond
    response.body = self.handler()
  File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/lib/encoding.py", line 219, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/opt/mylar/mylar/webserve.py", line 5715, in IssueInfo
    issuedetails = helpers.IssueDetails(filelocation, IssueID=issueid)
  File "/opt/mylar/mylar/helpers.py", line 1495, in IssueDetails
    issue_data = mylar.cv.getComic(None, 'single_issue', IssueID)
  File "/opt/mylar/mylar/cv.py", line 212, in getComic
    return singleIssue(dom)
  File "/opt/mylar/mylar/cv.py", line 1044, in singleIssue
    issue_info['description'] = drophtml(data['description'])
  File "/opt/mylar/mylar/cv.py", line 1103, in drophtml
    soup = Soup(html, "html.parser")
  File "/home/offspring/.local/lib/python3.7/site-packages/bs4/__init__.py", line 287, in __init__
    elif len(markup) &lt;= 256 and (
TypeError: object of type 'NoneType' has no len()
</pre>
    <div id="powered_by">
      <span>
        Powered by <a href="http://www.cherrypy.org">CherryPy 18.5.0</a>
      </span>
    </div>
    </body>
</html>

@BRTPOB need to know what series & issue number please - likely CV data is missing or incomplete

Describe the bug
Slow page-loads when RSS Feeds being parsed

CarePackage
No CP as per other ticket, but also nothing in the debug logs.

Environment (please complete the following information):

• OS: Win10-64
• Branch / commit: Dev/build 9246809

Additional information
Manage and Logs both load quickly. All other links across the top take considerable time to load.
After pausing RSS, pages still unresponsive (30+s sometimes). After restarting Mylar, pages once more load quickly.

Attempts to repro:
Manually force start RSS feed scan via http://localhost:8090/mylar/manage
First few minutes so far and UI is responsive as expected.
CPU activity as per Task Manager is less spike-y than when having to manually restart mylar.
Cropped from debug logs:

12-Feb-2020 02:31:48 - INFO :: mylar.clearLogs.3997 : CP Server Thread-11 : Web logs cleared
12-Feb-2020 02:32:11 - INFO :: mylar.schedulerForceCheck.2642 : CP Server Thread-8 : [RSS Feeds (trigger: interval[0:30:00], next run at: 2020-02-11 15:39:26 UTC)] Now force submitting job for jobid rss
12-Feb-2020 02:32:11 - INFO :: mylar.run.37 : ThreadPoolExecutor-0_3 : [RSS-FEEDS] RSS Feed Check Initalizing....
12-Feb-2020 02:32:11 - INFO :: mylar.run.92 : ThreadPoolExecutor-0_3 : [RSS-FEEDS] Initiating RSS Feed Check for NZB Providers.
12-Feb-2020 02:32:11 - DEBUG :: mylar.nzbs.500 : ThreadPoolExecutor-0_3 : [RSS] You have enabled 1 NZB RSS search providers.
12-Feb-2020 02:32:11 - DEBUG :: mylar._parse_feed.466 : ThreadPoolExecutor-0_3 : [RSS] Fetching items from nzbHydra2
12-Feb-2020 02:32:11 - DEBUG :: mylar.nzbs.573 : ThreadPoolExecutor-0_3 : [RSS] (nzbHydra2) now being updated...
12-Feb-2020 02:32:11 - INFO :: mylar.nzbs.605 : ThreadPoolExecutor-0_3 : [RSS] (nzbHydra2) 0 entries indexed.
12-Feb-2020 02:32:11 - INFO :: mylar.run.97 : ThreadPoolExecutor-0_3 : [RSS-FEEDS] RSS Feed Check/Update Complete
12-Feb-2020 02:32:11 - INFO :: mylar.run.98 : ThreadPoolExecutor-0_3 : [RSS-FEEDS] Watchlist Check for new Releases
12-Feb-2020 02:32:11 - INFO :: mylar.searchforissue.1608 : ThreadPoolExecutor-0_3 : Initiating RSS Search Scan at the scheduled interval of 30 minutes
12-Feb-2020 02:32:11 - INFO :: mylar.searchforissue.1660 : ThreadPoolExecutor-0_3 : Storyarcs to be searched for : 219

...snip...

12-Feb-2020 02:32:51 - INFO :: mylar.searchforissue.1774 : ThreadPoolExecutor-0_3 : Completed RSS Search scan
12-Feb-2020 02:32:51 - INFO :: mylar.run.100 : ThreadPoolExecutor-0_3 : [RSS-FEEDS] Watchlist Check complete.
12-Feb-2020 02:32:51 - INFO :: mylar.run.102 : ThreadPoolExecutor-0_3 : [RSS-FEEDS] Successfully ran a forced RSS Check.
12-Feb-2020 02:32:51 - DEBUG :: mylar.job_management.3549 : ThreadPoolExecutor-0_3 : ReScheduled job: RSS Feeds to 2020-02-11 16:02:51

When the RSS feed scan is called automatically, sometimes it runs fine but also sometimes it feels like it takes much longer than 40 seconds - these are the times when the web UI for mylar tends to grind, and CPU usage is more aggressive.

I had this issue in the 2.7 version, too, and would need to manually restart mylar a few times a week for it to actually grab comics and behave. Well, something similar.

Quick look at a log file - a full 10mb one - makes it seem like, until I paused and restarted mylar - it had been going for ~20 minutes.

Describe the bug
error when running pip install -r requirements.txt

Screenshots/Logs
I don't know where logs are even dumped at this point in the install, sorry.

``

C:\ProgramData\mylar3>pip install -r requirements.txt
Collecting APScheduler>=3.6.3
Using cached APScheduler-3.6.3-py2.py3-none-any.whl (58 kB)
Collecting beautifulsoup4>=4.8.2
Using cached beautifulsoup4-4.8.2-py3-none-any.whl (106 kB)
Collecting cfscrape>=2.0.8
Using cached cfscrape-2.0.8-py3-none-any.whl (11 kB)
Collecting cheroot==8.2.1
Using cached cheroot-8.2.1-py2.py3-none-any.whl (79 kB)
Collecting CherryPy>=18.5.0
Using cached CherryPy-18.5.0-py2.py3-none-any.whl (418 kB)
Collecting configparser>=4.0.2
Using cached configparser-4.0.2-py2.py3-none-any.whl (22 kB)
Collecting feedparser>=5.2.1
Using cached feedparser-5.2.1.tar.bz2 (192 kB)
Collecting Mako>=1.1.0
Using cached Mako-1.1.1.tar.gz (468 kB)
Collecting natsort>=3.5.2
Using cached natsort-7.0.1-py3-none-any.whl (33 kB)
Collecting Pillow>=7.0.0
Using cached Pillow-7.0.0-cp38-cp38-win_amd64.whl (2.0 MB)
Collecting portend>=2.6
Using cached portend-2.6-py2.py3-none-any.whl (5.1 kB)
Collecting pyinstaller>=3.5
Using cached PyInstaller-3.6.tar.gz (3.5 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing wheel metadata ... done
Collecting PyPDF2>=1.24
Using cached PyPDF2-1.26.0.tar.gz (77 kB)
Collecting PyQt5==5.12.2
Using cached PyQt5-5.12.2-5.12.3-cp35.cp36.cp37.cp38-none-win_amd64.whl (47.5 MB)
Collecting PyQt5-sip==12.7.0
Using cached PyQt5_sip-12.7.0-cp38-cp38-win_amd64.whl (59 kB)
Collecting pytz>=2019.3
Using cached pytz-2019.3-py2.py3-none-any.whl (509 kB)
Collecting requests>=2.22.0
Using cached requests-2.22.0-py2.py3-none-any.whl (57 kB)
Collecting simplejson>=3.17.0
Using cached simplejson-3.17.0.tar.gz (83 kB)
Collecting six>=1.13.0
Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
Collecting tzlocal>=2.0.0
Using cached tzlocal-2.0.0-py2.py3-none-any.whl (15 kB)
Collecting unrar>=0.3
Using cached unrar-0.4-py3-none-any.whl (25 kB)
Collecting unrar-cffi==0.1.0a5
Using cached unrar-cffi-0.1.0a5.tar.gz (253 kB)
ERROR: Command errored out with exit status 1:
command: 'c:\python38\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\Users\Nicholas\AppData\Local\Temp\pip-install-bbe_rqos\unrar-cffi\setup.py'"'"'; file='"'"'C:\Users\Nicholas\AppData\Local\Temp\pip-install-bbe_rqos\unrar-cffi\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\Nicholas\AppData\Local\Temp\pip-install-bbe_rqos\unrar-cffi\pip-egg-info'
cwd: C:\Users\Nicholas\AppData\Local\Temp\pip-install-bbe_rqos\unrar-cffi
Complete output (107 lines):
Traceback (most recent call last):
File "c:\python38\lib\site-packages\setuptools\msvc.py", line 489, in _find_latest_available_vc_ver
return self.find_available_vc_vers()[-1]
IndexError: list index out of range

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 154, in save_modules
    yield saved
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 195, in setup_context
    yield
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 250, in run_setup
    _execfile(setup_script, ns)
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 45, in _execfile
    exec(code, globals, locals)
  File "C:\Users\Nicholas\AppData\Local\Temp\easy_install-pk94ezb5\cffi-1.14.0\setup.py", line 127, in <module>
  File "C:\Users\Nicholas\AppData\Local\Temp\easy_install-pk94ezb5\cffi-1.14.0\setup.py", line 105, in uses_msvc
  File "c:\python38\lib\distutils\command\config.py", line 225, in try_compile
    self._compile(body, headers, include_dirs, lang)
  File "c:\python38\lib\distutils\command\config.py", line 132, in _compile
    self.compiler.compile([src], include_dirs=include_dirs)
  File "c:\python38\lib\distutils\_msvccompiler.py", line 360, in compile
    self.initialize()
  File "c:\python38\lib\distutils\_msvccompiler.py", line 253, in initialize
    vc_env = _get_vc_env(plat_spec)
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 185, in msvc14_get_vc_env
    return EnvironmentInfo(plat_spec, vc_min_ver=14.0).return_env()
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 843, in __init__
    self.si = SystemInfo(self.ri, vc_ver)
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 485, in __init__
    self.vc_ver = vc_ver or self._find_latest_available_vc_ver()
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 492, in _find_latest_available_vc_ver
    raise distutils.errors.DistutilsPlatformError(err)
distutils.errors.DistutilsPlatformError: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\Nicholas\AppData\Local\Temp\pip-install-bbe_rqos\unrar-cffi\setup.py", line 14, in <module>
    setup(
  File "c:\python38\lib\site-packages\setuptools\__init__.py", line 144, in setup
    _install_setup_requires(attrs)
  File "c:\python38\lib\site-packages\setuptools\__init__.py", line 139, in _install_setup_requires
    dist.fetch_build_eggs(dist.setup_requires)
  File "c:\python38\lib\site-packages\setuptools\dist.py", line 716, in fetch_build_eggs
    resolved_dists = pkg_resources.working_set.resolve(
  File "c:\python38\lib\site-packages\pkg_resources\__init__.py", line 780, in resolve
    dist = best[req.key] = env.best_match(
  File "c:\python38\lib\site-packages\pkg_resources\__init__.py", line 1065, in best_match
    return self.obtain(req, installer)
  File "c:\python38\lib\site-packages\pkg_resources\__init__.py", line 1077, in obtain
    return installer(requirement)
  File "c:\python38\lib\site-packages\setuptools\dist.py", line 786, in fetch_build_egg
    return cmd.easy_install(req)
  File "c:\python38\lib\site-packages\setuptools\command\easy_install.py", line 679, in easy_install
    return self.install_item(spec, dist.location, tmpdir, deps)
  File "c:\python38\lib\site-packages\setuptools\command\easy_install.py", line 705, in install_item
    dists = self.install_eggs(spec, download, tmpdir)
  File "c:\python38\lib\site-packages\setuptools\command\easy_install.py", line 890, in install_eggs
    return self.build_and_install(setup_script, setup_base)
  File "c:\python38\lib\site-packages\setuptools\command\easy_install.py", line 1158, in build_and_install
    self.run_setup(setup_script, setup_base, args)
  File "c:\python38\lib\site-packages\setuptools\command\easy_install.py", line 1144, in run_setup
    run_setup(setup_script, args)
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 253, in run_setup
    raise
  File "c:\python38\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 195, in setup_context
    yield
  File "c:\python38\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 166, in save_modules
    saved_exc.resume()
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 141, in resume
    six.reraise(type, exc, self._tb)
  File "c:\python38\lib\site-packages\setuptools\_vendor\six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 154, in save_modules
    yield saved
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 195, in setup_context
    yield
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 250, in run_setup
    _execfile(setup_script, ns)
  File "c:\python38\lib\site-packages\setuptools\sandbox.py", line 45, in _execfile
    exec(code, globals, locals)
  File "C:\Users\Nicholas\AppData\Local\Temp\easy_install-pk94ezb5\cffi-1.14.0\setup.py", line 127, in <module>
  File "C:\Users\Nicholas\AppData\Local\Temp\easy_install-pk94ezb5\cffi-1.14.0\setup.py", line 105, in uses_msvc
  File "c:\python38\lib\distutils\command\config.py", line 225, in try_compile
    self._compile(body, headers, include_dirs, lang)
  File "c:\python38\lib\distutils\command\config.py", line 132, in _compile
    self.compiler.compile([src], include_dirs=include_dirs)
  File "c:\python38\lib\distutils\_msvccompiler.py", line 360, in compile
    self.initialize()
  File "c:\python38\lib\distutils\_msvccompiler.py", line 253, in initialize
    vc_env = _get_vc_env(plat_spec)
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 185, in msvc14_get_vc_env
    return EnvironmentInfo(plat_spec, vc_min_ver=14.0).return_env()
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 843, in __init__
    self.si = SystemInfo(self.ri, vc_ver)
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 485, in __init__
    self.vc_ver = vc_ver or self._find_latest_available_vc_ver()
  File "c:\python38\lib\site-packages\setuptools\msvc.py", line 492, in _find_latest_available_vc_ver
    raise distutils.errors.DistutilsPlatformError(err)
distutils.errors.DistutilsPlatformError: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/
----------------------------------------

ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

``

Environment (please complete the following information):

• OS: Win10-64
• Branch / commit: python3-dev, 47d0bde

Additional information
Grabbed python-2.7.17.amd64.msi and python-3.8.1-amd64.exe to update 2.7 and install 3.x. Confirmed 'python' command was calling 3.x and not 2.7. Updated pip. Ran 'pip install -r requirements.txt' and errors.

Tried to manually grab and install MSVC++ runtime from the URL it spat out (it was already installed but hey who knows), ran pip again. Error. Tried reinstalling pythin 3.8, ran pip again. Error.

192.168.1.2 - - [02/Feb/2020:09:42:07] "GET /config HTTP/1.1" 200 153625 "http://192.168.1.36:8090/config" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:72.0) Gecko/20100101 Firefox/72.0"
[02/Feb/2020:09:42:22] HTTP
Traceback (most recent call last):
File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/_cprequest.py", line 638, in respond
self._do_respond(path_info)
File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/_cprequest.py", line 697, in _do_respond
response.body = self.handler()
File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/lib/encoding.py", line 219, in call
self.body = self.oldhandler(*args, **kwargs)
File "/home/offspring/.local/lib/python3.7/site-packages/cherrypy/_cpdispatch.py", line 54, in call
return self.callable(*self.args, **self.kwargs)
File "/opt/mylar/mylar/webserve.py", line 5663, in generateAPI
apikey = hashlib.sha224(str(random.getrandbits(256))).hexdigest()[0:32]
TypeError: Unicode-objects must be encoded before hashing
[02/Feb/2020:09:42:22] HTTP
Request Headers:
Remote-Addr: 192.168.1.2
HOST: 192.168.1.36:8090
USER-AGENT: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:72.0) Gecko/20100101 Firefox/72.0
ACCEPT: /
ACCEPT-LANGUAGE: en-US,en;q=0.5
ACCEPT-ENCODING: gzip, deflate
X-REQUESTED-WITH: XMLHttpRequest
DNT: 1
CONNECTION: keep-alive
REFERER: http://192.168.1.36:8090/config
192.168.1.2 - - [02/Feb/2020:09:42:22] "GET /generateAPI HTTP/1.1" 500 1654 "http://192.168.1.36:8090/config" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:72.0) Gecko/20100101 Firefox/72.0"

The current importer doesn't scale well, and if comicTagger fails, it fails and stops importing or the endpoint (markImports?action=massimport) timeout and the importing stops completely. I keep having to hit that endpoint every time so that it can mass import a few comics at a time which means this will take forever to get in.

Suggestion:

Move the importer to a Queue for processing. Allow for multiple jobs to run simultaneously (configuration) to speed up importing. Use the queue to recover from failed imports by pushing job back into the queue for later.

If there is a challenge with the table locking, then process all comics back into a queue after you have retrieved the metadata you needed for DB inserts. This will allow you to scale on the metadata reading part and preparing the SQL statements for import. Then have a queue process these in batch SQL inserts or 1 insert at a time but at least the heavy lifting is done prior to the inserts (unless you have dependencies or other complexities that might prevent this from scaling)

carepackage.zip
I added items from the pull list. They turn red to show wanted, but when I go to manage the comics, it shows Comic ID: 111428 (None) and no additional info.

Environment (please complete the following information):

• OS: docker/linux
• Branch / commit: Mylar3/master

Every time a search is launched, forced or scheduled a error occurs stopping the search and seems to suspend other processes

05-Mar-2020 15:46:06 - INFO :: mylar.configure.1009 : MainThread : [COMICTAGGER] Version detected: 1.3.1
05-Mar-2020 15:46:06 - INFO :: mylar.initialize.186 : MainThread : Checking to see if the database has all tables....
05-Mar-2020 15:46:06 - INFO :: mylar.dbcheck.1318 : MainThread : Ensuring DB integrity - Removing all Erroneous Comics (ie. named None)
05-Mar-2020 15:46:06 - INFO :: mylar.dbcheck.1320 : MainThread : Correcting Null entries that make the main page break on startup.
05-Mar-2020 15:46:06 - INFO :: mylar.initialize.200 : MainThread : Successfully discovered local IP and locking it in as : 172.17.0.4
05-Mar-2020 15:46:06 - INFO :: mylar.initialize.262 : MainThread : Remapping the sorting to allow for new additions.
05-Mar-2020 15:46:06 - INFO :: mylar.ComicSort.761 : MainThread : Sucessfully ordered 3 series in your watchlist.
05-Mar-2020 15:46:06 - INFO :: mylar.validateAndCreateDirectory.1693 : MainThread : [DIRECTORY-CHECK] Found comic directory: /config/app
05-Mar-2020 15:46:06 - INFO :: mylar.initialize.72 : MAIN : Starting Mylar on http://0.0.0.0:8090/
05-Mar-2020 15:46:06 - INFO :: mylar.getVersion.186 : MAIN : [LAST_RELEASE] Branch: master
05-Mar-2020 15:46:06 - INFO :: mylar.getVersion.191 : MAIN : [LAST_RELEASE] Version: v0.3.0
05-Mar-2020 15:46:06 - INFO :: mylar.getVersion.194 : MAIN : [LAST_RELEASE] Commit: 232c56b
05-Mar-2020 15:46:06 - INFO :: mylar.getVersion.208 : MAIN : Current Release Name: Hulk smash!
05-Mar-2020 15:46:06 - INFO :: mylar.getVersion.215 : MAIN : Branch detected & set to : master
05-Mar-2020 15:46:06 - INFO :: mylar.versionload.359 : MAIN : version_info: {'current_version': '232c56b30153d17f0de63784e317f7d0e4cec5de', 'current_version_name': 'v0.3.0', 'branch': ' master', 'current_release_name': 'Hulk smash!'}
05-Mar-2020 15:46:06 - INFO :: mylar.versionload.379 : MAIN : Version information: master [232c56b30153d1435t3ggsdg34gdgst24twc5de]
05-Mar-2020 15:46:06 - INFO :: mylar.start.356 : MAIN : DB Updater sccheduled to fire every 5 minutes
05-Mar-2020 15:46:06 - INFO :: mylar.queue_schedule.525 : MAIN : [SEARCH-QUEUE] Attempting to background load the search queue....
05-Mar-2020 15:46:06 - INFO :: mylar.queue_schedule.528 : MAIN : [SEARCH-QUEUE] Successfully started the Search Queuer...
05-Mar-2020 15:46:06 - INFO :: mylar.queue_schedule.536 : MAIN : [POST-PROCESS-QUEUE] Post Process queue enabled & monitoring for api requests....
05-Mar-2020 15:46:06 - INFO :: mylar.queue_schedule.539 : MAIN : [POST-PROCESS-QUEUE] Succesfully started Post-Processing Queuer....
05-Mar-2020 15:46:06 - INFO :: mylar.start.405 : MAIN : [WEEKLY] Checking for existance of Weekly Comic listing...
05-Mar-2020 15:46:06 - INFO :: mylar.start.471 : MAIN : Firing up the Background Schedulers now....
05-Mar-2020 15:46:06 - INFO :: mylar.start.475 : MAIN : Background Schedulers successfully started...
05-Mar-2020 15:46:20 - INFO :: mylar.toggleVerbose.4015 : CP Server Thread-9 : Verbose (DEBUG) logging is enabled
05-Mar-2020 15:46:20 - DEBUG :: mylar.toggleVerbose.4016 : CP Server Thread-9 : If you can read this message, debug logging is now working
05-Mar-2020 15:46:20 - INFO :: mylar.toggleVerbose.4019 : CP Server Thread-9 : config file has been loaded from: /config/app/config.ini
05-Mar-2020 15:46:23 - INFO :: mylar.schedulerForceCheck.2642 : CP Server Thread-3 : [Auto-Search (trigger: interval[6:00:00], next run at: 2020-03-06 02:45:19 UTC)] Now force submitting job for jobid search
05-Mar-2020 15:46:23 - INFO :: mylar.run.28 : ThreadPoolExecutor-0_0 : [SEARCH] Running Search for Wanted.
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1614 : ThreadPoolExecutor-0_0 : Initiating check to add Wanted items to Search Queue....
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:118500 IssueiD: 714255
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:118500 IssueiD: 712334
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:118500 IssueiD: 710006
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:118500 IssueiD: 706858
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 636411
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 612006
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 599898
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 592634
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 587440
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 534311
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 527174
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 520230
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 514490
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 510990
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 499885
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 497433
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 494597
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 493840
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 491620
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 490940
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:81986 IssueiD: 488743
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 487873
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 482739
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 477905
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 473600
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 470384
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 468423
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 462214
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 460275
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 453372
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 451051
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 447962
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 442887
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 437436
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 433797
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 428890
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1767 : ThreadPoolExecutor-0_0 : adding: ComicID:67426 IssueiD: 425853
05-Mar-2020 15:46:23 - INFO :: mylar.searchforissue.1781 : ThreadPoolExecutor-0_0 : Completed Queueing API Search scan
05-Mar-2020 15:46:23 - DEBUG :: mylar.job_management.3567 : ThreadPoolExecutor-0_0 : ReScheduled job: Auto-Search to 2020-03-06 02:46:23
05-Mar-2020 15:46:26 - INFO :: mylar.search_queue.3112 : SEARCH-QUEUE : [SEARCH-QUEUE] Now loading item from search queue: {'comicname': 'Ascender', 'seriesyear': '2019', 'issuenumber': '4', 'issueid': '714255', 'comicid': '118500', 'booktype': 'Print'}
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.63 : SEARCH-QUEUE : Publisher is : Image
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.71 : SEARCH-QUEUE : Issue Title given as : b'the haunted galaxy, part four'
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.102 : SEARCH-QUEUE : Checking for torrent enabled.
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.153 : SEARCH-QUEUE : nzbprovider(s): []
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.156 : SEARCH-QUEUE : There are 4 torrent providers you have selected.
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.161 : SEARCH-QUEUE : There are : 0 nzb providers you have selected
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.180 : SEARCH-QUEUE : search provider order is ['torznab: 1337x', 'torznab: thepiratebay', 'torznab: TorrentProjet2', 'torznab: Limetorrents']
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.247 : SEARCH-QUEUE : calpha/cnumber: None / None
05-Mar-2020 15:46:26 - DEBUG :: mylar.search_init.283 : SEARCH-QUEUE : Initiating Search via : api
05-Mar-2020 15:46:26 - DEBUG :: mylar.NZB_SEARCH.468 : SEARCH-QUEUE : Using Torznab host of : 1337x
05-Mar-2020 15:46:26 - INFO :: mylar.NZB_SEARCH.514 : SEARCH-QUEUE : Shhh be very quiet...I'm looking for Ascender issue: 4 (2019) using 1337x (torznab).
05-Mar-2020 15:46:26 - DEBUG :: mylar.NZB_SEARCH.578 : SEARCH-QUEUE : findloop: 0 / findcount: 1
05-Mar-2020 15:46:26 - INFO :: mylar.NZB_SEARCH.740 : SEARCH-QUEUE : Pausing for 60 seconds before continuing to avoid hammering
05-Mar-2020 15:46:26 - DEBUG :: mylar.NZB_SEARCH.758 : SEARCH-QUEUE : [SSL: False] Search URL: http://192.168.1.134:9117/api/v2.0/indexers/1337x/results/torznab?t=search&q=ascender%20004&cat=&apikey=ypo4pi1od7jct29m75gowndrofhrq5jk
05-Mar-2020 15:46:27 - INFO :: mylar.NZB_SEARCH.816 : SEARCH-QUEUE : no errors on data retrieval...proceeding
05-Mar-2020 15:46:27 - INFO :: mylar.search_init.396 : SEARCH-QUEUE : Could not find Issue 4 of Ascender (2019) using 1337x [api]
05-Mar-2020 15:46:27 - DEBUG :: mylar.NZB_SEARCH.468 : SEARCH-QUEUE : Using Torznab host of : thepiratebay
05-Mar-2020 15:46:27 - INFO :: mylar.NZB_SEARCH.514 : SEARCH-QUEUE : Shhh be very quiet...I'm looking for Ascender issue: 4 (2019) using thepiratebay (torznab).
05-Mar-2020 15:46:27 - DEBUG :: mylar.NZB_SEARCH.578 : SEARCH-QUEUE : findloop: 0 / findcount: 1
05-Mar-2020 15:46:27 - INFO :: mylar.NZB_SEARCH.740 : SEARCH-QUEUE : Pausing for 60 seconds before continuing to avoid hammering
05-Mar-2020 15:46:27 - DEBUG :: mylar.NZB_SEARCH.758 : SEARCH-QUEUE : [SSL: False] Search URL: http://192.168.1.134:9117/api/v2.0/indexers/thepiratebay/results/torznab?t=search&q=ascender%20004&cat=&apikey=ypo4pi1od7jct29m75gowndrofhrq5jk
05-Mar-2020 15:46:28 - INFO :: mylar.NZB_SEARCH.816 : SEARCH-QUEUE : no errors on data retrieval...proceeding
05-Mar-2020 15:46:28 - INFO :: mylar.search_init.396 : SEARCH-QUEUE : Could not find Issue 4 of Ascender (2019) using thepiratebay [api]
05-Mar-2020 15:46:28 - DEBUG :: mylar.NZB_SEARCH.468 : SEARCH-QUEUE : Using Torznab host of : TorrentProjet2
05-Mar-2020 15:46:28 - INFO :: mylar.NZB_SEARCH.514 : SEARCH-QUEUE : Shhh be very quiet...I'm looking for Ascender issue: 4 (2019) using TorrentProjet2 (torznab).
05-Mar-2020 15:46:28 - DEBUG :: mylar.NZB_SEARCH.578 : SEARCH-QUEUE : findloop: 0 / findcount: 1
05-Mar-2020 15:46:28 - INFO :: mylar.NZB_SEARCH.740 : SEARCH-QUEUE : Pausing for 60 seconds before continuing to avoid hammering
05-Mar-2020 15:46:28 - DEBUG :: mylar.NZB_SEARCH.758 : SEARCH-QUEUE : [SSL: False] Search URL: http://192.168.1.134:9117/api/v2.0/indexers/torrentproject2/results/torznab?t=search&q=ascender%20004&cat=&apikey=ypo4pi1od7jct29m75gowndrofhrq5jk
05-Mar-2020 15:46:29 - INFO :: mylar.NZB_SEARCH.816 : SEARCH-QUEUE : no errors on data retrieval...proceeding
05-Mar-2020 15:46:29 - INFO :: mylar.search_init.396 : SEARCH-QUEUE : Could not find Issue 4 of Ascender (2019) using TorrentProjet2 [api]
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.468 : SEARCH-QUEUE : Using Torznab host of : Limetorrents
05-Mar-2020 15:46:29 - INFO :: mylar.NZB_SEARCH.514 : SEARCH-QUEUE : Shhh be very quiet...I'm looking for Ascender issue: 4 (2019) using Limetorrents (torznab).
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.578 : SEARCH-QUEUE : findloop: 0 / findcount: 1
05-Mar-2020 15:46:29 - INFO :: mylar.NZB_SEARCH.740 : SEARCH-QUEUE : Pausing for 60 seconds before continuing to avoid hammering
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.758 : SEARCH-QUEUE : [SSL: False] Search URL: http://192.168.1.134:9117/api/v2.0/indexers/limetorrents/results/torznab?t=search&q=ascender%20004&cat=&apikey=ypo4pi1od7jct29m75gowndrofhrq5jk
05-Mar-2020 15:46:29 - INFO :: mylar.NZB_SEARCH.816 : SEARCH-QUEUE : no errors on data retrieval...proceeding
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.857 : SEARCH-QUEUE : checking search result: Ascender 004 (2019) (Digital) (Zone-Empire)
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.867 : SEARCH-QUEUE : sub: Ascender 004 (2019) (Digital) (Zone-Empire)
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.916 : SEARCH-QUEUE : comsize_b: 65630372
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.953 : SEARCH-QUEUE : size given as: 62.6 MB
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.999 : SEARCH-QUEUE : store date used is : 2019-07-24
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1000 : SEARCH-QUEUE : date used is : 2019-07-24
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1043 : SEARCH-QUEUE : usedate: 2019-07-24
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1089 : SEARCH-QUEUE : [CONV] Thu, 08 Aug 2019 20:46:29 +0000 is after store date of 2019-07-24
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1109 : SEARCH-QUEUE : Entry: Ascender 004 (2019) (Digital) (Zone-Empire)
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.325 : SEARCH-QUEUE : Scanner group tag discovered: Zone-Empire
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.436 : SEARCH-QUEUE : NEWLY SPLIT REORGD: ['Ascender', '004', '(2019)', '(Digital)']
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.471 : SEARCH-QUEUE : checking date : 2019
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.474 : SEARCH-QUEUE : date: 2019
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.802 : SEARCH-QUEUE : datecheck: [{'date': '2019', 'position': 2, 'mod_position': 14}]
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.808 : SEARCH-QUEUE : sctd: 2020
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.817 : SEARCH-QUEUE : year verified as : 2019
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.823 : SEARCH-QUEUE : year verified as: 2019
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.855 : SEARCH-QUEUE : highest_series_position: 2
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.875 : SEARCH-QUEUE : possible_issuenumbers: [{'number': '004', 'position': 1, 'mod_position': 9, 'validcountchk': False}]
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.924 : SEARCH-QUEUE : issue number :004
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.953 : SEARCH-QUEUE : issue_position: 1
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.970 : SEARCH-QUEUE : issue verified as : 004
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.1104 : SEARCH-QUEUE : sf_highest_series_pos: ['Ascender']
05-Mar-2020 15:46:29 - DEBUG :: mylar.parseit.1152 : SEARCH-QUEUE : series title possibly: Ascender
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1126 : SEARCH-QUEUE : parsed_info: {'parse_status': 'success', 'sub': None, 'comicfilename': 'Ascender 004 (2019) (Digital) (Zone-Empire)', 'comiclocation': None, 'series_name': 'Ascender', 'series_name_decoded': 'Ascender', 'issueid': None, 'dynamic_name': 'Ascender', 'series_volume': None, 'alt_series': None, 'alt_issue': None, 'issue_year': '2019', 'issue_number': '004', 'scangroup': 'Zone-Empire', 'reading_order': None, 'booktype': 'issue'}
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1135 : SEARCH-QUEUE : match_check: {'process_status': 'match', 'sub': None, 'volume': None, 'match_type': None, 'comicfilename': 'Ascender 004 (2019) (Digital) (Zone-Empire)', 'comiclocation': None, 'series_name': 'Ascender', 'series_volume': None, 'alt_series': None, 'alt_issue': None, 'issue_year': '2019', 'issueid': None, 'justthedigits': '004', 'annual_comicid': None, 'scangroup': 'Zone-Empire', 'booktype': 'issue'}
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1201 : SEARCH-QUEUE : year detected: 2019
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1203 : SEARCH-QUEUE : year looking for: 2019
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1205 : SEARCH-QUEUE : 2019 - right years match baby!
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1383 : SEARCH-QUEUE : issue we are looking for is : 4
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1384 : SEARCH-QUEUE : integer value of issue we are looking for : 4000
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1391 : SEARCH-QUEUE : issue we found for is : 004
05-Mar-2020 15:46:29 - DEBUG :: mylar.NZB_SEARCH.1393 : SEARCH-QUEUE : integer value of issue we have found : 4000
05-Mar-2020 15:46:29 - ERROR :: mylar.excepthook.315 : SEARCH-QUEUE : Uncaught exception: Traceback (most recent call last):
File "/app/mylar/logger.py", line 337, in new_run
old_run(*args, **kwargs)
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/app/mylar/helpers.py", line 3114, in search_queue
ss_queue = mylar.search.searchforissue(item['issueid'])
File "/app/mylar/search.py", line 1873, in searchforissue
foundNZB, prov = search_init(ComicName, IssueNumber, str(IssueYear), SeriesYear, Publisher, IssueDate, StoreDate, actissueid, AlternateSearch, UseFuzzy, ComicVersion, SARC=SARC, IssueArcID=IssueArcID, mode=mode, rsscheck=rsscheck, ComicID=ComicID, filesafe=Comicname_filesafe, allow_packs=allow_packs, oneoff=oneoff, manual=manual, torrentid_32p=TorrentID_32p, digitaldate=DigitalDate, booktype=booktype)
File "/app/mylar/search.py", line 360, in search_init
findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, Publisher, IssueDate, StoreDate, searchprov, send_prov_count, IssDateFix, IssueID, UseFuzzy, newznab_host, ComicVersion=ComicVersion, SARC=SARC, IssueArcID=IssueArcID, RSS="no", ComicID=ComicID, issuetitle=issuetitle, unaltered_ComicName=unaltered_ComicName, allow_packs=allow_packs, oneoff=oneoff, cmloopit=cmloopit, manual=manual, torznab_host=torznab_host, torrentid_32p=torrentid_32p, digitaldate=digitaldate, booktype=booktype)
File "/app/mylar/search.py", line 1489, in NZB_SEARCH
nzbname = nzbname_create(nzbprov, info=mylar.COMICINFO, title=ComicTitle) #entry['title'])
File "/app/mylar/search.py", line 2004, in nzbname_create
if os.path.exists(mylar.CONFIG.BLACKHOLE_DIR):
File "/usr/lib/python3.7/genericpath.py", line 19, in exists
os.stat(path)
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

Environnement:

Mylar Version: master [v0.3.0 - Hulk smash!]
-- source (build 232c56b)
Python Version : 3.7.5
Language : en_US.UTF-8

Running in a container (hotio) on a Debian 10 system

I have tried removing some of the Torznab to see if the error was coming from a specific provider, but it seems it happens with all providers.

Thanks

With Enable Series-Annual Integration selected, the issue status icon is missing.

It's looking for interfaces/default/images/issueinfo.png but that folder only contains _blue, _grey and _orange pngs.

Windows 10 64 Bit, Python 3.7.6
Version: 5eb0497 (python3-dev)

Describe the bug
Mylar3 can't load torrents into qbittorrent 4.2.1.

CarePackage
24-Feb-2020 17:50:44 - DEBUG :: mylar.searcher.2412 : SEARCH-QUEUE : Torrent Provider: torznab
24-Feb-2020 17:50:44 - INFO :: mylar.torsend2client.964 : SEARCH-QUEUE : matched on Justice League
24-Feb-2020 17:50:44 - DEBUG :: mylar.torsend2client.973 : SEARCH-QUEUE : filename for torrent set to : /home/mylar/mylar3/cache/Justice_League_41_2020.torrent
24-Feb-2020 17:50:46 - DEBUG :: mylar.torsend2client.1176 : SEARCH-QUEUE : [torznab] Saved torrent file to : /home/mylar/mylar3/cache/Justice_League_41_2020.torrent
24-Feb-2020 17:50:46 - INFO :: mylar.torsend2client.1254 : SEARCH-QUEUE : Connected to qBittorrent! Will try to add torrent now!
24-Feb-2020 17:50:46 - INFO :: mylar.load_torrent.62 : SEARCH-QUEUE : filepath to torrent file set to : /home/mylar/mylar3/cache/Justice_League_41_2020.torrent
24-Feb-2020 17:50:46 - INFO :: mylar.load_torrent.65 : SEARCH-QUEUE : Checking if Torrent Exists!
24-Feb-2020 17:50:46 - DEBUG :: mylar.load_torrent.75 : SEARCH-QUEUE : FileName (load_torrent): Justice_League_41_2020.torrent
24-Feb-2020 17:50:46 - DEBUG :: mylar.load_torrent.77 : SEARCH-QUEUE : Torrent Hash (load_torrent): "97044016FED31D0775008A67ECD0EDD9AB2181B7"
24-Feb-2020 17:50:46 - DEBUG :: mylar.find_torrent.40 : SEARCH-QUEUE : Finding Torrent hash: 97044016FED31D0775008A67ECD0EDD9AB2181B7
24-Feb-2020 17:50:46 - DEBUG :: mylar.get_torrent.48 : SEARCH-QUEUE : Getting Torrent info hash: 97044016FED31D0775008A67ECD0EDD9AB2181B7
24-Feb-2020 17:50:46 - ERROR :: mylar.get_torrent.52 : SEARCH-QUEUE : Could not get torrent info for 97044016FED31D0775008A67ECD0EDD9AB2181B7
24-Feb-2020 17:50:46 - INFO :: mylar.load_torrent.87 : SEARCH-QUEUE : Torrent not added yet, trying to add it now!
24-Feb-2020 17:50:46 - INFO :: mylar.load_torrent.93 : SEARCH-QUEUE : Setting download label to: Mylar
24-Feb-2020 17:50:46 - ERROR :: mylar.load_torrent.114 : SEARCH-QUEUE : Torrent not added
24-Feb-2020 17:50:46 - INFO :: mylar.torsend2client.1262 : SEARCH-QUEUE : Unable to add torrent to qBittorrent
24-Feb-2020 17:50:46 - ERROR :: mylar.searcher.2430 : SEARCH-QUEUE : Unable to send torrent - check logs and settings (this would be marked as a BAD torrent if Failed Handling was enabled)
24-Feb-2020 17:50:46 - INFO :: mylar.search_init.396 : SEARCH-QUEUE : Could not find Issue 41 of Justice League (2018) using Jackett-ETTV [api]

Environment (please complete the following information):

• OS: Linux Ubuntu 18.04.4 LTS
• Branch / commit: Master 9c0fd7b

Mylar host information:
Linux ubuntu 4.15.0-88-generic #88-Ubuntu SMP Tue Feb 11 20:11:34 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Mylar python information:
Python 3.8.0
/usr/bin/python3.8

PIP (freeze) list:
altgraph==0.17
APScheduler==3.6.3
asn1crypto==0.24.0
attrs==17.4.0
Automat==0.6.0
beautifulsoup4==4.8.2
certifi==2018.1.18
cffi==1.14.0
cfscrape==2.1.1
chardet==3.0.4
cheroot==8.2.1
CherryPy==18.5.0
click==6.7
colorama==0.3.7
command-not-found==0.3
configobj==5.0.6
configparser==4.0.2
constantly==15.1.0
cryptography==2.1.4
distro-info===0.18ubuntu0.18.04.1
feedparser==5.2.1
httplib2==0.9.2
hyperlink==17.3.1
idna==2.6
incremental==16.10.1
iotop==0.6
jaraco.classes==3.1.0
jaraco.collections==3.0.0
jaraco.functools==3.0.0
jaraco.text==3.2.0
keyring==10.6.0
keyrings.alt==3.0
language-selector==0.1
Mako==1.1.1
MarkupSafe==1.1.1
more-itertools==8.2.0
natsort==4.0.4
netifaces==0.10.4
PAM==0.4.2
Pillow==7.0.0
portend==2.6
pyasn1==0.4.2
pyasn1-modules==0.2.1
pycparser==2.19
pycrypto==2.6.1
pycurl==7.43.0.1
pygobject==3.26.1
PyInstaller==3.6
pyOpenSSL==17.5.0
PyPDF2==1.26.0
PyQt5==5.12.2
PyQt5-sip==12.7.0
pyserial==3.4
python-apt==1.6.5+ubuntu0.2
python-debian==0.1.32
pytz==2019.3
pyxdg==0.25
PyYAML==3.12
requests==2.23.0
requests-unixsocket==0.1.5
SecretStorage==2.3.1
service-identity==16.0.0
simplejson==3.17.0
six==1.14.0
soupsieve==2.0
speedtest-cli==2.0.0
ssh-import-id==5.7
systemd-python==234
tempora==2.1.0
Twisted==17.9.0
tzlocal==2.0.0
ufw==0.36
unattended-upgrades==0.1
unrar==0.4
unrar-cffi==0.1.0a5
urllib3==1.25.8
zc.lockfile==2.0
zope.interface==4.3.2

Mylar running environment:
LANG = en_AU.UTF-8
SUDO_GID = 1000
DISPLAY = localhost:10.0
USERNAME = mylar
JAVA_HOME = /usr/lib/jvm/java-8-oracle
SUDO_COMMAND = /bin/bash
J2SDKDIR = /usr/lib/jvm/java-8-oracle
DERBY_HOME = /usr/lib/jvm/java-8-oracle/db
USER = mylar
PWD = /home/mylar/mylar3
HOME = /home/mylar
J2REDIR = /usr/lib/jvm/java-8-oracle/jre
SUDO_USER = arathen
XDG_DATA_DIRS = /usr/local/share:/usr/share:/var/lib/snapd/desktop
SUDO_UID = 1000
MAIL = /var/mail/mylar
SHELL = /bin/bash
TERM = xterm
SHLVL = 1
LANGUAGE = en_AU:en
LOGNAME = mylar
PATH = /home/mylar/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/usr/lib/jvm/java-8-oracle/bin:/usr/lib/jvm/java-8-oracle/db/bin:/usr/lib/jvm/java-8-oracle/jre/bin
OLDPWD = /home/mylar
_ = /usr/bin/python3.8

Mylar git status:
git version 2.17.1

On branch master
Your branch is up to date with 'origin/master'.
nothing to commit, working tree clean

Additional information
Just installed this today after seeing the code freeze announcement in the previous version, so qbittorrent integration has not worked successfully so far.

Describe the bug
Trying to install the requirements on Windows.

Error while unpacking cffi-0.1.0.a5.tar.gz
New Text Document.txt

Environment (please complete the following information):

• OS: Windows 7
• Branch / commit: master

It installed about 20 other packages before breaking on this one.

Traceback (most recent call last): File "Mylar.py", line 26, in import mylar File "c:\mylar\mylar_init_.py", line 33, in from apscheduler.schedulers.background import BackgroundScheduler ImportError: bad magic number in 'apscheduler': b'\x03\xf3\r\n'

Describe the bug
Deluge fails to connect each time I run test.

CarePackage
carepackage.zip

Environment (please complete the following information):

• OS: Ubuntu 19.10
• Branch / commit: Version: adc9bb5 (python3-dev)

Additional information
Deluge runs on a separate VM, and it is working just fine. I do have a self-signed certificate in front of deluge (mylar too).

Describe the bug
Error establishing connection to rTorrent

error log

01-Mar-2020 00:44:08 - ERROR :: mylar.connect.78 : CP Server Thread-6 : Make sure you have the right protocol specified for the rtorrent host. Failed to connect to rTorrent - error: HTTPSConnectionPool(host='unraid.home.lab', port=8061): Max retries exceeded with url: //plugins/httprpc/action.php (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_record', 'wrong version number')])"))).

01-Mar-2020 00:44:08 - WARNING :: mylar.testrtorrent.6064 : CP Server Thread-6 : [rTorrent] Could not establish connection to http://unraid.home.lab:8061. Error returned: HTTPSConnectionPool(host='unraid.home.lab', port=8061): Max retries exceeded with url: //plugins/httprpc/action.php (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_record', 'wrong version number')])")))

Environment

• Docker image based on Ubuntu [https://hub.docker.com/r/hotio/mylar3].
  I've also tried #135
• Branch / commit: mylar3: master

Additional information
My rTorrent isn't using https
I'm not using https url on mylar trying to connect to rTorrent (as per the logs)
I've go the exact same settings & rtorrent instance working fine with the previous Mylar

Describe the bug
I cannot run the "Manually ReTag" option for a new series

CarePackage
carepackage.zip

Environment (please complete the following information):

• OS: Ubuntu 19.10
• Branch / commit: Version: adc9bb5 (python3-dev)

Additional information
It did change the permission properly

Describe the bug
As soon as I click on a series, I receive

CarePackage
I cannot create a care package, when I try, I received

I am also not seeing any events in the logs

Environment (please complete the following information):

• OS: Ubuntu 19.10
• Branch / commit: Version: a4de247 (python3-dev)

Additional information
Everything was fine prior to updating to the latest commits

Received this traceback

Looking at git blame for line 1019, I think self.status_msg isn't being return'ed back from here?

Am I barking up the wrong tree?

Not sure if this is done, but it would be great if instead of using various parsing techniques on the filename to determine how it should be imported, perhaps use the XML file inside the CBZ? This will have a wealth of information and if people have used ComicVine to already add metadata to the file as I have, it may make the imported data more accurate.

When adding a comic from a search result, the screen goes back to my manage screen and doesn't add the comic selected.

In the carepackage, this is happening at the line dated Mar 3 21:54:05. Adding items from weekly pull list followed below. They added, but also threw errors.

Environment (please complete the following information):

• OS: docker/linux
• Branch / commit: Mylar3/master

Additional information
Add any other information about the problem here.
carepackage.zip

Hi,

Still getting a error on torznab searches. Different one than last time though. I cant figure out if it is still related to my config. Thanks:

06-Mar-2020 12:02:14 - INFO :: mylar.NZB_SEARCH.514 : SEARCH-QUEUE : Shhh be very quiet...I'm looking for Zero issue: 18 (2015) using Limetorrents (torznab).
06-Mar-2020 12:02:14 - INFO :: mylar.NZB_SEARCH.740 : SEARCH-QUEUE : Pausing for 60 seconds before continuing to avoid hammering
06-Mar-2020 12:02:14 - INFO :: mylar.NZB_SEARCH.816 : SEARCH-QUEUE : no errors on data retrieval...proceeding
06-Mar-2020 12:02:14 - ERROR :: mylar.excepthook.315 : SEARCH-QUEUE : Uncaught exception: Traceback (most recent call last):
File "/app/mylar/logger.py", line 337, in new_run
old_run(*args, **kwargs)
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/app/mylar/helpers.py", line 3114, in search_queue
ss_queue = mylar.search.searchforissue(item['issueid'])
File "/app/mylar/search.py", line 1873, in searchforissue
foundNZB, prov = search_init(ComicName, IssueNumber, str(IssueYear), SeriesYear, Publisher, IssueDate, StoreDate, actissueid, AlternateSearch, UseFuzzy, ComicVersion, SARC=SARC, IssueArcID=IssueArcID, mode=mode, rsscheck=rsscheck, ComicID=ComicID, filesafe=Comicname_filesafe, allow_packs=allow_packs, oneoff=oneoff, manual=manual, torrentid_32p=TorrentID_32p, digitaldate=DigitalDate, booktype=booktype)
File "/app/mylar/search.py", line 360, in search_init
findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, Publisher, IssueDate, StoreDate, searchprov, send_prov_count, IssDateFix, IssueID, UseFuzzy, newznab_host, ComicVersion=ComicVersion, SARC=SARC, IssueArcID=IssueArcID, RSS="no", ComicID=ComicID, issuetitle=issuetitle, unaltered_ComicName=unaltered_ComicName, allow_packs=allow_packs, oneoff=oneoff, cmloopit=cmloopit, manual=manual, torznab_host=torznab_host, torrentid_32p=torrentid_32p, digitaldate=digitaldate, booktype=booktype)
File "/app/mylar/search.py", line 1124, in NZB_SEARCH
parsed_comic = p_comic.listFiles()
File "/app/mylar/filechecker.py", line 116, in listFiles
runresults = self.parseit(self.dir, self.file)
File "/app/mylar/filechecker.py", line 355, in parseit
tmpfilename = re.sub(i, 'XCV', tmpfilename)
File "/usr/lib/python3.7/re.py", line 192, in sub
return _compile(pattern, flags).sub(repl, string, count)
File "/usr/lib/python3.7/re.py", line 286, in _compile
p = sre_compile.compile(pattern, flags)
File "/usr/lib/python3.7/sre_compile.py", line 764, in compile
p = sre_parse.parse(p, flags)
File "/usr/lib/python3.7/sre_parse.py", line 924, in parse
p = _parse_sub(source, pattern, flags & SRE_FLAG_VERBOSE, 0)
File "/usr/lib/python3.7/sre_parse.py", line 420, in _parse_sub
not nested and not items))
File "/usr/lib/python3.7/sre_parse.py", line 526, in _parse
source.tell() - here)
re.error: unterminated character set at position 5

06-Mar-2020 12:03:07 - INFO :: mylar.dbUpdate.352 : ThreadPoolExecutor-0_1 : Update complete
06-Mar-2020 12:08:08 - INFO :: mylar.dbUpdate.352 : ThreadPoolExecutor-0_2 : Update complete
06-Mar-2020 12:13:08 - INFO :: mylar.dbUpdate.352 : ThreadPoolExecutor-0_4 : Update complete
06-Mar-2020 12:18:08 - INFO :: mylar.dbUpdate.352 : ThreadPoolExecutor-0_0 : Update complete
06-Mar-2020 12:23:08 - INFO :: mylar.dbUpdate.352 : ThreadPoolExecutor-0_2 : Update complete
06-Mar-2020 12:28:08 - INFO :: mylar.dbUpdate.352 : ThreadPoolExecutor-0_7 : Update complete

Originally posted by @renhardy in #164 (comment)

Saving the comic library settings doesn't actually save. When you restart these fields are clear. Current workaround is to manually edit the .ini file and manually modify:

add_comics = False
comic_dir = None
imp_move = False
imp_paths = False
imp_rename = False
imp_metadata = False
imp_seriesfolders = True

Describe the bug
I have moved files into the appropriate directory, which Mylar created. I hit rescan, and it throws a permission error.

CarePackage
(removed)

Environment (please complete the following information):

• OS: Ubuntu 19.10
• Branch / commit: Version: d066c11 (python3-dev)

Additional information
n/a

As per @BenBeyond from mylar2's issue#2414:

I have 2 series that Mylar has marked the booktype as "Digital". They are Destiny, NY and Prison Witch. Issues are available on 32p but Mylar will not download them because the 32p issues are marked as "Issue" and not "Digital"...
2020-02-20 14:35:04 | DEBUG | Booktypes do not match. Looking for Digital, this is a issue. Ignoring this result.

It would be nice to be able to tell Mylar to ignore this booktype when searching and finding issues.

Also, what is an example of a series that has a "Digital" booktype on 32p?

For both of these series, there is no "printed" series to be found on CV, only "Digital". But the issues available on 32p are the exact same as what is shown on CV (based off of cover art, release date, and issues number.)
I understand that this might be an anomaly for the specific series that I am looking for, and that other digital series might not line up like that.

@evilhero: If you added the correct edition but it's being flagged wrong, you can force the edition to Print via the Edit Settings tab on that particular series detail page.

The setting quoted above is exactly what I am asking for, but I can't find it on the Edit Settings tab on these series... There is one to "Forcibly Mark series as TPB/GN", but the tooltip doesn't say anything about booktype or digital, so I didn't think that was it.

@evilhero: Also, if you're using Auth mode you can set the 32P ID on the Edit Settings tab in order to force Mylar to search only against that specific series ID.

I also did this for both series, but the booktype seems to override or ignore the 32p ID.

Describe the bug
Carepackage button broken, possibly only within windows?

CarePackage
haha. Nope.

http://localhost:8090/mylar/carepackage gives:

500 Internal Server Error
The server encountered an unexpected condition which prevented it from fulfilling the request.
Traceback (most recent call last):
File "c:\Python37\lib\site-packages\cherrypy_cprequest.py", line 638, in respond
self._do_respond(path_info)
File "c:\Python37\lib\site-packages\cherrypy_cprequest.py", line 697, in _do_respond
response.body = self.handler()
File "c:\Python37\lib\site-packages\cherrypy\lib\encoding.py", line 219, in call
self.body = self.oldhandler(*args, **kwargs)
File "c:\Python37\lib\site-packages\cherrypy_cpdispatch.py", line 54, in call
return self.callable(*self.args, **self.kwargs)
File "c:\ProgramData\mylar3\mylar\webserve.py", line 5606, in carepackage
from mylar.carepackage import carePackage
File "c:\ProgramData\mylar3\mylar\carepackage.py", line 213
if path.exists(self.lastrelpath)
^
TabError: inconsistent use of tabs and spaces in indentation
Powered by CherryPy 18.5.0

Log with debug enabled shows nothing for hitting the button and getting the error.

Environment (please complete the following information):

• OS: [e.g. Windows10]
• Branch / commit: Dev/build 9246809

Additional information
Ticket as per @barbequesauce request on irc.

There is no archive generated and downloaded by the browser.

The only log generated while replicating is when clicking on the gear icon to load /config:

Describe the request
When you run the carepackage option, it does not clean up the ~/logs directory

How did you come up with the idea?
having to manually clean-up the directory in questions

Environment (please complete the following information):

• OS: Ubuntu 19.10
• Branch / commit: Version: adc9bb5 (python3-dev)

Additional information
n/a

for large comic collections, this page doesnt load. Paging is required on this page to limit the number of records at a time. Filtering options would be great so you can find comics to import or pull back only comics that havent been imported yet (status).

In order to accommodate annuals being in a sub-folder within a given series directory, the $Annual variable needs to be included in the folder format string.

For post-processing, this would allow for new annuals to be automatically be added to an Annuals sub-folder if annual-integration is enabled and the folder format contains the $Annual field ($Publisher/$Series ($Year)/$Annual). If no annuals exist it should ignore the $Annual option and drop the item into the normal series directory as per normal post-processing rules.

Describe the bug
With some comics, it fails to extract the cover and resize it.

Screenshots/Logs
03-feb-2020 08:32:54 - INFO :: Thread-18 : getimage.py:extract_image:98 : cb_filename set to : Unholy 004 (2017) (ADULT) (Digital) (DR & Quinch-Empire)/
03-feb-2020 08:32:54 - WARNING :: Thread-18 : getimage.py:extract_image:114 : [WARNING] Unable to resize existing image: cannot identify image file <_io.BytesIO object at 0x00000140F5CFA360>
03-feb-2020 08:32:54 - INFO :: Thread-18 : notifiers.py:notify:362 : Telegram notify failed to decode image: Invalid base64-encoded string: number of data characters (49) cannot be 1 more than a multiple of 4

Environment (please complete the following information):

• OS: [e.g. Windows10] windows10
• Branch / commit: [e.g. Dev/38aksi1] current python3-dev version

Additional information
For example, this comic failed to extract the cover: https://www.dropbox.com/s/u4kbzd3ol5hnlav/UnHoly%20004%20%282017%29.cbz?dl=0