Error when importing any of chemrxiv, biorxiv, medrxiv from paperscraper.get_dumps about paperscraper HOT 7 CLOSED

Hi @arifin-chemist89, thanks for reporting the issue. I believe the reason is an empty .jsonl file that is stored under paperscraper/server_dumps.
The file might be empty because the chemrxiv api is down (see #13).
The quick fix should be to delete the empty file.

from paperscraper.

Thanks for your quick response.
actually I could not find paperscraper/server_dumps directory. Furthermore, as I mentioned in edit1, I also got the same error even I am importing get_and_dump_arxiv_papers. Is the following line need to be done while dumping 'biorxiv', 'chemrxiv', 'medrxiv' db?

    path = sorted(dump_paths, reverse=True)[0]
    querier = XRXivQuery(path)
    QUERY_FN_DICT.update({db: querier.search_keywords})

from paperscraper.

Did you follow this instruction to download the dumps for chemrxiv, biorxiv and medrxiv before the error occurred for the first time? https://github.com/PhosphorylatedRabbits/paperscraper#download-x-rxiv-dumps

I can see from your error trace that your paperscraper is located in /.local/lib/python3.7/site-packages/paperscraper/.
Navigate there and go to paperscraper/server_dumps and I believe you will find an empty file from chemrxiv. Delete this file and restart your python shell this should do the quick fix

from paperscraper.

While I cant do much against the chemrxiv api being down, what definitely has to be improved is the error handling in the package. I will soon release a proper fix for this.

from paperscraper.

Issue should be fixed @arifin-chemist89
If you reinstall paperscraper, you should have version 0.1.1 which should run without this problem. Unfortunately, the chemrXiv API was shut down. See #16 and the Release notes

from paperscraper.

I am sorry for the unclear question. I think I can understand now. Anyway, thank you very much for your notice and quick bug fix. I will try to reinstall it and looking forward for chemrXiv API to go back in action again.

from paperscraper.

no worries, but there is simply no chemrxiv API anymore. Chemrxiv changed its host and the new host does not provide API access. See the README for details

from paperscraper.