Fetch feeds in parallel about feed-to-sqlite HOT 5 OPEN

Possibly useful: pallets/click#85 (comment)

from feed-to-sqlite.

Thinking through this further, it would mean turning the whole thing async. Which is maybe worth trying, just for kicks.

from feed-to-sqlite.

Also possibly useful: https://github.com/encode/httpx

The sqlite work will probably have to be in a thread, or at the very end, since concurrent writes won't work.

from feed-to-sqlite.

Switched to HTTPX. Proper async report is likely dependent on upstream help here: simonw/sqlite-utils#242

from feed-to-sqlite.

Realizing I can probably do this without waiting on full async support from sqlite-utils. The key is making normalize an async function, and then using loop.run_in_executor.

from feed-to-sqlite.