Multithread architecture ? about pywb HOT 3 CLOSED

pywb runs in a WSGI server, and the default implementation that you get with the wayback app is currently just a single process as it uses the reference implementation.

For production use, I would recommend using the uWSGI server but there are others.

You can take a look at the run-uwsgi.sh. All the configuration options are in https://github.com/ikreymer/pywb/blob/master/uwsgi.ini

The processes section indicates how many parallel processes will run, it is set to 10 by default.

There are other WSGI containers and it is up to the user to decide which one is appropriate, and pywb should work with any standard container.
Here's a comprehensive list: http://wsgi.readthedocs.org/en/latest/servers.html

Though, it might make sense to add support for uwsgi or others to the basic wayback application, I will look at this in the next config update, or at least improve documentation regarding running in WSGI container.

from pywb.

Try running ./run-uwsgi.sh and see if that works for you. It'll need to install the uWSGI server the first time you run it as well and there may be additional dependencies. You can also try run-gunicorn.sh which has less dependencies and can also configure number of worker processes with the -w flag. (Currently set to 4 in the example).

from pywb.

The uWSGI is much better ! Thanks for the pointer. Now I just have to dig into its 839 configuration options.

from pywb.