worker job queuing might be inefficient about adaptivemd HOT 5 CLOSED

Correct, that was just a proof of concept and was legacy from using RP and is common for worker schemes, where connections might not be reliable. You want to make sure that you do not have dead times, so you prefetch tasks to keep running.

But I agree to set the default to 1.

from adaptivemd.

I think pre-fetching of jobs is only meaningful if we assume that the workers don't have continuous access to the database, so this is not the normal case.

In the case of database downtimes pre-fetching may help to keep the workers busy, but only if they don't crash at the end of the first job in case they are unable to reach the database (in order to communicate the results of the first job). Is this currently the case?

from adaptivemd.

In the case of database downtimes pre-fetching may help to keep the workers busy, but only if they don't crash at the end of the first job in case they are unable to reach the database (in order to communicate the results of the first job). Is this currently the case?

Right. In the case of our worker is practically does not make sense. To be compatible with RP we might need this anyway, but if you agree I will erase the option for the adaptivemdworker.

from adaptivemd.

I think this is a good solution for now.

from adaptivemd.

Done. After an update it should use prefetch=1

from adaptivemd.