Multiprocessing RuntimeError about pyautolens HOT 13 OPEN

Hi Max. Could you try putting your code in a function or using if __name__ == "__main__"?

Something like:

if __name__ == "__main__":
    # your code goes here.

from pyautolens.

Yes, I’m going to try

from pyautolens.

It seems the fitting procedure has been started successfully, it's running. I've used
if name == "main":
# your code goes here.

from pyautolens.

from pyautolens.

Do you mean the module spawn.py?

from pyautolens.

@rhayes777 Any advise for how I should build this into example scripts to ensure it doesnt crop up again? Would be annoying to have extra lines of code (e.g. if name == "main") in every script.

from pyautolens.

I don't think there is anyway to avoid this exception on MacOS doing multiprocessing without that check. I'll have a dig just in case.

from pyautolens.

Hi, I’m afraid (though I’m not sure this is the true reason) there is some problem with the solution you have found.
In fact whenever I launch the script with that command you suggested, I’m leaved with tons of background python multiprocessing running process and this gives me an out of memory problem. I have to kill all of them manually. I repeat, I don’t know if the reason is that command, but I’ve never had this problem before.

from pyautolens.

@rhayes777 I think we need to stress-test parallelization of multiple PYthon versions (3.6 -> 3.9) and for different numpy / numba versions.

I suspect this issue hasnt cropped up before because I am used to using 3.6.

from pyautolens.

from pyautolens.

Files.zip

from pyautolens.

They are on numpy==1.21.5, and I think numpy threading could be the cause of this (Albeit it could be a separate issue with multiprocessing + dynesty).

from pyautolens.

Also on Linux (windows subsystem for linux techncially)

from pyautolens.