Is it possible to set the Calculate Network Locations to parallel processing as well? about large-network-analysis-tools HOT 7 CLOSED

That you for this excellent suggestion. I don't know why I never thought of it myself!

Calculating locations can, indeed, be very slow, so I think parallelizing this process makes a lot of sense. I will have to ponder the best way to approach it since you can't write to the same geodatabase or feature class from multiple processes at the same time. I would have to store the location fields somewhere else and rejoin them, but that can be done.

I am adding this to my to-do list. However, I'm not sure when I can get to it, so you may have another couple of months of slow processing. I will update this issue when I have a solution.

from large-network-analysis-tools.

Thanks Melinda! Much appreciated.

from large-network-analysis-tools.

Hello @iamaflyingsquirrel. I spoke with the developer on my team who wrote the locating logic, and he expressed interest in learning more about your 13 million points. I'm curious as well! Would you be willing to tell us more about your analysis?

For the short term, parallelizing the call to Calculate Locations in this tool is definitely the way to go. For the long term, my team is interested in improving the efficiency of the locating logic under the hood to better account for clustered points and large datasets generally. Would it be possible for you to share an example of your 13m points with us? (We understand if not, if it's proprietary or confidential or whatever. You can also scrub out/delete any fields. We're mostly interested in the geographic distribution of the points.)

Thanks.

from large-network-analysis-tools.

PS. You can e-mail me privately at [email protected] if you don't want to post info for the whole world to see.

from large-network-analysis-tools.

Thanks Melinda, will send you an email!

from large-network-analysis-tools.

And done! Please pull the latest repo changes or download the latest release. It includes a new Parallel Calculate Locations tool if you want to just calculate your locations separately up front. Or, if you're running one of the other tools, and you tell it to precalculate network locations, it will use the parallelized logic. Please let me know how this works for you and if you have any problems with it. Thanks again for the great idea. Should have done this ages ago!

from large-network-analysis-tools.

Apparently I forgot to close this issue.

from large-network-analysis-tools.