This fault tolerant task manager is supposed to crawl through webpages and gather more URI's and then put those extra URI into the servers to other clients continue the processing.
This project needs spread communication toolkit in order to work properly.
This toolkit is implemented in the following project: