Comments (7)
Hi,
I can't find any documentation on how to successfully parallelise jmetalpy. The closest thing I could find was this example here: https://jmetal.github.io/jMetalPy/api/algorithm/multiobjective/eas/nsgaii_distributed.html
But even running that exact code produces a stream of errors and doesn't actually work. I've attached a log of what happens. This is me running the program, letting it sit for a while with no seeming activity, then hitting Ctrl+C to kill it.
from jmetalpy.
Hello Dominik,
To be clear, which version of Dask are you using? In the examples folder you can find some examples about how to use PySpark and Dask to evaluate solutions in parallel, as well as a distributed version of the NSGA-II algorithm.
from jmetalpy.
Hi,
Thanks for the response! I have no idea how I got to that other version of the distributed algorithm, but using the links you provided produces a working example using ZDT1. Thanks for that!
I am, however, running a custom FloatProblem, and using it with the distributed NSGA-II algorithm gives me the following error:
4 cores available
Traceback (most recent call last):
File "main.py", line 69, in <module>
main()
File "main.py", line 57, in main
algorithm.run()
File "/home/dominik/.local/share/virtualenvs/multigroup-8rF_qus2/lib/python3.8/site-packages/jmetal/algorithm/multiobjective/nsgaii.py", line 267, in run
auxiliar_population = r.replace(auxiliar_population, offspring_population)
File "/home/dominik/.local/share/virtualenvs/multigroup-8rF_qus2/lib/python3.8/site-packages/jmetal/util/replacement.py", line 26, in replace
self.ranking.compute_ranking(join_population)
File "/home/dominik/.local/share/virtualenvs/multigroup-8rF_qus2/lib/python3.8/site-packages/jmetal/util/ranking.py", line 60, in compute_ranking
dominance_test_result = self.comparator.compare(solutions[p], solutions[q])
File "/home/dominik/.local/share/virtualenvs/multigroup-8rF_qus2/lib/python3.8/site-packages/jmetal/util/comparator.py", line 155, in compare
raise Exception("The solution1 is None")
Exception: The solution1 is None
Any idea as to what this might be? My custom problem inherits from FloatProblem and is only using custom init and evaluate methods. Is there anything else I need to implement to get it working in a distributed/parallel way? It works fine single-threaded.
from jmetalpy.
Hello,
I just tested the algorithm with a custom problem and it is working as expected. Can you send me an email (<antonio.benitez (at) lcc.uma.es>) with your problem implementation so I can test it on my machine? (if so, I will update this issue for future references once we find the root cause for raised exception).
Thank you!!
from jmetalpy.
Hi.
Does the error appear when using the sequential NSGA-II, or only when the distributed version is executed?
Antonio
from jmetalpy.
Hi,
With sequential NSGA-II it works fine.
I'm not sure I can send over my custom problem because it contains my company's IP. Would you be able to post the working problem that you used? Perhaps I can then work backwards to discover what the difference is and post a minimally reproducible example.
from jmetalpy.
DistributedNSGAII
works well for me with dask
. However, I was fully unaware of this possibility and had previously hacked my own solution to get jmetalpy
working with dask
.
I think it would be really useful to clarify in the documentation how the library can be used with dask
in a massive-parallel way.
from jmetalpy.
Related Issues (20)
- github pages offline
- Diversity indicators
- Are constraints strongly enforced? HOT 1
- Equality Constraints HOT 6
- TypeError in PolynomialMutation and SBXCrossover HOT 8
- SPXCrossover doesn't work with number of variables > 1 HOT 2
- Question about function evaluations HOT 1
- New termination criterion: early stopping based
- why you use random uniform like this in MixedIntegerFloatProblem HOT 1
- Help with getting a start
- Refactor class Problem
- Genetic algorithms cannot solve constrained problems
- OMOPSO with multi-process failed HOT 1
- Integer variables and SBXCrossover HOT 2
- Release 1.5.7 missing on pypi.org
- Mixed integer solving
- defining new problems HOT 2
- Combination of a routing an scheduling problem HOT 7
- Is it possible to use moead with 3 objectives in version 1.6.0? HOT 6
- crossover.py C2 becomes a complex number
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jmetalpy.