Comments (1)
The root cause of this issue is, before monitor loop has to start, the monitor process has to perform the allocation of shared_memory . In the given example (with times 2.53 and 0.06) almost 2.5 seconds is spend in _allocate_shared_memory() function for the monitor process. Once the allocation is complete after a certain seconds(2.5 in our case) the monitor loop becomes ready to receive unidist operations. Once the monitor loop is up and running all the further puts with similar objects would take similar times.
The initial allocation of shared memory with MPI.Win.Allocate_shared
is not time taking. However in _allocate_shared_memory(self): function we are setting -1 to the service buffer because 0 is a valid value. This operation is a time consuming operation. I tried removing this line from unidist source and could see the time taken for the first put would decrease.
Have to figure out if there is a faster way to set the service buffer to all -1, or if this could be removed if this is not necessary.
from unidist.
Related Issues (20)
- Enabling Modin numpy API in HM slows down MPI backend
- `total.03-fe.04-attach_features.11-user-item volume features` stage of HM is 3x slower on MPI than on Ray
- Fix check for out of bounds reserved memory in shared storage
- `ValueError: Unknown DataID!` or `KeyError: <weakref at 0x000002432FB250E0; to 'MasterDataID' at 0x000002432F873F40>`
- Unidist on mpi fails on cluster when shared memory is turned off
- Unidist MPI backend fails on cluster for HM benchmark with `OverflowError` HOT 1
- send data across hosts by utlizing metadata for underlying buffers of an object
- Fix documentation build
- Make MPI shared object store default option
- Modin tests fail on latest unidist on MPI HOT 1
- Raise a warning if shared object storage is enabled but the MPI library does not support it.
- CI is not run on Windows
- [MPI] Fix Unidist crash on MS MPI when calling Split_type.
- Build unidist for different platforms
- [MPI] Fix MPICH version check
- Error : No module named 'psutil'
- Data shouldn't be mutable after putting into the shared object store
- Dead lock in unidist when 2 mutually dependent tasks are submitted to same worker.
- Modin's to_csv tests sometimes hang on MPI
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from unidist.