Comments (1)
Hi @mvhulten, at the moment we have no plans for a dedicated InfiniBand hook.
I have limited experience with InfiniBand, but it should be possible to make IB-based networks work with the current MPI hook.
Taking as example an MPI hook configuration we have for a system at CSCS:
- ibverbs libraries (e.g.
/usr/lib64/libibverbs.so.1
and/usr/lib64/libibverbs/libmlx5-rdmav25.so
) should be added toMPI_DEPENDENCY_LIBS
; - the path for drivers config files (e.g.
/etc/libibverbs.d
) should be added toBIND_MOUNTS
; - InfiniBand devices (e.g.
/dev/infiniband/issm0
,/dev/infiniband/rdma_cm
,/dev/infiniband/umad0
, and/dev/infiniband/uverbs0
) should be added toBIND_MOUNTS
In case you would like the IB network to be exposed into any container, an alternative option could be to define ibverbs libraries and config directory as siteMounts and the IB devices as siteDevices.
I hope these tips are useful!
from sarus.
Related Issues (20)
- Pull non-latest tag HOT 2
- Issue when just appending flags for image with entrypoint set HOT 2
- Suggestion: documentation link at top of repo HOT 2
- Too many cpus requested HOT 2
- Going rootless
- Failed to retrieve username for uid=xxxxx HOT 5
- Help needed configuring oci nvidia hook HOT 3
- RDMA failed to open device HOT 2
- unable to build HOT 2
- Comparison to other tools like singularity HOT 4
- support for insecure registries HOT 3
- Error sending request to remote registry HOT 11
- home basedir hard-coded HOT 3
- Sarus spack recipe inside main Spack repo?
- Race condition with static auth.json filename HOT 2
- Cannot run an OCI image in Sarus HOT 9
- Why is sarus requiring root permissions for things that are outside of sarus? HOT 1
- Stopping Sarus containers HOT 1
- `sarus run` failing without a tag when latest is not available HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sarus.