Comments (2)
santoshkumarradha
commented on May 26, 2024
2
hey @arosen93 I think this is a neat feature.
IMO this does not seem like a lot of work, I think it should be as simple as abstracting https://github.com/AgnostiqHQ/covalent-slurm-plugin/blob/develop/covalent_slurm_plugin/slurm.py#L261C2-L266 asyncssh.connect , which returns a SSHClientConnection object and making it such that we have an local abstraction for this with a toggle switch inside the plugin kwargs.
from covalent-slurm-plugin.
Andrew-S-Rosen
commented on May 26, 2024
@santoshkumarradha: Do you know if there is a way to use asyncssh such that the connection object returned simply performs actions on the local machine? I had trouble finding something like that in the docs. If there's an easy way to return a connection object that will run locally, I'll happily test things out and submit a PR.
from covalent-slurm-plugin.
Related Issues (20)
- Add support for a certificate file to be passed to `asyncssh.connect()` HOT 1
- Support commands beyond the SLURM directive HOT 2
- Docs updates: Clarify remote dependencies (`cloudpickle`, `covalent`), Python version matching, and `parsable` flag
- `self._remote_func_filename` is not defined when a SLURM job hits the walltime
- Accurate time logging for queued jobs HOT 2
- Update PR template
- Allow for the creation of unique subfolders in the current working directory to avoid file overwriting
- Support for login without SSH key HOT 1
- SLURM job crashes if Conda is not installed HOT 1
- Add an option, `use_srun: bool`, that can run the Python function without `srun`
- Add support for dropped connections HOT 2
- Update to sshproxy instructions in README.md
- Allow certain exit codes at user's discretion HOT 6
- Slurm electrons fails when called within a Dask sublattice which itself is called in a Dask lattice. HOT 2
- Slurm sublattice fails with "username is a required parameter in the Slurm plugin." HOT 6
- Setting the executor in a `@ct.lattice` decorator does not use the right configuration parameters HOT 1
- Make it possible for users to pass optional kwargs to `asyncssh.connect()`
- Can not acquire file lock on Slurm cluster HOT 2
- Adding docker based functional tests to the pipeline
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from covalent-slurm-plugin.