Comments (3)
Hi @tomjamescn, that's an interesting platform from Microsoft. Personally I haven't used it before but seems that it won't be too hard to create a backend to it. I check the document, it has APIs to submit a job, get job status, and start /stop job, which is exactly what's needed by fiber. Would you be interested to contribute a new OpenPai backend? You can follow this example https://github.com/uber/fiber/blob/master/fiber/kubernetes_backend.py . I can provide help along the way.
from fiber.
@calio thanks for your response, I have much interesting to contribute a openpai-backend, I would try.
I have a problem that how fiber deal with communication between master and worker process, I found no config about port for communication. As I know, I could give head and node the port config in Ray.
from fiber.
By default, Fiber master will pick a random port to listen and workers will connect to that port. See ipc_admin_master_port
in https://uber.github.io/fiber/config/. If there is a specific port you want to use, you can set ipc_admin_master_port
.
from fiber.
Related Issues (20)
- Passing multiple arguments to a method is failing HOT 3
- Docker Swarm support HOT 3
- pip install fiber error with Python 3.8 on macOS HOT 4
- A Few Issues found on Kubernetes HOT 5
- is it possible to run fiber on Yarn? HOT 2
- Add Python type hints to Fiber code base
- Installation issue with pip install fiber on Windows 10, Python 3.8, via conda HOT 2
- Is there any plan to extend fiber beyond aws/gcp Kubernetes clusters? HOT 4
- Add network to docker containers HOT 2
- Value Error (not enough values to unpack) in pool.py HOT 4
- urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded (Caused by NewConnectionErr or('<urllib3.connection.HTTPConnection object at 0x7fb3be7bca58>: Failed to establish a new connection: [Errno 111] Connection refused',)) HOT 2
- Page not found at docs HOT 1
- test failure on AArch64, Fedora 33 HOT 1
- Number of pending pool workers HOT 1
- Install Mac OS 11.3
- fiber.Pool runs tasks in serial in local mode
- connections error issue HOT 1
- Package still maintained? Alternatives? HOT 2
- How should an image in fiberconfig be specified for an ECR in AWS?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fiber.