Comments (3)
Thanks Tony. Yes, we are aware of the lack of information on how to setup a cluster. We are in the process of providing the instructions/scripts for various scenarios. It will start with a cluster of windows domain joined machines, then we will also provide similar instructions/scripts for Azure.
from prajna.
Hello Weirong Zhu,
please, if you can , try to give us a simplified cluster setup like Spark standalone (described here)
http://spark.apache.org/docs/latest/spark-standalone.html
this way even solo/small developers can test Prajna in their free time at home on their own pc or group of pcs without having to use expensive server licenses or cloud subscription (with credit card => $$$), that's good for production but for just taking confidence with the suite something simple I believe would really help this new product to spread rapidly.
One more question, I'm just curious, Spark is known to be built on top of Akka with Scala, Prajna was written in F# (quite similar to scala). Did you use also an actor model framework like Akka? If yes what did you use? Thanks. Antonio
from prajna.
Hi antogh,
Currently, the deployment instruction we have is similar to Spark's standalone mode. Please check out https://github.com/MSRCCS/Prajna/wiki/Use-Prajna (also specifically for deployment: https://github.com/MSRCCS/Prajna/wiki/Deploy-Prajna). Please let us know if you hit any problems.
Regarding to questions on Prajna internals, please refer to http://msrccs.github.io/Prajna/paper/Prajna_v1.pdf for Prajna technical implementation details.
Thanks!
from prajna.
Related Issues (20)
- Add Documentation and FAQ HOT 1
- Support concurrent read from remote DSet HOT 1
- unittest under Linux
- DSet.fold zeroState is separate across node, but is shared within node.
- Environment.SystemDirectory get empty string under Linux/Mono
- Better error msg for authentication failure HOT 1
- Default Cache Memory Limit
- Cannot support PCL.
- When roughly a stable version will be released?
- Using DSet<bool> cause exception at Prajna.Core.MetaFunction`1.EncodeFunc HOT 2
- Enourmous memory usage on example with word counting HOT 1
- "Job fails as some source is not available" when invoking on cluster
- How to specify native dll and custom file to remote? HOT 1
- app.config is lost in remote HOT 3
- Question about the order in DSet sequence HOT 2
- executable not generated HOT 4
- Application hangs in cleanup HOT 25
- daemon doesn't work in remote machine HOT 2
- Is this project dead? HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from prajna.