Comments (8)
Sorry for the delay in documentation, --interp option has been removed as different main classes can be submitted for different extensions (which makes it redundant. I'll post a recommended profile shortly)
from ispark.
Plz check the updated example config file in readme:
import os
c = get_config()
SPARK_HOME = os.environ['SPARK_HOME']
# the above line can be replaced with: SPARK_HOME = '${INSERT_INSTALLATION_DIR_OF_SPARK}'
MASTER = '${INSERT_YOUR_SPARK_MASTER_URL}'
c.KernelManager.kernel_cmd = [SPARK_HOME+"/bin/spark-submit",
"--master", MASTER,
"--class", "org.tribbloid.ispark.Main",
"--executor-memory", "2G",
#(only enable this line if you have extra jars) "--jars", "${FULL_PATHS_OF_EXTRA_JARS}",
"${FULL_PATH_OF_MAIN_JAR}",
"--profile", "{connection_file}",
"--parent"]
c.NotebookApp.ip = '*' # only add this line if you want IPython-notebook being open to the public
c.NotebookApp.open_browser = False # only add this line if you want to suppress opening a browser after IPython-notebook initialization
c.NotebookApp.port = 8888
from ispark.
Ok, Thank you,:)
I want to know how config kernel_spec file in IPython3.0 Released.
from ispark.
Can you try the following spec first?
{
"display_name": "ISpark",
"language": "scala",
"argv": [
"/opt/spark/spark-1.2.1/bin/spark-submit",
"--master",
"local[*]",
"--class",
"org.tribbloid.ispark.Main",
"--executor-memory", "2G",
"/pathto/ispark-core-assembly-0.2.0-SNAPSHOT.jar",
"--profile",
"{connection_file}",
"--parent"
],
"codemirror_mode": "scala"
}
I tried IPy 3.0 before it's release, it works in most of the time but occasionally the kernel is out of synch. I'll try it again some da
from ispark.
Hi @Anne623, how is it working? Is it running smoothly?
from ispark.
Hi, @tribbloid , I have not check yet, I will feed back while I checked.
from ispark.
Hi, @tribbloid , I checked, it's working. Thank you. 👍 :)
from ispark.
@Anne623, Thanks a lot for verification! It really helps a lot of people about to convert to IPy3! (like me)
from ispark.
Related Issues (20)
- Unrecognized option error HOT 9
- Illegal character in path in ISpark jar file HOT 18
- ClassNotFoundException with class, defined in notebook HOT 3
- Autocomplete is not working HOT 6
- Shift + Tab operation not works in IPython 3.x HOT 5
- Scala syntax highlights in the ipython 3.1.0-cbccb68 HOT 6
- Printing variable value in notebook when I set value to a variable HOT 5
- Task not serializable error with HashingTF HOT 7
- Compare and contrast to spark-notebook and Zeppelin HOT 2
- No such method error
- Can't compile against 2.11 & 1.4.0 HOT 2
- Can not Completer in spark1.4.0
- port to jupyter-scala
- Kernel restart issue HOT 3
- Question about macro in JsonImpl
- Java Issue when run ipython HOT 5
- problem with private[spark] functions? HOT 7
- Updgrade to Spark 1.3.0 HOT 10
- Support running on yarn cluster HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ispark.