Comments (4)
What version of SBT are you using? (sbt -version)?
from high-performance-spark-examples.
➜ sbt about
[info] Loading project definition from /private/tmp/hello/project
[info] Set current project to Hello (in build file:/private/tmp/hello/)
[info] This is sbt 0.13.13
[info] The current project is {file:/private/tmp/hello/}root 0.1.0-SNAPSHOT
[info] The current project is built against Scala 2.12.1
[info] Available Plugins: sbt.plugins.IvyPlugin, sbt.plugins.JvmPlugin, sbt.plugins.CorePlugin, sbt.plugins.JUnitXmlReportPlugin, sbt.plugins.Giter8TemplatePlugin
[info] sbt, sbt plugins, and build definitions are using Scala 2.10.6
from high-performance-spark-examples.
^ that's from a different sbt project (it's the hello world example in the sbt getting started guide). running 'sbt -version' gives me this:
➜ sbt -version
[info] Loading project definition from /Users/adam/Documents/repos/oreilly/high-performance-spark-examples/project
[info] Set current project to examples (in build file:/Users/adam/Documents/repos/oreilly/high-performance-spark-examples/)
[warn] The `-` command is deprecated in favor of `onFailure` and will be removed in 0.14.0
from high-performance-spark-examples.
somehow I got it working...not totally sure what it was that made it work, but in the process I updated sbt to 0.13.15, deleted both ~/.sbt and ~/.ivy and refactored the assembly section in the build.sbt (which IntelliJ was throwing errors about) to match a newer template I found here: http://queirozf.com/entries/creating-scala-fat-jars-for-spark-on-sbt-with-sbt-assembly-plugin
from high-performance-spark-examples.
Related Issues (20)
- example 6-8 in SecondarySort.scala error
- QuantileOnlyArtisanalTest test("Secondary Sort") error
- The feedback on a code bug at /goldilocks/GoldilocksSecondarySort.scala
- [error] Server access Error: Connection refused (Connection refused) HOT 1
- Upgrade SparkR + enable CI
- Add a custom expression w/codegen
- Add a custom optimizer rule
- Upgrade to Spark 1.6 HOT 1
- Add examples for Spark accumulators
- Add dataset join examples HOT 2
- Add a selectExplode example for chapter 3 HOT 2
- Add a mapPartitions example to GenerateScalingData
- Port examples to Java HOT 1
- Port examples to Python
- Enable R tests
- Improve test coverage
- Failed to find a default value for inputCol
- Behavior of spark's predicate push down for Hbase backed Hive tables
- port to SBT 1.* HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from high-performance-spark-examples.