scala / community-build Goto Github PK

Scala 2 community build — a corpus of open-source repos built against Scala nightlies

License: Apache License 2.0

Shell 100.00%

community-build's Introduction

Scala 2 Community Build

In this repository we build and test a large corpus of open-source Scala 2 projects. Everything is built from source using Lightbend's dbuild.

The project is financed and primarily maintained by Lightbend, as part of our overall maintenance of the Scala compiler and standard library.

How big is it? The 2.13 build contains over 2 million lines of Scala code from 250 repos, and it takes about 14 hours to run, as of September 2023.

Why do this? The main goal is to guard against regressions in new versions of Scala (language, standard library, and modules). This complements the regression test suite we maintain in scala/scala. It's also a service to the open source community, providing early notice of issues and incompatibilities.

Can I run it myself? Sure, just clone the repo and ./run.

Scala 3?

here: VirtusLab/community-build3

News

August 31, 2021: Scala 2.13 community build radically simplified
February 20, 2020: Scala 2 community build reaches goals
January 13, 2020: 2.13.x build gets big upgrade
October 17, 2019: Maintainability improvements made
August 4, 2019: Community build progress report
January 31, 2019: Community build progress report
January 18, 2019: Scala community build grows, adds Scala 2.13 and JDK 11
January 16, 2018: Community build grows to 141 projects, 2.8 million lines of code

Further documentation is in the wiki.

community-build's People

Contributors

Stargazers

Watchers

community-build's Issues

add MiMa

some notes on this at lightbend-labs/mima#94 (comment)

wip at https://github.com/SethTisue/community-builds/commits/add-mima but I got java.lang.OutOfMemoryError: PermGen space in https://scala-ci.typesafe.com/job/scala-2.11.x-integrate-community-build/131/consoleFull, sigh. (and again, so apparently not intermittent, either)

build circularly dependent Scala modules with fresh, not stock compiler?

as previously detailed at #142, dbuild's "assemble" builds Scala first, but then doesn't use the Scala it just built to build circularly dependent modules like scala-xml. this is arguably a bug, or at least not ideal, given that the whole idea of dbuild is to build everything using a freshly-built Scala compiler

dbuild builds Scala and its modules using the "assemble" build system. the doc on that build system says "the nested projects are built independently, each in isolation", which can be read as describing the behavior in this ticket as intentional. it's not trying and failing to override the module's Scala version — it isn't even trying.

add Akka HTTP and Akka Streams

we should do this because it's Akka, but also because ensime-server's master branch now has them as a dependency

I tried changing our dep to akka.git#releasing-akka-stream-and-http-experimental-1.0 but it didn't work and I decided to postpone rather than investigate. (for now we freeze ensime-server at the commit before the dependency was added)

(this was in the 2.11 build. it might be better to leave that one alone and only tackle Akka Streams in Java 8 world? dunno)

2.12.x: twitter-util fails to compile

not immediately clear if this is some kind of regression in 2.12, or somehow the result of a difference in the context of the community build itself between 2.11.x-jdk8 and 2.12.x... or what

https://scala-ci.typesafe.com/job/scala-2.12.x-integrate-community-build/201/consoleFull

2.11.x JDK6 and JDK8 builds interfere with each other

I thought this was happening before, and tried to fix it with 77f26d4, which I later reverted because I wasn't sure whether it had any effect and I became unsure whether the problem even existed.

I'm now absolutely 100% sure the problem exists. here's the smoking gun. in a 2.11.x-jdk8 run we see:

[scalatest] --== Building scalatest ==--
[scalatest] Found cached project build, uuid f1ba6a978aed6bad1b7b9e7e0c2d0e23d5030744
[scalatest] --== End Building scalatest ==--

but there is also a JDK6 2.11.x run where we see exactly the same thing in the log, with the same uuid. the two builds should definitely not be sharing any cached project builds at all.

the telltale symptom of the JDK6 build dipping into the JDK8 cache is an UnsupportedClassVersionError, e.g. java.lang.UnsupportedClassVersionError: org/scalatest/DoNotDiscover : Unsupported major.minor version 52.0.

(if the JDK8 build were to use the JDK6 cache, it would probably just work... probably!)

so I need to take a second stab at 77f26d4 or similar

ScalaJS broken in the 2.11.x community build since build 502 / Mar 29, 2015

https://jenkins-dbuild.typesafe.com:8499/job/Community-2.11.x/502

[scala-js] [warn] 59 warnings found
[scala-js] [info] Main Scala API documentation successful.
[scala-js] [info] Packaging /mnt/dbuild/jenkinsdbuild2/localhome-a7/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-3700267f500d7b7c607d6b595749c52787a06149/library/target/scala-2.11/scalajs-library-0.6.3-dbuildx3700267f500d7b7c607d6b595749c52787a06149-javadoc.jar ...
[scala-js] [info] Done packaging.
[scala-js] [warn] No main class detected
[scala-js] [info] Compiling 98 Scala sources to /mnt/dbuild/jenkinsdbuild2/localhome-a7/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-3700267f500d7b7c607d6b595749c52787a06149/javalib/target/scala-2.11/classes...
[scala-js] [info] Compiling 4 Scala sources to /mnt/dbuild/jenkinsdbuild2/localhome-a7/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-3700267f500d7b7c607d6b595749c52787a06149/library-aux/target/scala-2.11/classes...
[scala-js] [info] Compiling 35 Scala sources to /mnt/dbuild/jenkinsdbuild2/localhome-a7/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-3700267f500d7b7c607d6b595749c52787a06149/javalanglib/target/scala-2.11/classes...
[scala-js] [info] Compiling 542 Scala sources to /mnt/dbuild/jenkinsdbuild2/localhome-a7/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-3700267f500d7b7c607d6b595749c52787a06149/scalalib/target/scala-2.11/classes...
[scala-js] [error] error: Error: scalajs takes no options
[scala-js] [error] one error found
[scala-js] java.lang.RuntimeException: Nonzero exit code returned from runner: 1
[scala-js]  at scala.sys.package$.error(package.scala:27)
[scala-js]  at ExternalCompile$$anonfun$4$$anonfun$7$$anonfun$ExternalCompile$$anonfun$$anonfun$$doCompile$1$1.apply(ExternalCompile.scala:80)
[scala-js]  at ExternalCompile$$anonfun$4$$anonfun$7$$anonfun$ExternalCompile$$anonfun$$anonfun$$doCompile$1$1.apply(ExternalCompile.scala:80)
[scala-js]  at scala.Option.foreach(Option.scala:236)
[scala-js]  at ExternalCompile$$anonfun$4$$anonfun$7.ExternalCompile$$anonfun$$anonfun$$doCompile$1(ExternalCompile.scala:80)
[scala-js]  at ExternalCompile$$anonfun$4$$anonfun$7.apply(ExternalCompile.scala:93)
[scala-js]  at ExternalCompile$$anonfun$4$$anonfun$7.apply(ExternalCompile.scala:45)
[scala-js]  at sbt.FileFunction$$anonfun$cached$1.apply(Tracked.scala:186)
[scala-js]  at sbt.FileFunction$$anonfun$cached$1.apply(Tracked.scala:186)
[scala-js]  at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3$$anonfun$apply$4.apply(Tracked.scala:200)
[scala-js]  at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3$$anonfun$apply$4.apply(Tracked.scala:196)
[scala-js]  at sbt.Difference.apply(Tracked.scala:175)
[scala-js]  at sbt.Difference.apply(Tracked.scala:157)
[scala-js]  at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3.apply(Tracked.scala:196)
[scala-js]  at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3.apply(Tracked.scala:195)
[scala-js]  at sbt.Difference.apply(Tracked.scala:175)
[scala-js]  at sbt.Difference.apply(Tracked.scala:151)
[scala-js]  at sbt.FileFunction$$anonfun$cached$2.apply(Tracked.scala:195)
[scala-js]  at sbt.FileFunction$$anonfun$cached$2.apply(Tracked.scala:193)
[scala-js]  at ExternalCompile$$anonfun$4.apply(ExternalCompile.scala:100)
[scala-js]  at ExternalCompile$$anonfun$4.apply(ExternalCompile.scala:19)
[scala-js]  at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
[scala-js]  at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40)
[scala-js]  at sbt.std.Transform$$anon$4.work(System.scala:63)
[scala-js]  at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
[scala-js]  at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
[scala-js]  at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17)
[scala-js]  at sbt.Execute.work(Execute.scala:235)
[scala-js]  at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
[scala-js]  at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
[scala-js]  at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159)
[scala-js]  at sbt.CompletionService$$anon$2.call(CompletionService.scala:28)
[scala-js]  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[scala-js]  at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[scala-js]  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[scala-js]  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[scala-js]  at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[scala-js]  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[scala-js]  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[scala-js]  at java.lang.Thread.run(Thread.java:701)
[scala-js] [error] (scalalib/compile:compile) Nonzero exit code returned from runner: 1

/cc @sjrd

Upgrade to sbt 0.13.7

We're running on top of sbt 0.13.5 in the community build. It's getting outdated and causes issues like mentioned in #79. We should consider upgrading to 0.13.7 (latest sbt version at the time of creating this ticket).

real build is slow, testing fixes locally is slow too

slow in actual Jenkins runs:

we keep having to up the limit on how many hours the community builds are allowed to take. lately they've been in the ~8 hour range

slow during testing:

e.g. I'm trying to fix an issue in the scala-xml build. even if I delete all of common.conf and all of community.dbuild except for two projects only (scala and scala-xml), and even once the scala project has been built and cached, it still takes a long time (like 10+ minutes) for the scala-xml build to get going, which means my turnaround time for testing possible fixes precludes any kind of thinking/coding "flow"

most of the time is spent first resolving, then downloading the dependencies, not of scala-xml itself, but of its build definition. the list of jars needed is quite long, and most of them seem to be dependencies of dbuild itself — since one of the mechanisms by which dbuild operates is by injecting its own sbt plugin.

because dbuild sets up a special environment in which ivy.home and sbt.ivy.home are different, the needed JARs don't get cached in ~/.ivy2 like they would be in a normal build

and whatever magic dbuild does to make resolution fast during extraction (I confirmed by testing that extraction the 1st time is slow but subsequent extractions are very fast) isn't operable here, not sure why

make upstream dbuild friendly

following projects are known to need patches -- turn our repos into something we can submit as a PR:

improve documentation for library authors wanting to add their projects

@milessabin writes “I think it would be helpful if the community build README had some information for community library providers on how to keep the build up to date consistently with not breaking dependencies for other libraries ... I would have put a PR for this together myself a while back if I'd known what was involved."

@adriaanm writes “Seth is also working on better documentation for the community build, so that you can more easily contribute the configuration needed to include your project”

I did make a good start at this at https://github.com/scala/community-builds/wiki, but it still isn't really feasible for authors to do this themselves. Because #152, #162, #158, #133, ...

Document local Artifactory proxy usage

The first step of dbuild run is analysis of project dependencies. For that to complete, dependencies of each project need to be resolved through Ivy. It means we have to hit remote repositories a lot and it takes time. The workaround for slow Ivy resolution that Typesafe uses when running Jenkins jobs is going through a local repository proxy. We are using Artifactory for that.

We should cleanup repository defintions in our config files and document how to set up local Artifactory proxy so it's practical to run dbuild with community build config outside of Typesafe jenkins machine.

fix scala-xml related regression in 2.11.x-jdk8 build

recent 2.11.x-jdk8 builds are failing during Scaladoc generation with "java.lang.ClassNotFoundException: scala.runtime.java8.JFunction1" errors, with scala-xml in the stack traces (example)

it appears that in the context of the community build, the new crossScalaVersions logic in scala/scala-xml@38fbbbe results in scala-xml being built for 2.12.0-M2 instead of for 2.11.8 as intended. (I don't understand why the problem didn't manifest itself earlier, but maybe it did and I'm just forgetful/confused about it.)

I would expect dbuild to override a project's scalaVersion and crossScalaVersions stuff; not sure why that isn't happening here, but I assume it has to do with scala-xml being a scala module. there is a bunch of related-looking stuff in the dbuild manual about dbuild's cross-version setting.

Community buid fails due to unresolved dependency in Akka

[akka] --== Building akka ==--
[akka] Resolving: https://github.com/akka/akka.git#c73603f707882d1487a3ac2ca46c6b05c509af55 in directory: ./target-0.9.1/project-builds/akka-88f69abeeedd8ddfc21517246c15842a216cb458
[akka] Fetching https://github.com/akka/akka.git
[akka] into /localhome/jenkinsdbuild3/workspace/Community-2.11.x/target-0.9.1/clones/6a06c693d070a06224673b7e010e55b9d0ba80c2
[akka] Took: 00h 00m 02.0s
[akka] Cloning /localhome/jenkinsdbuild3/workspace/Community-2.11.x/target-0.9.1/clones/6a06c693d070a06224673b7e010e55b9d0ba80c2
[akka] to /localhome/jenkinsdbuild3/workspace/Community-2.11.x/target-0.9.1/project-builds/akka-88f69abeeedd8ddfc21517246c15842a216cb458
[akka] Took: 00h 00m 00.8s
[akka] Fetching /localhome/jenkinsdbuild3/workspace/Community-2.11.x/target-0.9.1/clones/6a06c693d070a06224673b7e010e55b9d0ba80c2
[akka] into /localhome/jenkinsdbuild3/workspace/Community-2.11.x/target-0.9.1/project-builds/akka-88f69abeeedd8ddfc21517246c15842a216cb458
[akka] Took: 00h 00m 04.2s
[akka] Resolving artifacts, level 0, space: default
[akka] Retrieved from project scala (commit: none): 13 artifacts

...

[akka] [info] Resolving org.scala-sbt#compiler-interface;0.13.5 ...
[akka] [info] Resolving org.scala-sbt#precompiled-2_8_2;0.13.5 ...
[akka] [info] Resolving org.scala-sbt#precompiled-2_9_2;0.13.5 ...
[akka] [info] Resolving org.scala-sbt#precompiled-2_9_3;0.13.5 ...
[akka] [info] Resolving org.scala-lang#jline;2.10.2 ...
[akka] [info] Resolving org.fusesource.jansi#jansi;1.4 ...
[akka] [info] downloading https://a7.typesafe.com:8082/artifactory/repo/org/scala-lang/scala-compiler/2.10.2/scala-compiler-2.10.2.jar ...
[akka] [info]   [SUCCESSFUL ] org.scala-lang#scala-compiler;2.10.2!scala-compiler.jar (401ms)
[akka] [info] downloading https://a7.typesafe.com:8082/artifactory/repo/org/scala-lang/jline/2.10.2/jline-2.10.2.jar ...
[akka] [info]   [SUCCESSFUL ] org.scala-lang#jline;2.10.2!jline.jar (19ms)
[akka] [warn]   ::::::::::::::::::::::::::::::::::::::::::::::
[akka] [warn]   ::          UNRESOLVED DEPENDENCIES         ::
[akka] [warn]   ::::::::::::::::::::::::::::::::::::::::::::::
[akka] [warn]   :: org.scala-lang#scala-library;2.10.4-dbuildx02077049a08aeb2751a9a426dc8c29feded3d129: not found
[akka] [warn]   ::::::::::::::::::::::::::::::::::::::::::::::

I suspect this failure is caused by adding dependency on jmh sbt plugin: https://github.com/akka/akka/pull/16373/files#diff-a84f91f20f040218bccd09fed4761fb3R26

//cc @ktoso

Resolve exception: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1

Just cloning and running:

./community-2.11.x.sh

the whole thing fails horribly because it cannot resolve com.typesafe.dbuild#distributed-sbt-plugin;0.9.1.

Full spam:

doeraene@lamppc37:~/projects/community-builds$ ./community-2.12.x.sh 
dbuild version: 0.9.1
dbuild config: community-2.11.x.dbuild
dbuild-0.9.1/bin/dbuild -Dvars.scala-ref=scala/scala.git#2.12.x community-2.11.x.dbuild
[warn] WARNING: This directory is not in use: /localhome/doeraene/projects/community-builds/target-0.9.0
[parboiled] --== Extracting dependencies for parboiled ==--
[parboiled] Fetching https://github.com/sirthias/parboiled.git
[parboiled] into /localhome/doeraene/projects/community-builds/target-0.9.1/clones/7482dc5d02a63db0cb750bb226aa6ec0e1599238
[parboiled:error] WARNING: gnome-keyring:: couldn't connect to: /tmp/keyring-xJfGTo/pkcs11: No such file or directory
[parboiled] Took: 00h 00m 00.7s
[parboiled] Fetching /localhome/doeraene/projects/community-builds/target-0.9.1/clones/7482dc5d02a63db0cb750bb226aa6ec0e1599238
[parboiled] into /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/4248698ed520451e797163df6d369b3753e4f7bc
[parboiled] Took: 00h 00m 00.0s
[parboiled] Extracting dependencies for: parboiled
[parboiled] Using Scala 2.11.2 during extraction.
[parboiled] Using sbt version: 0.13.5
[parboiled] [info] Loading project definition from /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/4248698ed520451e797163df6d369b3753e4f7bc/project/project
[parboiled] [info] Updating {file:/localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/4248698ed520451e797163df6d369b3753e4f7bc/project/project/}root-4248698ed520451e797163df6d369b3753e4f7bc-build-build...
[parboiled] [warn] Host a7.typesafe.com not found. url=https://a7.typesafe.com:8082/artifactory/repo/com/typesafe/dbuild/distributed-sbt-plugin_2.10_0.13/0.9.1/distributed-sbt-plugin-0.9.1.pom
[parboiled] [info] You probably access the destination server through a proxy server that is not well configured.
[parboiled] [warn] Host a7.typesafe.com not found. url=https://a7.typesafe.com:8082/artifactory/repo/com.typesafe.dbuild/distributed-sbt-plugin/scala_2.10/sbt_0.13/0.9.1/ivys/ivy.xml
[parboiled] [info] You probably access the destination server through a proxy server that is not well configured.
[parboiled] [warn]      module not found: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1
[parboiled] [warn] ==== local: tried
[parboiled] [warn]   /home/doeraene/.ivy2/local/com.typesafe.dbuild/distributed-sbt-plugin/scala_2.10/sbt_0.13/0.9.1/ivys/ivy.xml
[parboiled] [warn] ==== a7-maven: tried
[parboiled] [warn]   https://a7.typesafe.com:8082/artifactory/repo/com/typesafe/dbuild/distributed-sbt-plugin_2.10_0.13/0.9.1/distributed-sbt-plugin-0.9.1.pom
[parboiled] [warn] ==== a7-ivy: tried
[parboiled] [warn]   https://a7.typesafe.com:8082/artifactory/repo/com.typesafe.dbuild/distributed-sbt-plugin/scala_2.10/sbt_0.13/0.9.1/ivys/ivy.xml
[parboiled] [warn]      ::::::::::::::::::::::::::::::::::::::::::::::
[parboiled] [warn]      ::          UNRESOLVED DEPENDENCIES         ::
[parboiled] [warn]      ::::::::::::::::::::::::::::::::::::::::::::::
[parboiled] [warn]      :: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1: not found
[parboiled] [warn]      ::::::::::::::::::::::::::::::::::::::::::::::
[parboiled] [warn] 
[parboiled] [warn]      Note: Some unresolved dependencies have extra attributes.  Check that these dependencies exist with the requested attributes.
[parboiled] [warn]              com.typesafe.dbuild:distributed-sbt-plugin:0.9.1 (sbtVersion=0.13, scalaVersion=2.10)
[parboiled] [warn] 
[parboiled] sbt.ResolveException: unresolved dependency: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1: not found
[parboiled]     at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:217)
[parboiled]     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:126)
[parboiled]     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:125)
[parboiled]     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:115)
[parboiled]     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:115)
[parboiled]     at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:103)
[parboiled]     at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:48)
[parboiled]     at sbt.IvySbt$$anon$3.call(Ivy.scala:57)
[parboiled]     at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:98)
[parboiled]     at xsbt.boot.Locks$GlobalLock.xsbt$boot$Locks$GlobalLock$$withChannelRetries$1(Locks.scala:81)
[parboiled]     at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:102)
[parboiled]     at xsbt.boot.Using$.withResource(Using.scala:11)
[parboiled]     at xsbt.boot.Using$.apply(Using.scala:10)
[parboiled]     at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:62)
[parboiled]     at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:52)
[parboiled]     at xsbt.boot.Locks$.apply0(Locks.scala:31)
[parboiled]     at xsbt.boot.Locks$.apply(Locks.scala:28)
[parboiled]     at sbt.IvySbt.withDefaultLogger(Ivy.scala:57)
[parboiled]     at sbt.IvySbt.withIvy(Ivy.scala:98)
[parboiled]     at sbt.IvySbt.withIvy(Ivy.scala:94)
[parboiled]     at sbt.IvySbt$Module.withModule(Ivy.scala:115)
[parboiled]     at sbt.IvyActions$.update(IvyActions.scala:125)
[parboiled]     at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1223)
[parboiled]     at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1221)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$74.apply(Defaults.scala:1244)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$74.apply(Defaults.scala:1242)
[parboiled]     at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1246)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1241)
[parboiled]     at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
[parboiled]     at sbt.Classpaths$.cachedUpdate(Defaults.scala:1249)
[parboiled]     at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1214)
[parboiled]     at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1192)
[parboiled]     at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
[parboiled]     at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:42)
[parboiled]     at sbt.std.Transform$$anon$4.work(System.scala:64)
[parboiled]     at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:237)
[parboiled]     at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:237)
[parboiled]     at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
[parboiled]     at sbt.Execute.work(Execute.scala:244)
[parboiled]     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:237)
[parboiled]     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:237)
[parboiled]     at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
[parboiled]     at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
[parboiled]     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[parboiled]     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[parboiled]     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[parboiled]     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[parboiled]     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[parboiled]     at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[parboiled]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[parboiled]     at java.lang.Thread.run(Thread.java:662)
[parboiled] [error] (*:update) sbt.ResolveException: unresolved dependency: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1: not found
[parboiled] Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? 
[parboiled:error] java.lang.RuntimeException: 
[parboiled:error]       at scala.sys.package$.error(package.scala:27)
[parboiled:error]       at distributed.support.sbt.SbtRunner.distributed$support$sbt$SbtRunner$$processCommand(SbtRunner.scala:93)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:74)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:64)
[parboiled:error]       at sbt.IO$.withTemporaryFile(IO.scala:311)
[parboiled:error]       at distributed.support.sbt.SbtRunner.run(SbtRunner.scala:64)
[parboiled:error]       at distributed.support.sbt.SbtExtractor$.extractMetaData(DependencyExtractor.scala:99)
[parboiled:error]       at distributed.support.sbt.SbtBuildSystem.extractDependencies(SbtBuildSystem.scala:58)
[parboiled:error]       at distributed.support.sbt.SbtBuildSystem.extractDependencies(SbtBuildSystem.scala:18)
[parboiled] --== End Extracting dependencies for parboiled ==--
[json4s] --== Extracting dependencies for json4s ==--
[json4s] Fetching https://github.com/json4s/json4s.git
[json4s] into /localhome/doeraene/projects/community-builds/target-0.9.1/clones/6fc07108d250f5a661c5b4e8f566d85dbf02473c
[json4s:error] WARNING: gnome-keyring:: couldn't connect to: /tmp/keyring-xJfGTo/pkcs11: No such file or directory
[json4s] Took: 00h 00m 00.7s
[json4s] Fetching /localhome/doeraene/projects/community-builds/target-0.9.1/clones/6fc07108d250f5a661c5b4e8f566d85dbf02473c
[json4s] into /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/df9e16a67a2695a1e7113e84ba09c73342f316f2
[json4s] Took: 00h 00m 00.0s
[json4s] Extracting dependencies for: json4s
[json4s] Using Scala 2.11.2 during extraction.
[json4s] Using sbt version: 0.13.5
^Cdoeraene@lamppc37:~/projects/community-builds$ community-2.11.x.sh dbuild version: 0.9.1
dbuild config: community-2.11.x.dbuild
dbuild-0.9.1/bin/dbuild community-2.11.x.dbuild
[warn] WARNING: This directory is not in use: /localhome/doeraene/projects/community-builds/target-0.9.0
[parboiled] --== Extracting dependencies for parboiled ==--
[parboiled] Fetching https://github.com/sirthias/parboiled.git
[parboiled] into /localhome/doeraene/projects/community-builds/target-0.9.1/clones/7482dc5d02a63db0cb750bb226aa6ec0e1599238
[parboiled:error] WARNING: gnome-keyring:: couldn't connect to: /tmp/keyring-xJfGTo/pkcs11: No such file or directory
[parboiled] Took: 00h 00m 00.7s
[parboiled] Fetching /localhome/doeraene/projects/community-builds/target-0.9.1/clones/7482dc5d02a63db0cb750bb226aa6ec0e1599238
[parboiled] into /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/4248698ed520451e797163df6d369b3753e4f7bc
[parboiled] Took: 00h 00m 00.0s
[parboiled] Extracting dependencies for: parboiled
[parboiled] Using Scala 2.11.2 during extraction.
[parboiled] Using sbt version: 0.13.5
[parboiled] [info] Loading project definition from /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/4248698ed520451e797163df6d369b3753e4f7bc/project/project
[parboiled] [info] Updating {file:/localhome/doeraene/projects/community-builds/target-0.9.1/extraction/448fbc5099967acbff6fff182a613a3cb8c038f6/projects/4248698ed520451e797163df6d369b3753e4f7bc/project/project/}root-4248698ed520451e797163df6d369b3753e4f7bc-build-build...
[parboiled] [warn] Host a7.typesafe.com not found. url=https://a7.typesafe.com:8082/artifactory/repo/com/typesafe/dbuild/distributed-sbt-plugin_2.10_0.13/0.9.1/distributed-sbt-plugin-0.9.1.pom
[parboiled] [info] You probably access the destination server through a proxy server that is not well configured.
[parboiled] [warn] Host a7.typesafe.com not found. url=https://a7.typesafe.com:8082/artifactory/repo/com.typesafe.dbuild/distributed-sbt-plugin/scala_2.10/sbt_0.13/0.9.1/ivys/ivy.xml
[parboiled] [info] You probably access the destination server through a proxy server that is not well configured.
[parboiled] [warn]      module not found: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1
[parboiled] [warn] ==== local: tried
[parboiled] [warn]   /home/doeraene/.ivy2/local/com.typesafe.dbuild/distributed-sbt-plugin/scala_2.10/sbt_0.13/0.9.1/ivys/ivy.xml
[parboiled] [warn] ==== a7-maven: tried
[parboiled] [warn]   https://a7.typesafe.com:8082/artifactory/repo/com/typesafe/dbuild/distributed-sbt-plugin_2.10_0.13/0.9.1/distributed-sbt-plugin-0.9.1.pom
[parboiled] [warn] ==== a7-ivy: tried
[parboiled] [warn]   https://a7.typesafe.com:8082/artifactory/repo/com.typesafe.dbuild/distributed-sbt-plugin/scala_2.10/sbt_0.13/0.9.1/ivys/ivy.xml
[parboiled] [warn]      ::::::::::::::::::::::::::::::::::::::::::::::
[parboiled] [warn]      ::          UNRESOLVED DEPENDENCIES         ::
[parboiled] [warn]      ::::::::::::::::::::::::::::::::::::::::::::::
[parboiled] [warn]      :: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1: not found
[parboiled] [warn]      ::::::::::::::::::::::::::::::::::::::::::::::
[parboiled] [warn] 
[parboiled] [warn]      Note: Some unresolved dependencies have extra attributes.  Check that these dependencies exist with the requested attributes.
[parboiled] [warn]              com.typesafe.dbuild:distributed-sbt-plugin:0.9.1 (sbtVersion=0.13, scalaVersion=2.10)
[parboiled] [warn] 
[parboiled] sbt.ResolveException: unresolved dependency: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1: not found
[parboiled]     at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:217)
[parboiled]     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:126)
[parboiled]     at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:125)
[parboiled]     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:115)
[parboiled]     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:115)
[parboiled]     at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:103)
[parboiled]     at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:48)
[parboiled]     at sbt.IvySbt$$anon$3.call(Ivy.scala:57)
[parboiled]     at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:98)
[parboiled]     at xsbt.boot.Locks$GlobalLock.xsbt$boot$Locks$GlobalLock$$withChannelRetries$1(Locks.scala:81)
[parboiled]     at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:102)
[parboiled]     at xsbt.boot.Using$.withResource(Using.scala:11)
[parboiled]     at xsbt.boot.Using$.apply(Using.scala:10)
[parboiled]     at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:62)
[parboiled]     at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:52)
[parboiled]     at xsbt.boot.Locks$.apply0(Locks.scala:31)
[parboiled]     at xsbt.boot.Locks$.apply(Locks.scala:28)
[parboiled]     at sbt.IvySbt.withDefaultLogger(Ivy.scala:57)
[parboiled]     at sbt.IvySbt.withIvy(Ivy.scala:98)
[parboiled]     at sbt.IvySbt.withIvy(Ivy.scala:94)
[parboiled]     at sbt.IvySbt$Module.withModule(Ivy.scala:115)
[parboiled]     at sbt.IvyActions$.update(IvyActions.scala:125)
[parboiled]     at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1223)
[parboiled]     at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1221)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$74.apply(Defaults.scala:1244)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$74.apply(Defaults.scala:1242)
[parboiled]     at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1246)
[parboiled]     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1241)
[parboiled]     at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
[parboiled]     at sbt.Classpaths$.cachedUpdate(Defaults.scala:1249)
[parboiled]     at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1214)
[parboiled]     at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1192)
[parboiled]     at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
[parboiled]     at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:42)
[parboiled]     at sbt.std.Transform$$anon$4.work(System.scala:64)
[parboiled]     at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:237)
[parboiled]     at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:237)
[parboiled]     at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
[parboiled]     at sbt.Execute.work(Execute.scala:244)
[parboiled]     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:237)
[parboiled]     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:237)
[parboiled]     at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
[parboiled]     at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
[parboiled]     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[parboiled]     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[parboiled]     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[parboiled]     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[parboiled]     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[parboiled]     at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[parboiled]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[parboiled]     at java.lang.Thread.run(Thread.java:662)
[parboiled] [error] (*:update) sbt.ResolveException: unresolved dependency: com.typesafe.dbuild#distributed-sbt-plugin;0.9.1: not found
[parboiled] Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? 
[parboiled:error] java.lang.RuntimeException: 
[parboiled:error]       at scala.sys.package$.error(package.scala:27)
[parboiled:error]       at distributed.support.sbt.SbtRunner.distributed$support$sbt$SbtRunner$$processCommand(SbtRunner.scala:93)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:74)
[parboiled:error]       at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:64)
[parboiled:error]       at sbt.IO$.withTemporaryFile(IO.scala:311)
[parboiled:error]       at distributed.support.sbt.SbtRunner.run(SbtRunner.scala:64)
[parboiled:error]       at distributed.support.sbt.SbtExtractor$.extractMetaData(DependencyExtractor.scala:99)
[parboiled:error]       at distributed.support.sbt.SbtBuildSystem.extractDependencies(SbtBuildSystem.scala:58)
[parboiled:error]       at distributed.support.sbt.SbtBuildSystem.extractDependencies(SbtBuildSystem.scala:18)
[parboiled] --== End Extracting dependencies for parboiled ==--

and it goes on...

add scalaz-stream so we can track specs2

for a while now (since #44) the community build has been pegged to an older rev of specs2 from before the scalaz-stream dependency was introduced. we shouldn't leave it that way too long; specs2 is too important. and scalaz-stream is likely to to start turning up in other places too.

@retronym doesn't think adding scalaz-stream to the build was actually attempted previously, so maybe we'll be lucky and discover it's easy.

track scalatest

now at "scalatest/scalatest.git#scala-2.11-M8", not sure which branch we should track

track scalacheck

Currently at "rickynils/scalacheck.git#1.11.1", but master should be fine

add more projects

(I edit this list frequently. except when I forget to update it at all.)

projects we'd like to include:

high priority:
- Spark #763 — volunteers needed
- (nothing else right now?)
would be nice:
- scastie (not a lib, but good to have some apps)
- Play sample repos (we do have play-webgoat)
- macwire
- hamsters
- squants (PR)
- algebird
- thyme
- metal
- scalatra
- finagle
- ammonite (problematic because it's built with mill now, not sbt; someone would need to make a minimal sbt build; or perhaps someday dbuild will support mill)

what won't we add? important to ecosystem but probably out of scope here: Dotty, IntelliJ, Scala Native, cbt (builds itself, not built by sbt), mill (ditto, they have an sbt build at the moment but plan to eliminate it), all sbt plugins (there could be a separate build for that), ...

unfork scalariform

Adriaan forked to disable sbt-eclipse-plugin, but that probably doesn't matter anymore.

but, scalariform is still on ScalaTest 2.1, and we would like to be on ScalaTest 2.2 (#14). perhaps Daniel will voluntarily take care of it: daniel-trinh/scalariform#87

unfork specs2 in 2.12 build

  specs2-3-ref                 : "adriaanm/specs2.git#community-build-3.6"
    // "etorreborre/specs2.git#SPECS2-3.6.2"
  specs2-2-ref                 : "adriaanm/specs2.git#community-build-2.4"
    // "etorreborre/specs2.git#SPECS2-2.4.17"

maybe also see whether it's really necessary to have two specs2 versions. maybe now that we have everything on Shapeless 2.2.x, it isn't necessary? the spaces stuff necessary to have two different specs2 versions substantially complicates the build. also, it seems like that kind of thing shouldn't even be necessary given that specs2 is just a test dependency of stuff, not a runtime dependency. sigh

need better documentation on doing local runs

(accumulated random notes on this from the last few months)

though it may not even be worth documenting this better until something is done about the performance issues (its's #152)

I guess setting up local Artifactory helps performance; I haven't tried it yet. there is doc linked from #58

often, running dbuild with -d is key in order to see what's going on (I mean if it's the community build itself you're troubleshooting, and not a compiler bug)

document how to fix the scala version at a given SHA, to prevent global rebuilds when someone merges a Scala PR? the Jenkins jobs for community builds have a field for this, not sure how it's done locally.

how to run just one project? e.g. ./dbuild-0.9.1/bin/dbuild -n community.dbuild sbinary works, sort of, but does bypassing the usual scripts/jobs/integrate/community-build method still get you the right resolvers? need to double check what value the scripts directory script adds

also building just one project doesn't really save you that much time since all projects are still extracted which takes a while. I've been working around this by commenting out big swathes of common.conf and/or community.dbuild

scala-js failure since May 20, 2015

https://jenkins-dbuild.typesafe.com:8499/view/Shared/job/Community-2.11.x/554/consoleFull

[scala-js] Testing: jasmineTestFramework
[scala-js] org.mozilla.javascript.EcmaError: ReferenceError: "x" is not defined. (s_Array$.sjsir#78)
[scala-js]  at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3701)
[scala-js]  at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3679)
[scala-js]  at org.mozilla.javascript.ScriptRuntime.notFoundError(ScriptRuntime.java:3764)
[scala-js]  at org.mozilla.javascript.ScriptRuntime.nameOrFunction(ScriptRuntime.java:1805)
[scala-js]  at org.mozilla.javascript.ScriptRuntime.name(ScriptRuntime.java:1744)
[scala-js]  at org.mozilla.javascript.gen.s_Array__sjsir_295._c_anonymous_17(s_Array$.sjsir:78)
[scala-js]  at org.mozilla.javascript.gen.s_Array__sjsir_295.call(s_Array$.sjsir)
[scala-js]  at org.mozilla.javascript.optimizer.OptRuntime.call2(OptRuntime.java:42)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_jasminetest_JasmineFramework_sjsir_31._c_anonymous_6(Lorg_scalajs_jasminetest_JasmineFramework.sjsir:28)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_jasminetest_JasmineFramework_sjsir_31.call(Lorg_scalajs_jasminetest_JasmineFramework.sjsir)
[scala-js]  at org.mozilla.javascript.optimizer.OptRuntime.callProp0(OptRuntime.java:85)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26._c_anonymous_6(Lorg_scalajs_testinterface_internal_InfoSender.sjsir:25)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26.call(Lorg_scalajs_testinterface_internal_InfoSender.sjsir)
[scala-js]  at org.mozilla.javascript.optimizer.OptRuntime.callProp0(OptRuntime.java:85)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26._c_anonymous_3(Lorg_scalajs_testinterface_internal_InfoSender.sjsir:20)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26.call(Lorg_scalajs_testinterface_internal_InfoSender.sjsir)
[scala-js]  at org.mozilla.javascript.optimizer.OptRuntime.callProp0(OptRuntime.java:85)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26._c_anonymous_9(Lorg_scalajs_testinterface_internal_InfoSender.sjsir:38)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26.call(Lorg_scalajs_testinterface_internal_InfoSender.sjsir)
[scala-js]  at org.mozilla.javascript.optimizer.OptRuntime.callProp0(OptRuntime.java:85)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26._c_anonymous_14(Lorg_scalajs_testinterface_internal_InfoSender.sjsir:55)
[scala-js]  at org.mozilla.javascript.gen.Lorg_scalajs_testinterface_internal_InfoSender_sjsir_26.call(Lorg_scalajs_testinterface_internal_InfoSender.sjsir)
[scala-js]  at org.mozilla.javascript.optimizer.OptRuntime.callProp0(OptRuntime.java:85)
[scala-js]  at org.mozilla.javascript.gen.testFrameworkInfo_js_33._c_script_0(testFrameworkInfo.js:2)
[scala-js]  at org.mozilla.javascript.gen.testFrameworkInfo_js_33.call(testFrameworkInfo.js)
[scala-js]  at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:394)
[scala-js]  at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3102)
[scala-js]  at org.mozilla.javascript.gen.testFrameworkInfo_js_33.call(testFrameworkInfo.js)
[scala-js]  at org.mozilla.javascript.gen.testFrameworkInfo_js_33.exec(testFrameworkInfo.js)
[scala-js]  at org.mozilla.javascript.Context.evaluateString(Context.java:1078)
[scala-js]  at org.scalajs.jsenv.rhino.package$ContextOps$.evaluateFile$extension(package.scala:21)
[scala-js]  at org.scalajs.jsenv.rhino.RhinoJSEnv.org$scalajs$jsenv$rhino$RhinoJSEnv$$internalRunJS(RhinoJSEnv.scala:152)
[scala-js]  at org.scalajs.jsenv.rhino.RhinoJSEnv$AsyncRunner$$anon$1.run(RhinoJSEnv.scala:76)
[scala-js] java.lang.RuntimeException: Exception while running JS code: ReferenceError: "x" is not defined. (s_Array$.sjsir#78)
[scala-js]  at scala.sys.package$.error(package.scala:27)
[scala-js]  at org.scalajs.jsenv.rhino.RhinoJSEnv.org$scalajs$jsenv$rhino$RhinoJSEnv$$internalRunJS(RhinoJSEnv.scala:168)
[scala-js]  at org.scalajs.jsenv.rhino.RhinoJSEnv$AsyncRunner$$anon$1.run(RhinoJSEnv.scala:76)
[scala-js] [error] (jasmineTestFramework/test:loadedTestFrameworks) Exception while running JS code: ReferenceError: "x" is not defined. (s_Array$.sjsir#78)
[scala-js:error] Incomplete(node=Some(ScopedKey(Scope(Select(ProjectRef(file:/mnt/dbuild/jenkinsdbuild3/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-e4b1c28b19a5e8e22dc4dee7106f8e3034da47a4/,jasmineTestFramework)),Select(ConfigKey(test)),Global,Global),test)), tpe=Error, msg=None, causes=List(Incomplete(node=Some(ScopedKey(Scope(Select(ProjectRef(file:/mnt/dbuild/jenkinsdbuild3/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-e4b1c28b19a5e8e22dc4dee7106f8e3034da47a4/,jasmineTestFramework)),Select(ConfigKey(test)),Global,Global),executeTests)), tpe=Error, msg=None, causes=List(Incomplete(node=Some(ScopedKey(Scope(Select(ProjectRef(file:/mnt/dbuild/jenkinsdbuild3/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-e4b1c28b19a5e8e22dc4dee7106f8e3034da47a4/,jasmineTestFramework)),Select(ConfigKey(test)),Global,Global),loadedTestFrameworks)), tpe=Error, msg=None, causes=List(), directCause=Some(java.lang.RuntimeException: Exception while running JS code: ReferenceError: "x" is not defined. (s_Array$.sjsir#78))), Incomplete(node=Some(ScopedKey(Scope(Global,Global,Global,Global),testGrouping)), tpe=Error, msg=None, causes=List(Incomplete(node=Some(ScopedKey(Scope(Select(ProjectRef(file:/mnt/dbuild/jenkinsdbuild3/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-e4b1c28b19a5e8e22dc4dee7106f8e3034da47a4/,jasmineTestFramework)),Select(ConfigKey(test)),Global,Global),definedTests)), tpe=Error, msg=None, causes=List(Incomplete(node=Some(ScopedKey(Scope(Select(ProjectRef(file:/mnt/dbuild/jenkinsdbuild3/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/scala-js-e4b1c28b19a5e8e22dc4dee7106f8e3034da47a4/,jasmineTestFramework)),Select(ConfigKey(test)),Global,Global),loadedTestFrameworks)), tpe=Error, msg=None, causes=List(), directCause=Some(java.lang.RuntimeException: Exception while running JS code: ReferenceError: "x" is not defined. (s_Array$.sjsir#78)))), directCause=None)), directCause=None)), directCause=None)), directCause=None)
[scala-js:error]    at sbt.Incomplete.copy(Incomplete.scala:17)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$taskToKey$1.apply(EvaluateTask.scala:383)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$taskToKey$1.apply(EvaluateTask.scala:382)
[scala-js:error]    at scala.Function1$$anonfun$andThen$1.apply(Function1.scala:55)
[scala-js:error]    at scala.Function1$$anonfun$andThen$1.apply(Function1.scala:55)
[scala-js:error]    at sbt.Incomplete$$anonfun$sbt$Incomplete$$visit$1$1.apply(Incomplete.scala:32)
[scala-js:error]    at sbt.Incomplete$$anonfun$sbt$Incomplete$$visit$1$1.apply(Incomplete.scala:32)
[scala-js:error]    at scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)
[scala-js:error]    at scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)
[scala-js:error]    at sbt.Incomplete$.sbt$Incomplete$$visit$1(Incomplete.scala:32)
[scala-js:error]    at sbt.Incomplete$.transform(Incomplete.scala:36)
[scala-js:error]    at sbt.Incomplete$.transformBU(Incomplete.scala:26)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$transformInc$1.apply(EvaluateTask.scala:381)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$transformInc$1.apply(EvaluateTask.scala:381)
[scala-js:error]    at scala.util.Either$LeftProjection.map(Either.scala:377)
[scala-js:error]    at sbt.EvaluateTask$.transformInc(EvaluateTask.scala:381)
[scala-js:error]    at sbt.EvaluateTask$.run$1(EvaluateTask.scala:347)
[scala-js:error]    at sbt.EvaluateTask$.runTask(EvaluateTask.scala:361)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$apply$1$$anonfun$apply$3.apply(EvaluateTask.scala:258)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$apply$1$$anonfun$apply$3.apply(EvaluateTask.scala:258)
[scala-js:error]    at scala.Option$WithFilter.map(Option.scala:206)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$apply$1.apply(EvaluateTask.scala:258)
[scala-js:error]    at sbt.EvaluateTask$$anonfun$apply$1.apply(EvaluateTask.scala:257)
[scala-js:error]    at sbt.EvaluateTask$.withStreams(EvaluateTask.scala:293)
[scala-js:error]    at sbt.EvaluateTask$.apply(EvaluateTask.scala:257)
[scala-js:error]    at sbt.EvaluateTask$.apply(EvaluateTask.scala:255)
[scala-js:error]    at sbt.Extracted.runTask(Extracted.scala:43)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$.com$typesafe$dbuild$DistributedRunner$$buildTestPublish$1(DistributedRunner.scala:596)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$19.apply(DistributedRunner.scala:616)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$19.apply(DistributedRunner.scala:616)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$com$typesafe$dbuild$DistributedRunner$$runAggregate$1.apply(DistributedRunner.scala:70)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$com$typesafe$dbuild$DistributedRunner$$runAggregate$1.apply(DistributedRunner.scala:67)
[scala-js:error]    at scala.collection.LinearSeqOptimized$class.foldLeft(LinearSeqOptimized.scala:111)
[scala-js:error]    at scala.collection.immutable.List.foldLeft(List.scala:84)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$.com$typesafe$dbuild$DistributedRunner$$runAggregate(DistributedRunner.scala:67)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$14.apply(DistributedRunner.scala:574)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$14.apply(DistributedRunner.scala:574)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$.buildStuff(DistributedRunner.scala:616)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$generateArtifacts$1.apply(DistributedRunner.scala:745)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$generateArtifacts$1.apply(DistributedRunner.scala:745)
[scala-js:error]    at com.typesafe.dbuild.StateHelpers$.saveLastMsg(StateHelpers.scala:35)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$.generateArtifacts(DistributedRunner.scala:745)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$com$typesafe$dbuild$DistributedRunner$$buildIt$1.apply(DistributedRunner.scala:749)
[scala-js:error]    at com.typesafe.dbuild.DistributedRunner$$anonfun$com$typesafe$dbuild$DistributedRunner$$buildIt$1.apply(DistributedRunner.scala:749)
[scala-js:error]    at sbt.Command$$anonfun$command$1$$anonfun$apply$1.apply(Command.scala:29)
[scala-js:error]    at sbt.Command$$anonfun$command$1$$anonfun$apply$1.apply(Command.scala:29)
[scala-js:error]    at sbt.Command$.process(Command.scala:92)
[scala-js:error]    at sbt.MainLoop$$anonfun$1$$anonfun$apply$1.apply(MainLoop.scala:98)
[scala-js:error]    at sbt.MainLoop$$anonfun$1$$anonfun$apply$1.apply(MainLoop.scala:98)
[scala-js:error]    at sbt.State$$anon$1.process(State.scala:184)
[scala-js:error]    at sbt.MainLoop$$anonfun$1.apply(MainLoop.scala:98)
[scala-js:error]    at sbt.MainLoop$$anonfun$1.apply(MainLoop.scala:98)
[scala-js:error]    at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17)
[scala-js:error]    at sbt.MainLoop$.next(MainLoop.scala:98)
[scala-js:error]    at sbt.MainLoop$.run(MainLoop.scala:91)
[scala-js:error]    at sbt.MainLoop$$anonfun$runWithNewLog$1.apply(MainLoop.scala:70)
[scala-js:error]    at sbt.MainLoop$$anonfun$runWithNewLog$1.apply(MainLoop.scala:65)
[scala-js:error]    at sbt.Using.apply(Using.scala:24)
[scala-js:error]    at sbt.MainLoop$.runWithNewLog(MainLoop.scala:65)
[scala-js:error]    at sbt.MainLoop$.runAndClearLast(MainLoop.scala:48)
[scala-js:error]    at sbt.MainLoop$.runLoggedLoop(MainLoop.scala:32)
[scala-js:error]    at sbt.MainLoop$.runLogged(MainLoop.scala:24)
[scala-js:error]    at sbt.StandardMain$.runManaged(Main.scala:53)
[scala-js:error]    at sbt.xMain.run(Main.scala:28)
[scala-js:error]    at xsbt.boot.Launch$$anonfun$run$1.apply(Launch.scala:57)
[scala-js:error]    at xsbt.boot.Launch$.withContextLoader(Launch.scala:77)
[scala-js:error]    at xsbt.boot.Launch$.run(Launch.scala:57)
[scala-js:error]    at xsbt.boot.Launch$$anonfun$explicit$1.apply(Launch.scala:45)
[scala-js:error]    at xsbt.boot.Launch$.launch(Launch.scala:65)
[scala-js:error]    at xsbt.boot.Launch$.apply(Launch.scala:16)
[scala-js:error]    at xsbt.boot.Boot$.runImpl(Boot.scala:32)
[scala-js:error]    at xsbt.boot.Boot$.main(Boot.scala:21)
[scala-js:error]    at xsbt.boot.Boot.main(Boot.scala)
[scala-js:error] java.lang.RuntimeException: 
[scala-js:error]    at scala.sys.package$.error(package.scala:27)
[scala-js:error]    at distributed.support.sbt.SbtRunner.distributed$support$sbt$SbtRunner$$processCommand(SbtRunner.scala:93)
[scala-js:error]    at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[scala-js:error]    at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[scala-js:error]    at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:74)
[scala-js:error]    at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:64)
[scala-js:error]    at sbt.IO$.withTemporaryFile(IO.scala:311)
[scala-js:error]    at distributed.support.sbt.SbtRunner.run(SbtRunner.scala:64)
[scala-js:error]    at distributed.support.sbt.SbtBuilder$.buildSbtProject(SbtBuildRunner.scala:84)
[scala-js:error]    at distributed.support.sbt.SbtBuildSystem.runBuild(SbtBuildSystem.scala:68)
[scala-js:error]    at distributed.support.sbt.SbtBuildSystem.runBuild(SbtBuildSystem.scala:18)
[scala-js] --== End Building scala-js ==--

unfork Play in 2.12 build

  // TODO unfork: it replaces sys.error for unused dependency by println...
  playframework-ref            : "adriaanm/playframework.git#2.4.x"

Unresolved dependency in spray when building locally

I've been trying to build the community build locally for some time with

$ ./community-2.11.x.sh -l

as I was advised in #64. I could never get it working (with various revisions of the master branch), due to an unresolved dependency during the extraction of spray. All other projects extract fine, but the build is still stuck because extraction as a whole failed.

I get this log for the spray part:

[spray] --== Extracting dependencies for spray ==--
[spray] Fetching https://github.com/spray/spray.git
[spray] into /localhome/doeraene/projects/community-builds/target-0.9.1/clones/b21fb93a57f49c1ce50294e594fdf7ccc44cf04e
[spray] Took: 00h 00m 02.0s
[spray] Cloning /localhome/doeraene/projects/community-builds/target-0.9.1/clones/b21fb93a57f49c1ce50294e594fdf7ccc44cf04e
[spray] to /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693
[spray] Took: 00h 00m 00.0s
[spray] Fetching /localhome/doeraene/projects/community-builds/target-0.9.1/clones/b21fb93a57f49c1ce50294e594fdf7ccc44cf04e
[spray] into /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693
[spray] Took: 00h 00m 00.2s
[spray] Extracting dependencies for: spray
[spray] Using Scala 2.11.2 during extraction.
[spray] Using sbt version: 0.13.5
[spray] [info] Loading project definition from /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693/project/project
[spray] [info] Updating {file:/localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693/project/project/}b25cc2edc52bfb154641e6458db0d6982db45693-build-build...
[spray] [info] Done updating.
[spray] [info] Loading project definition from /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693/project
[spray] [info] Resetting onLoad... in one scope
[spray] [info] Loading project definition from /localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693/project
[spray] [info] Dependencies among subprojects:
[spray] [info] default-sbt-project -> 
[spray] [info] Aggregates of subprojects:
[spray] [info] default-sbt-project -> 
[spray] [info] Building graph...
[spray] [info] sorting...
[spray] [info] These subprojects will be built: default-sbt-project
[spray] [info] Updating {file:/localhome/doeraene/projects/community-builds/target-0.9.1/extraction/0d4f8866a9919fb3fe53ee2783b05700b261171c/projects/b25cc2edc52bfb154641e6458db0d6982db45693/project/}b25cc2edc52bfb154641e6458db0d6982db45693-build...
[spray] [warn]  module not found: com.decodified#scala-ssh_2.10;0.6.4
[spray] [warn] ==== local: tried
[spray] [warn]   /home/doeraene/.ivy2/local/com.decodified/scala-ssh_2.10/0.6.4/ivys/ivy.xml
[spray] [warn] ==== public: tried
[spray] [warn]   http://repo1.maven.org/maven2/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn] ==== sonatype-snapshots: tried
[spray] [warn]   https://oss.sonatype.org/content/repositories/snapshots/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn] ==== sonatype-releases: tried
[spray] [warn]   https://oss.sonatype.org/content/repositories/releases/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn] ==== java-annoying-cla-shtuff: tried
[spray] [warn]   http://download.java.net/maven/2/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn] ==== typesafe-releases: tried
[spray] [warn]   http://typesafe.artifactoryonline.com/typesafe/releases/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn] ==== typesafe-ivy-releases: tried
[spray] [warn]   http://typesafe.artifactoryonline.com/typesafe/ivy-releases/com.decodified/scala-ssh_2.10/0.6.4/ivys/ivy.xml
[spray] [warn] ==== dbuild-snapshots: tried
[spray] [warn]   http://typesafe.artifactoryonline.com/typesafe/temp-distributed-build-snapshots/com.decodified/scala-ssh_2.10/0.6.4/ivys/ivy.xml
[spray] [warn] ==== sbt-plugin-releases: tried
[spray] [warn]   http://scalasbt.artifactoryonline.com/scalasbt/sbt-plugin-releases/com.decodified/scala-ssh_2.10/0.6.4/ivys/ivy.xml
[spray] [warn] ==== jgit-repo: tried
[spray] [warn]   http://download.eclipse.org/jgit/maven/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn] ==== scala-fresh-2.10.x: tried
[spray] [warn]   http://typesafe.artifactoryonline.com/typesafe/scala-fresh-2.10.x/com/decodified/scala-ssh_2.10/0.6.4/scala-ssh_2.10-0.6.4.pom
[spray] [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[spray] [warn]  ::          UNRESOLVED DEPENDENCIES         ::
[spray] [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[spray] [warn]  :: com.decodified#scala-ssh_2.10;0.6.4: not found
[spray] [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[spray] sbt.ResolveException: unresolved dependency: com.decodified#scala-ssh_2.10;0.6.4: not found
[spray]         at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:217)
[spray]         at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:126)
[spray]         at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:125)
[spray]         at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:115)
[spray]         at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:115)
[spray]         at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:103)
[spray]         at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:48)
[spray]         at sbt.IvySbt$$anon$3.call(Ivy.scala:57)
[spray]         at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:98)
[spray]         at xsbt.boot.Locks$GlobalLock.xsbt$boot$Locks$GlobalLock$$withChannelRetries$1(Locks.scala:81)
[spray]         at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:102)
[spray]         at xsbt.boot.Using$.withResource(Using.scala:11)
[spray]         at xsbt.boot.Using$.apply(Using.scala:10)
[spray]         at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:62)
[spray]         at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:52)
[spray]         at xsbt.boot.Locks$.apply0(Locks.scala:31)
[spray]         at xsbt.boot.Locks$.apply(Locks.scala:28)
[spray]         at sbt.IvySbt.withDefaultLogger(Ivy.scala:57)
[spray]         at sbt.IvySbt.withIvy(Ivy.scala:98)
[spray]         at sbt.IvySbt.withIvy(Ivy.scala:94)
[spray]         at sbt.IvySbt$Module.withModule(Ivy.scala:115)
[spray]         at sbt.IvyActions$.update(IvyActions.scala:125)
[spray]         at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1223)
[spray]         at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1221)
[spray]         at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$74.apply(Defaults.scala:1244)
[spray]         at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$74.apply(Defaults.scala:1242)
[spray]         at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35)
[spray]         at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1246)
[spray]         at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1241)
[spray]         at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45)
[spray]         at sbt.Classpaths$.cachedUpdate(Defaults.scala:1249)
[spray]         at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1214)
[spray]         at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1192)
[spray]         at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
[spray]         at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:42)
[spray]         at sbt.std.Transform$$anon$4.work(System.scala:64)
[spray]         at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:237)
[spray]         at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:237)
[spray]         at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
[spray]         at sbt.Execute.work(Execute.scala:244)
[spray]         at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:237)
[spray]         at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:237)
[spray]         at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:160)
[spray]         at sbt.CompletionService$$anon$2.call(CompletionService.scala:30)
[spray]         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[spray]         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[spray]         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[spray]         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[spray]         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[spray]         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[spray]         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[spray]         at java.lang.Thread.run(Thread.java:662)
[spray] [error] (*:update) sbt.ResolveException: unresolved dependency: com.decodified#scala-ssh_2.10;0.6.4: not found
[spray] Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? 
[spray:error] java.lang.RuntimeException: 
[spray:error]   at scala.sys.package$.error(package.scala:27)
[spray:error]   at distributed.support.sbt.SbtRunner.distributed$support$sbt$SbtRunner$$processCommand(SbtRunner.scala:93)
[spray:error]   at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[spray:error]   at distributed.support.sbt.SbtRunner$$anonfun$run$1$$anonfun$apply$2$$anonfun$apply$3.apply(SbtRunner.scala:74)
[spray:error]   at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:74)
[spray:error]   at distributed.support.sbt.SbtRunner$$anonfun$run$1.apply(SbtRunner.scala:64)
[spray:error]   at sbt.IO$.withTemporaryFile(IO.scala:311)
[spray:error]   at distributed.support.sbt.SbtRunner.run(SbtRunner.scala:64)
[spray:error]   at distributed.support.sbt.SbtExtractor$.extractMetaData(DependencyExtractor.scala:99)
[spray:error]   at distributed.support.sbt.SbtBuildSystem.extractDependencies(SbtBuildSystem.scala:58)
[spray:error]   at distributed.support.sbt.SbtBuildSystem.extractDependencies(SbtBuildSystem.scala:18)
[spray] --== End Extracting dependencies for spray ==--

Do I have to something special to solve this?

unfork ScalaMock

similar to #144

done in 2.11.x-jdk6 as of #147, but still needs to be pushed through to 2.11.x-jdk8 and 2.12.x

move to Akka 2.4

but note that 2.4 build requires JDK 8, so the 2.11.x branch will need to stay on Akka 2.3

related, if not part and parcel: #146

scaladoc-related regression in recent scala-js build

in the last few days, sometime after scala-js/scala-js@9c5d21b, something was merged that makes scala-js fail to find doc jars, in both the 2.11.x-jdk8 and 2.12.x builds (probably 2.11.x too):

[scala-js] [warn]   :: org.scala-lang#scala-library;2.12.0-dbuildx1449e929bfaf6c8cf79cfea26d7fe2107a8b984e!scala-library.jar(doc)
[scala-js] [warn]   :: org.scala-lang#scala-compiler;2.12.0-dbuildx1449e929bfaf6c8cf79cfea26d7fe2107a8b984e!scala-compiler.jar(doc)
[scala-js] [warn]   :: org.scala-lang#scala-reflect;2.12.0-dbuildx1449e929bfaf6c8cf79cfea26d7fe2107a8b984e!scala-reflect.jar(doc)

perhaps the community build skips generating Scaladoc for Scala itself?

for now, freezing at the last known good commit

regression: scala-partest failing (MiMa errors)

failure log: https://scala-ci.typesafe.com/job/scala-2.11.x-integrate-community-build/124/consoleFull:

[scala-partest] [info] scala-partest: found 40 potential binary incompatibilities
...

I think the responsible PR is scala/scala-partest#40

maybe the MiMA files in the scala-partest repo just need to be updated? I haven't dealt with this before. @szeiger?

@adriaanm, is there any need for scala-partest to stay binary compatible from release to release at all...? it's not obvious to me what the point of that would be.

Remove references to sbt-idea

According to mpeltonen/sbt-idea#327 the sbt-idea plugin looks abandoned. That's not a big deal because IntelliJ imports Scala project natively now.

We should get rid of sbt-idea project from community build. However, we can do that only once all projects defined community build drop their references to sbt-idea plugin.

This ticket is created for tracking progress on this.

unfork sbt in 2.12 build

  sbt-ref                      : "adriaanm/sbt.git#community-build"
    // 0.13.7-M2 + drop ListBuffer.readOnly (after 0.13.7-M2, new dependencies were added
      --> TODO: add them here as well)

upgrade to spray 1.3.2, run its test suite

see comments in #66

Add the current shapeless release to the community build

Current release is 2.2.2 ... will be at least 2.2.3 by the time this ticket is closed.

overall coverage and quality of 2.12 build leaves much to be desired

around the time of 2.12.0-M2, we threw together a 2.12 build by-any-means-necessary. it's pretty janky. I've opened tickets on many of the most significant issues (frozen sbt, forked Play, frozen scala-js, commented-out ENSIME, and so on and so on), but there plenty more forked and frozen projects and projects where we aren't running the tests.

I believe we've already overspent our notional budget for 2015 for doing big, intensive rounds of upgrades here, but it would be good to keep chipping away at this.

2.11.x/JDK6 build doesn't work on Mac OS X (can't find lib/tools.jar)

the ensime-server project has code that assumes that any self-respecting JDK would have $JAVA_HOME/lib/tools.jar, but this isn't true of Apple-packaged JDKs. (Oracle took over the packaging on OS X starting with JDK 7, so that's why only 6 is affected.)

the error occurs during extraction, so at least you find out quickly.

we're not working on the 2.11.x/JDK6 build much these days; most of the action nowadays is on JDK 8. and we usually run the build on Jenkins, not locally. so I'm not likely to fix this, but I wanted to document it.

Track automatically how many lines of code we are compiling

We are tracking number of lines compiled by community build by manually running cloc from time to time. It would be great to run cloc automatically.

upgrade to sbt 0.13.9

all three builds (2.11.x, 2.11.x-jdk8, 2.12.x) ought to be using this

lots of resolver errors in build logs (maven.twttr.com)

lukas [2:47 PM]
seth, it's a detail, but do you know why this line keeps appearing in the community build log?
[...] [error] SERVER ERROR: Service Temporarily Unavailable url=https://maven.twttr.com/<some>/<maven>/<artifact>/<path>

sethtisue [2:49 PM]
it started when I added a resolver needed by twitter-util
I’ve asked Toni if it’s possible to add a resolver just to a single project, Toni says no

lukas [2:49 PM]
is there an order in the resolvers list? then it could just come last?

sethtisue [2:50 PM]
it is already last or very close. it’s mysterious to me
this falls under the general heading of #152
it could be that we need to mirror more of the resolvers in the Artifactory config on scala-ci, but the idea of having to mess with that depresses me

bump to akka 2.4-M3 in 2.12.x

See akka/akka#18009

That will enable removal of scala.concurrent.util.Unsafe.

Get off custom fork for Java 8 testing

The Community-2.11.x-Java8 jenkins job has been running stripped down version of community build. That version has been created by @retronym in his own fork.

We should figure out all necessary fixes so we can get off the fork and custom branch. Ideally, we should use exactly the same definition for both Java 6 and Java 8. If some custiomizations are needed (e.g. for swing), the difference between branches should be kept minimal.

This issue is here to track progress of that effort. The work has been motivated by the fact that the fork started to get stale and failing for some other reasons.

track ensime-server

this requires adding fommil/spray-json-shapeless. we had held back from doing that before, but perusal of https://github.com/fommil/spray-json-shapeless/blob/master/build.sbt indicates it is probably possible now that we're on current Shapeless.

upgrade to newer dbuild 0.9.3+

this is not pressing, but presumably we should upgrade eventually

a previous attempt to upgrade from 0.9.1 to 0.9.2 went awry; gory details at scala-ide/uber-build#64 . as of June 2015, there is no 0.9.3 release

suspicious scala-xml dependencies

are these outdated scala-xml dependencies in common.conf actually necessary? they aren't commented, so they have the look of something that just got kept by accident. we'd have to investigate

in two places:

commands += "set libraryDependencies += \"org.scala-lang.modules\" %% \"scala-xml\" % \"1.0.0-RC6\""

track slick

currently at "slick/slick.git#pull/686/head"

Community build failing in Play's SBT plugin

Recent community build failure: https://jenkins-dbuild.typesafe.com:8499/view/Shared/job/Community-2.11.x/513/console

Perhaps due to playframework/playframework#4108:

[Play2-SBT-Plugin] [warn] Run 'evicted' to see detailed eviction warnings
[Play2-SBT-Plugin] [info] Compiling 26 Scala sources to /mnt/dbuild/jenkinsdbuild4/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/Play2-SBT-Plugin-fcfeaa98ab8e414fb0e8db6b74e8dffdb3256dfa/framework/src/sbt-plugin/target/scala-2.10.4-dbuildx02077049a08aeb2751a9a426dc8c29feded3d129/sbt-0.13/classes...
[Play2-SBT-Plugin] [warn] /mnt/dbuild/jenkinsdbuild4/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/Play2-SBT-Plugin-fcfeaa98ab8e414fb0e8db6b74e8dffdb3256dfa/framework/src/sbt-plugin/src/main/scala/PlayCommands.scala:400: Adapting argument list by creating a 3-tuple: this may not be what you want.
[Play2-SBT-Plugin] [warn]         signature: ArrowAssoc.->[B](y: B): (A, B)
[Play2-SBT-Plugin] [warn]   given arguments: module.\("@organisation").text, module.\("@name").text, rev.\("@name")
[Play2-SBT-Plugin] [warn]  after adaptation: ArrowAssoc.->((module.\("@organisation").text, module.\("@name").text, rev.\("@name")): (String, String, scala.xml.NodeSeq))
[Play2-SBT-Plugin] [warn]             'module -> (module \ "@organisation" text, module \ "@name" text, rev \ "@name"),
[Play2-SBT-Plugin] [warn]                     ^
[Play2-SBT-Plugin] [error] /mnt/dbuild/jenkinsdbuild4/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/Play2-SBT-Plugin-fcfeaa98ab8e414fb0e8db6b74e8dffdb3256dfa/framework/src/sbt-plugin/src/main/scala/PlayEclipse.scala:40: not found: value setting
[Play2-SBT-Plugin] [error]         setting(crossTarget in ref, state) map { ct =>
[Play2-SBT-Plugin] [error]         ^
[Play2-SBT-Plugin] [error] /mnt/dbuild/jenkinsdbuild4/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/Play2-SBT-Plugin-fcfeaa98ab8e414fb0e8db6b74e8dffdb3256dfa/framework/src/sbt-plugin/src/main/scala/PlayEclipse.scala:57: not found: value evaluateTask
[Play2-SBT-Plugin] [error]         evaluateTask(dependencyClasspath in Runtime, ref, state) map { classpath =>
[Play2-SBT-Plugin] [error]         ^
[Play2-SBT-Plugin] [error] /mnt/dbuild/jenkinsdbuild4/localhome-a8/workspace/Community-2.11.x/target-0.9.1/project-builds/Play2-SBT-Plugin-fcfeaa98ab8e414fb0e8db6b74e8dffdb3256dfa/framework/src/sbt-plugin/src/main/scala/PlayEclipse.scala:81: not found: value setting
[Play2-SBT-Plugin] [error]         (setting(baseDirectory in ref, state) |@| setting(key in ref, state)) { (base, src) =>
[Play2-SBT-Plugin] [error]          ^
[Play2-SBT-Plugin] [warn] one warning found
[Play2-SBT-Plugin] [error] three errors found
[Play2-SBT-Plugin] [error] (SBT-Plugin/compile:compile) Compilation failed

/cc @jroper

re-enable Spray test suite

figure out why https://scala-ci.typesafe.com/job/scala-2.11.x-integrate-community-build/33/console
failed spray.httpx.unmarshalling.ScalaXmlUnmarshallerSpec

write documentation on how to troubleshoot community build problems

I've learned a lot about this in the last few months. I should write as much of it down as I can.

Play's run-support breaks community build

The playframework/playframework#3730 breaks community build with the following error:

[Play2-SBT-Plugin:error] scala.MatchError: 2.10.4-dbuildx02077049a08aeb2751a9a426dc8c29feded3d129 (of class java.lang.String)
[Play2-SBT-Plugin:error]    at Dependencies$.sbtIO(Dependencies.scala:134)
[Play2-SBT-Plugin:error]    at Dependencies$.runSupportDependencies(Dependencies.scala:131)
[Play2-SBT-Plugin:error]    at PlayBuild$$anonfun$SbtRunSupportProject$2.apply(Build.scala:217)
[Play2-SBT-Plugin:error]    at PlayBuild$$anonfun$SbtRunSupportProject$2.apply(Build.scala:217)
[Play2-SBT-Plugin:error]    at sbt.EvaluateSettings$MixedNode.evaluate0(INode.scala:175)

The full log is available here: https://jenkins-dbuild.typesafe.com:8499/job/Community-2.11.x/380/consoleFull

Related: lightbend-labs/dbuild#145

get ensime and spray-json-shapeless working again in 2.12.x build

some details are in the 2.12. common.conf. they are commented out right now — it hasn't been deeply investigated yet

the spray-json-shapeless error is:

Missing dependency: the library io.spray#spray-json is not provided (in space "specs2_24")

after extraction, the log shows:

[info] Project spray-json-shapeless
[info]   depends on: akka, scala, scalacheck, scalatest, shapeless

which isn't right; in 2.11.x-jdk8 we see many more dependencies:

[info] Project spray-json-shapeless
[info]   depends on: akka, genjavadoc-plugin, scala, scala-logging-api, scala-logging-slf4j, scalacheck, scalatest, scalaz, scoverage, shapeless, specs2, spray-json

unfork scala-js (fatal warnings issue)

I tried:

commands += "set every scalacOptions -= \"-Xfatal-warnings\""

but it looks like -= and set every don't like each other:

[scala-js] Cyclic reference involving 
[scala-js]    {file:/home/jenkins/workspace/scala-2.12.x-integrate-community-build/target-0.9.1/project-builds/scala-js-fc1ee6e96289c6fc597166f4987765ab422ca46f/}scalajs/*:scalacOptions
[scala-js]    */*:scalacOptions
[scala-js]  at sbt.Dag$Cyclic.$colon$colon(Dag.scala:67)

perhaps some incantation involving in ThisBuild or in Global would do the trick. if not, maybe contribute an upstream patch that makes this easier to control

Using older sbt version than defined?

We have noticed that community build started failing with

[akka:error] /mnt/dbuild/jenkinsdbuild3/localhome-a8/workspace/Community-2.12.x/target-0.9.1/extraction/4f8728a499f0b6163a3fcf05c392c289fb41a656/projects/47df9ee57e5f9cdf5c1713e29fb7b173d201cbe0/project/plugins.sbt:7: error: value jcenterRepo is not a member of object sbt.Resolver
[akka:error] resolvers += Resolver.jcenterRepo
[akka:error]                       ^
[akka] [error] Type error in expression
[akka] Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore?

after akka/akka#17450 has been merged. It seems that even if logs print out that sbt 0.13.8 is being used

akka] Using Scala 2.11.2 during extraction.
[akka] Using sbt version: 0.13.8

at some part dbuild still uses <=0.13.5 because Resolver.jcenterRepo can not be resolved.

scala / community-build Goto Github PK

community-build's Introduction

Scala 2 Community Build

Scala 3?

News

Read more

community-build's People

Contributors

Stargazers

Watchers

Forkers

community-build's Issues

Recommend Projects

Recommend Topics

Recommend Org