Giter Club home page Giter Club logo

Comments (5)

kris-sigur avatar kris-sigur commented on July 24, 2024

I was under the impression that that issue had been resolved via this commit: 12dde2b

Which version of Heritrix are you using?

from heritrix3.

martinvahi avatar martinvahi commented on July 24, 2024

I used the "stable" binary, because the
source failed to build.

from heritrix3.

anjackson avatar anjackson commented on July 24, 2024

In case it helps, we use this version of Heritrix3, and download it from the NetarchiveSuite Maven repo (see comments on that blog post).

This Dockerfile shows how we do it, although this also patches in our own modules.

from heritrix3.

martinvahi avatar martinvahi commented on July 24, 2024

Thank You for the kind answer, but currently my opinion, a very subjective opinion, a preference, is still that a flawless process is:

  1. clone it
  2. build it
  3. run it without any tinkering and bug workarounds and patching
  4. optionally run it with a myriad of custom configuration parameters, but the thing should run for the majority of people without that nasty 4. step/option

So, again, thank You for the kind help, I'm only glad for the answer and for the help, but I think that the build step should be fixed in stead of various people helping each other with various workarounds. Anyways, here's my console output with the version of Heritrix3 that You kindly referred:

se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ ls
commons  contrib  dist  engine  modules  pom.xml  README.md
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ nice -n20 ant package
Buildfile: build.xml does not exist!
Build failed
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ nice -n20 mvn package
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.archive.heritrix:heritrix-commons:jar:3.3.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ org.archive:heritrix:3.3.0-SNAPSHOT, /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/pom.xml, line 368, column 12
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.archive.heritrix:heritrix-modules:jar:3.3.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ org.archive:heritrix:3.3.0-SNAPSHOT, /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/pom.xml, line 368, column 12
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.archive.heritrix:heritrix-engine:jar:3.3.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ org.archive:heritrix:3.3.0-SNAPSHOT, /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/pom.xml, line 368, column 12
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.archive.heritrix:heritrix:pom:3.3.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ org.archive:heritrix:3.3.0-SNAPSHOT, /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/pom.xml, line 368, column 12
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.archive:heritrix:pom:3.3.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 368, column 12
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] Heritrix 3
[INFO] Heritrix 3: 'commons' subproject (utility classes)
[INFO] Heritrix 3: 'modules' subproject (reusable components)
[INFO] Heritrix 3: 'engine' subproject
[INFO] Heritrix 3 (distribution bundles)
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml (924 B at 1.4 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.6.1/maven-compiler-plugin-3.6.1.pom
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.6.1/maven-compiler-plugin-3.6.1.pom
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.6.1/maven-compiler-plugin-3.6.1.pom (11 KB at 94.3 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-plugins/30/maven-plugins-30.pom
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/30/maven-plugins-30.pom
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/30/maven-plugins-30.pom (10 KB at 93.7 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-parent/30/maven-parent-30.pom
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/30/maven-parent-30.pom
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/30/maven-parent-30.pom (41 KB at 253.8 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/apache/18/apache-18.pom
Downloading: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom
Downloaded: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 KB at 144.3 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.6.1/maven-compiler-plugin-3.6.1.jar
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.6.1/maven-compiler-plugin-3.6.1.jar
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.6.1/maven-compiler-plugin-3.6.1.jar (58 KB at 458.0 KB/sec)
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'commons' subproject (utility classes) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.1/maven-compiler-plugin-3.1.pom
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.1/maven-compiler-plugin-3.1.pom
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.1/maven-compiler-plugin-3.1.pom (10 KB at 97.8 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-plugins/24/maven-plugins-24.pom
Downloaded: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-plugins/24/maven-plugins-24.pom (11 KB at 18.5 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.1/maven-compiler-plugin-3.1.jar
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.1/maven-compiler-plugin-3.1.jar
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.1/maven-compiler-plugin-3.1.jar (42 KB at 371.2 KB/sec)
Downloading: http://download.oracle.com/maven/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.pom
Downloading: http://builds.archive.org/maven2/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.pom
Downloaded: http://builds.archive.org/maven2/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.pom (6 KB at 8.4 KB/sec)
Downloading: http://download.oracle.com/maven/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom
Downloading: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom
Downloaded: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom (16 KB at 26.5 KB/sec)
Downloading: http://download.oracle.com/maven/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.pom
Downloading: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.pom
Downloaded: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.pom (5 KB at 10.6 KB/sec)
Downloading: http://download.oracle.com/maven/org/apache/httpcomponents/httpcomponents-core/4.3.2/httpcomponents-core-4.3.2.pom
Downloading: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.3.2/httpcomponents-core-4.3.2.pom
Downloaded: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.3.2/httpcomponents-core-4.3.2.pom (12 KB at 29.9 KB/sec)
Downloading: http://download.oracle.com/maven/org/netpreserve/commons/webarchive-commons/1.1.4/webarchive-commons-1.1.4.pom
Downloading: http://builds.archive.org/maven2/org/netpreserve/commons/webarchive-commons/1.1.4/webarchive-commons-1.1.4.pom
Downloaded: http://builds.archive.org/maven2/org/netpreserve/commons/webarchive-commons/1.1.4/webarchive-commons-1.1.4.pom (8 KB at 18.0 KB/sec)
[WARNING] The artifact poi:poi:jar:2.5.1 has been relocated to poi:poi:jar:2.5.1-final-20040804
[WARNING] The artifact itext:itext:jar:1.3 has been relocated to com.lowagie:itext:jar:1.3
Downloading: http://download.oracle.com/maven/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.jar
Downloading: http://download.oracle.com/maven/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.jar
Downloading: http://download.oracle.com/maven/org/netpreserve/commons/webarchive-commons/1.1.4/webarchive-commons-1.1.4.jar
Downloading: http://builds.archive.org/maven2/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.jar
Downloading: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.jar
Downloading: http://builds.archive.org/maven2/org/netpreserve/commons/webarchive-commons/1.1.4/webarchive-commons-1.1.4.jar
Downloaded: http://builds.archive.org/maven2/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.jar (276 KB at 188.9 KB/sec)
Downloaded: http://builds.archive.org/maven2/org/netpreserve/commons/webarchive-commons/1.1.4/webarchive-commons-1.1.4.jar (673 KB at 366.4 KB/sec)
Downloaded: http://builds.archive.org/maven2/org/apache/httpcomponents/httpclient/4.3.3/httpclient-4.3.3.jar (576 KB at 309.3 KB/sec)
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix-commons ---
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/1.5.1/plexus-utils-1.5.1.pom
Downloaded: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/1.5.1/plexus-utils-1.5.1.pom (3 KB at 5.7 KB/sec)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-toolchain/1.0/maven-toolchain-1.0.pom
Downloaded: http://builds.archive.org/maven2/org/apache/maven/maven-toolchain/1.0/maven-toolchain-1.0.pom (4 KB at 8.5 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.2/plexus-compiler-api-2.2.pom
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.2/plexus-compiler-api-2.2.pom
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.2/plexus-compiler-api-2.2.pom (865 B at 8.7 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler/2.2/plexus-compiler-2.2.pom
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.2/plexus-compiler-2.2.pom
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.2/plexus-compiler-2.2.pom (4 KB at 36.0 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/3.0.8/plexus-utils-3.0.8.pom
Downloaded: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/3.0.8/plexus-utils-3.0.8.pom (4 KB at 7.8 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus/3.2/plexus-3.2.pom
Downloaded: http://builds.archive.org/maven2/org/codehaus/plexus/plexus/3.2/plexus-3.2.pom (19 KB at 31.3 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.2/plexus-compiler-manager-2.2.pom
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.2/plexus-compiler-manager-2.2.pom
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.2/plexus-compiler-manager-2.2.pom (690 B at 6.9 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.2/plexus-compiler-javac-2.2.pom
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.2/plexus-compiler-javac-2.2.pom
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.2/plexus-compiler-javac-2.2.pom (769 B at 7.7 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compilers/2.2/plexus-compilers-2.2.pom
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.2/plexus-compilers-2.2.pom
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.2/plexus-compilers-2.2.pom (2 KB at 12.5 KB/sec)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/1.5.1/plexus-utils-1.5.1.jar
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-toolchain/1.0/maven-toolchain-1.0.jar
Downloading: http://builds.archive.org/maven2/org/apache/maven/shared/maven-shared-utils/0.1/maven-shared-utils-0.1.jar
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.2/plexus-compiler-api-2.2.jar
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.2/plexus-compiler-manager-2.2.jar
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.2/plexus-compiler-javac-2.2.jar
Downloaded: http://builds.archive.org/maven2/org/apache/maven/shared/maven-shared-utils/0.1/maven-shared-utils-0.1.jar (151 KB at 127.8 KB/sec)
Downloaded: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/1.5.1/plexus-utils-1.5.1.jar (206 KB at 168.5 KB/sec)
Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/maven-toolchain/1.0/maven-toolchain-1.0.jar
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.2/plexus-compiler-api-2.2.jar
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.2/plexus-compiler-manager-2.2.jar
Downloading: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.2/plexus-compiler-javac-2.2.jar
Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/maven-toolchain/1.0/maven-toolchain-1.0.jar (33 KB at 297.6 KB/sec)
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.2/plexus-compiler-manager-2.2.jar (5 KB at 22.2 KB/sec)
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.2/plexus-compiler-javac-2.2.jar (19 KB at 79.2 KB/sec)
Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.2/plexus-compiler-api-2.2.jar (25 KB at 96.1 KB/sec)
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 77 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/target/classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/util/IdentityCacheableWrapper.java:[7,63] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,28] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,67] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/io/Warc2Arc.java: Some input files use or override a deprecated API.
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/io/Warc2Arc.java: Recompile with -Xlint:deprecation for details.
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/util/TestUtils.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/util/TestUtils.java uses unchecked or unsafe operations.
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/main/java/org/archive/util/TestUtils.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 5 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 38 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/target/test-classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/test/java/org/archive/io/arc/ARCWriterTest.java: Some input files use or override a deprecated API.
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/src/test/java/org/archive/io/arc/ARCWriterTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-commons ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.bdb.StoredQueueTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.976 sec
Running org.archive.surt.SURTTokenizerTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.221 sec
Running org.archive.settings.file.BdbModuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.884 sec
Running org.archive.settings.file.PrefixFinderTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.118 sec
Running org.archive.util.FileUtilsTest
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.157 sec
Running org.archive.util.PaddingStringBufferTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.util.ObjectIdentityBdbCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
level to 0
OIBCT:DB name:consistencyCache,  hit%: 100%, gets=262144 memHits=131072 diskHits=0 supplieds=131072 expungePuts=0 syncs=0
level to 10
veebr 02, 2017 10:17:55 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 100%, gets=1572864 memHits=1441792 diskHits=0 supplieds=131072 expungePuts=0 syncs=0
level to 20
veebr 02, 2017 10:18:00 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 95%, gets=2883584 memHits=2621440 diskHits=131072 supplieds=131072 expungePuts=131074 syncs=0
level to 30
veebr 02, 2017 10:18:06 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 93%, gets=4194304 memHits=3801088 diskHits=262144 supplieds=131072 expungePuts=262144 syncs=0
level to 40
veebr 02, 2017 10:18:10 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 92%, gets=5505024 memHits=4980736 diskHits=393216 supplieds=131072 expungePuts=393871 syncs=0
level to 50
veebr 02, 2017 10:18:14 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 92%, gets=6815744 memHits=6160384 diskHits=524288 supplieds=131072 expungePuts=524288 syncs=0
level to 60
veebr 02, 2017 10:18:19 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 91%, gets=8126464 memHits=7340032 diskHits=655360 supplieds=131072 expungePuts=655684 syncs=0
OIBCT:DB name:consistencyCache,  hit%: 90%, gets=8519680 memHits=7602176 diskHits=786432 supplieds=131072 expungePuts=786432 syncs=0
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
veebr 02, 2017 10:18:26 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
veebr 02, 2017 10:18:27 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
10000,0
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.295 sec
Running org.archive.util.PropertyUtilsTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.util.SURTTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.util.UriUtilsTest
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec
Running org.archive.util.fingerprint.MemLongFPSetTest
veebr 02, 2017 10:18:31 AM org.archive.util.fingerprint.MemLongFPSet grow
INFO: Doubling fingerprinting slots to 1024
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.util.fingerprint.LongFPSetCacheTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec
Running org.archive.util.fingerprint.ArrayLongFPCacheTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.util.MimetypeUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.util.SurtPrefixSetTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.util.anvl.ANVLRecordTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.util.BloomFilter64bitTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.496 sec
Running org.archive.util.LongToIntConsistentHashTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.331 sec
Running org.archive.util.ms.PieceReaderTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Running org.archive.util.ms.DocTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec
Running org.archive.util.TextUtilsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec
Running org.archive.util.ObjectIdentityBdbManualCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
level to 0
OIBMCT:DB name:consistencyCache,  hit%: 100%, gets=262144 memHits=131072 diskHits=0 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=121072 syncs=0
level to 10
veebr 02, 2017 10:20:48 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 956 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 100%, gets=1572864 memHits=1441792 diskHits=0 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=1431792 syncs=0
level to 20
veebr 02, 2017 10:21:12 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 95%, gets=2883584 memHits=2631440 diskHits=121072 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=2742512 syncs=0
level to 30
veebr 02, 2017 10:21:35 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 94%, gets=4194304 memHits=3821088 diskHits=242144 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=4053232 syncs=0
level to 40
veebr 02, 2017 10:21:59 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 93%, gets=5505024 memHits=5010736 diskHits=363216 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=5363952 syncs=0
level to 50
veebr 02, 2017 10:22:23 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 92%, gets=6815744 memHits=6200384 diskHits=484288 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=6674672 syncs=0
level to 60
veebr 02, 2017 10:22:46 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 92%, gets=8126464 memHits=7390032 diskHits=605360 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=7985392 syncs=0
OIBMCT:DB name:consistencyCache,  hit%: 91%, gets=8519680 memHits=7662176 diskHits=726432 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=8378608 syncs=0
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 150.967 sec
Running org.archive.io.SinkHandlerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.io.BufferedSeekInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.io.arc.ARCReaderFactoryTest
log4j:WARN No appenders could be found for logger (org.archive.util.LaxHttpParser).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec
Running org.archive.io.arc.ARCWriterPoolTest
veebr 02, 2017 10:22:56 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
veebr 02, 2017 10:22:56 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.707 sec
Running org.archive.io.arc.ARCWriterTest
veebr 02, 2017 10:22:56 AM org.archive.util.DevUtils warnHandle
WARNING: java.lang.Throwable: Gap between expected and actual: -1
 writing arc /tmp/heritrix-junit-tests/testGapError-JUNIT.arc.gz.open
	at org.archive.io.arc.ARCWriter.write(ARCWriter.java:398)
	at org.archive.io.arc.ARCWriter.write(ARCWriter.java:357)
	at org.archive.io.arc.ARCWriterTest.testGapError(ARCWriterTest.java:522)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.063 sec
Running org.archive.io.warc.WARCWriterTest
veebr 02, 2017 10:22:56 AM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/ /index.html
java.lang.IllegalArgumentException: Contains disallowed white space 0x20: http://www.archive.org/test/ /index.html
	at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:148)
	at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
	at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
	at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
	at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
	at org.archive.io.warc.WARCWriterTest.testSpaceInURL(WARCWriterTest.java:423)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

veebr 02, 2017 10:22:56 AM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/	/index.html
java.lang.IllegalArgumentException: Contains illegal character 0x9: http://www.archive.org/test/	/index.html
	at org.archive.io.warc.WARCWriter.baseCharacterCheck(WARCWriter.java:137)
	at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:146)
	at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
	at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
	at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
	at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
	at org.archive.io.warc.WARCWriterTest.testTabInURL(WARCWriterTest.java:428)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec
Running org.archive.io.HeaderedArchiveRecordTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.io.RepositionableInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.io.RecordingOutputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.io.RecordingInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.125 sec
Running org.archive.io.ArchiveTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.io.ArchiveReaderFactoryTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.io.ReplayCharSequenceTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.324 sec
Running org.archive.uid.UUIDGeneratorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec

Results :

Tests run: 169, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix-commons ---
[INFO] Building jar: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/commons/target/heritrix-commons-3.3.0-SNAPSHOT.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'modules' subproject (reusable components) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix-modules ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 51 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix-modules ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 164 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/target/classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/main/java/org/archive/modules/writer/ARCWriterProcessor.java: Some input files use or override a deprecated API.
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/main/java/org/archive/modules/writer/ARCWriterProcessor.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix-modules ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix-modules ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 56 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/target/test-classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java:[54,26] sun.security.tools.KeyTool is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java:[56,26] sun.security.tools.KeyTool is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/fetcher/FetchHTTPTest.java:[298,9] sun.security.tools.KeyTool is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/fetcher/CookieFetchHTTPIntegrationTest.java:[128,9] sun.security.tools.KeyTool is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java uses or overrides a deprecated API.
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-modules ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.modules.canonicalize.StripWWWNRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.075 sec
Running org.archive.modules.canonicalize.LowercaseRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.canonicalize.StripSessionCFIDsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.canonicalize.RulesCanonicalizationPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.canonicalize.FixupQueryStringTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.canonicalize.StripSessionIDsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec
Running org.archive.modules.canonicalize.StripUserinfoRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.canonicalize.StripWWWRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.canonicalize.RegexRuleTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.ScriptedProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec
Running org.archive.modules.extractor.HTTPContentDigestTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.extractor.ExtractorImpliedURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.extractor.ExtractorXMLTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.044 sec
Running org.archive.modules.extractor.ExtractorJSTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.145 sec
Running org.archive.modules.extractor.ExtractorCSSTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.modules.extractor.ExtractorDOCTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.extractor.ExtractorPDFTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.JerichoExtractorHTMLTest
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag frame at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c19,p18)
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c57,p56) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c113,p112) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c172,p171) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c73,p72)
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c75,p74) has missing whitespace after quoted attribute value at position (r1,c118,p117)
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c75,p74) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c75,p74) missing required end tag
comparing: http://www.anotherexample.com/ and https://www.anotherexample.com/
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c38,p37) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c66,p65) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r6,c5,p438) missing required end tag
veebr 02, 2017 10:23:09 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r6,c5,p438) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 10:23:10 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.11 sec
Running org.archive.modules.extractor.ExtractorHTTPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.AggressiveExtractorHTMLTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.extractor.ExtractorSWFTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.modules.extractor.ExtractorURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorUniversalTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorMultipleRegexTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.802 sec
Running org.archive.modules.extractor.ExtractorHTMLTest
comparing: http://www.anotherexample.com/ and https://www.anotherexample.com/
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec
Running org.archive.modules.credential.CredentialStoreTest
junit.framework.AssertionFailedError
	at junit.framework.Assert.fail(Assert.java:47)
	at junit.framework.Assert.assertTrue(Assert.java:20)
	at junit.framework.Assert.assertTrue(Assert.java:27)
	at org.archive.state.ModuleTestBase.verifySerialization(ModuleTestBase.java:211)
	at org.archive.state.ModuleTestBase.testSerializationIfAppropriate(ModuleTestBase.java:189)
	at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:217)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec <<< FAILURE!
Running org.archive.modules.credential.HttpAuthenticationCredentialTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.credential.HtmlFormCredentialTest
junit.framework.AssertionFailedError
	at junit.framework.Assert.fail(Assert.java:47)
	at junit.framework.Assert.assertTrue(Assert.java:20)
	at junit.framework.Assert.assertTrue(Assert.java:27)
	at org.archive.state.ModuleTestBase.verifySerialization(ModuleTestBase.java:211)
	at org.archive.state.ModuleTestBase.testSerializationIfAppropriate(ModuleTestBase.java:189)
	at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:217)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec <<< FAILURE!
Running org.archive.modules.net.CrawlServerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.net.RobotstxtTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec
Running org.archive.modules.net.ServerCacheTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.net.RobotsPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.net.FirstNamedRobotsPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.net.CrawlHostTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.forms.FormLoginProcessorTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.modules.recrawl.PersistLogProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.recrawl.PersistLoadProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.recrawl.ContentDigestHistoryTest
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest bdb
INFO: created org.archive.bdb.BdbModule@ab691c6
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest historyStore
INFO: created org.archive.modules.recrawl.BdbContentDigestHistory@16fb47dd
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest loader
INFO: created org.archive.modules.recrawl.ContentDigestHistoryLoader@4b2b09f4
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest storer
INFO: created org.archive.modules.recrawl.ContentDigestHistoryStorer@769a98b9
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.BdbContentDigestHistory store
WARNING: not saving empty content digest history (do you  have a ContentDigestHistoryLoader in your disposition chain?) - http://example.org/1
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest bdb
INFO: created org.archive.bdb.BdbModule@666c5d67
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest historyStore
INFO: created org.archive.modules.recrawl.BdbContentDigestHistory@70f52030
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-jdk14/1.6.6/slf4j-jdk14-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
veebr 02, 2017 10:23:11 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
veebr 02, 2017 10:23:11 AM org.archive.modules.recrawl.ContentDigestHistoryTest loader
INFO: created org.archive.modules.recrawl.ContentDigestHistoryLoader@455e051a
veebr 02, 2017 10:23:12 AM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {response={numRecords=1, totalBytes=480, contentBytes=141, sizeOnDisk=10}, warcinfo={numRecords=0, totalBytes=0, contentBytes=0, sizeOnDisk=0}, totals={numRecords=3, totalBytes=1371, contentBytes=406, sizeOnDisk=30}, request={numRecords=1, totalBytes=520, contentBytes=202, sizeOnDisk=10}, metadata={numRecords=1, totalBytes=371, contentBytes=63, sizeOnDisk=10}}
veebr 02, 2017 10:23:12 AM org.archive.modules.recrawl.ContentDigestHistoryTest storer
INFO: created org.archive.modules.recrawl.ContentDigestHistoryStorer@153b8425
veebr 02, 2017 10:23:12 AM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {response={numRecords=1, totalBytes=480, contentBytes=141, sizeOnDisk=10}, warcinfo={numRecords=0, totalBytes=0, contentBytes=0, sizeOnDisk=0}, revisit={numRecords=1, totalBytes=746, contentBytes=141, sizeOnDisk=10}, totals={numRecords=6, totalBytes=3006, contentBytes=810, sizeOnDisk=60}, request={numRecords=2, totalBytes=1040, contentBytes=404, sizeOnDisk=20}, metadata={numRecords=2, totalBytes=740, contentBytes=124, sizeOnDisk=20}}
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.139 sec
Running org.archive.modules.recrawl.FetchHistoryProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.recrawl.PersistStoreProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.deciderules.HasViaDecideRuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.deciderules.ViaSurtPrefixedDecideRuleTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec
Running org.archive.modules.deciderules.MatchesStatusCodeDecideRuleTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.deciderules.NotMatchesStatusCodeDecideRuleTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.deciderules.DecideRuleSequenceTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.deciderules.HopsPathMatchesRegexDecideRuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.writer.WARCWriterProcessorTest
veebr 02, 2017 10:23:12 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=100
veebr 02, 2017 10:23:12 AM org.archive.modules.writer.WARCWriterProcessor innerProcessResult
SEVERE: Failed write of Records: http://test.com/
java.io.IOException: pretend no space left on device
	at org.archive.modules.writer.WARCWriterProcessorTest$FailWARCWriter.writeRecord(WARCWriterProcessorTest.java:150)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:384)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:345)
	at org.archive.io.warc.WARCWriter.createFile(WARCWriter.java:129)
	at org.archive.io.WriterPoolMember.createFile(WriterPoolMember.java:204)
	at org.archive.io.WriterPoolMember.checkSize(WriterPoolMember.java:180)
	at org.archive.modules.writer.WARCWriterProcessor.write(WARCWriterProcessor.java:213)
	at org.archive.modules.writer.WARCWriterProcessor.innerProcessResult(WARCWriterProcessor.java:191)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.writer.WARCWriterProcessorTest.testResilientOnError(WARCWriterProcessorTest.java:105)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:217)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

veebr 02, 2017 10:23:12 AM org.archive.modules.writer.WARCWriterProcessor innerProcessResult
SEVERE: Failed write of Records: http://test.com/
java.io.IOException: pretend no space left on device
	at org.archive.modules.writer.WARCWriterProcessorTest$FailWARCWriter.writeRecord(WARCWriterProcessorTest.java:150)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:384)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:345)
	at org.archive.io.warc.WARCWriter.createFile(WARCWriter.java:129)
	at org.archive.io.WriterPoolMember.createFile(WriterPoolMember.java:204)
	at org.archive.io.WriterPoolMember.checkSize(WriterPoolMember.java:180)
	at org.archive.modules.writer.WARCWriterProcessor.write(WARCWriterProcessor.java:213)
	at org.archive.modules.writer.WARCWriterProcessor.innerProcessResult(WARCWriterProcessor.java:191)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.writer.WARCWriterProcessorTest$2.run(WARCWriterProcessorTest.java:118)

veebr 02, 2017 10:23:12 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.204 sec
Running org.archive.modules.writer.MirrorWriterProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.writer.ARCWriterProcessorTest
veebr 02, 2017 10:23:12 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.fetcher.CookieFetchHTTPIntegrationTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.317 sec
Running org.archive.modules.fetcher.FetchFTPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.fetcher.FetchHTTPTest
veebr 02, 2017 10:23:13 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:13 +0000] "GET / HTTP/1.0" 200 57 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:13 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
95.153.20.212 -  -  [02/veebr/2017:08:23:13 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:13 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:13 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:13 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:14 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:14 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:14 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:14 +0000] "GET / HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:14 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:14 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /set-cookie HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /set-cookie HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /if-modified-since HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /if-modified-since HTTP/1.0" 304 0 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /if-none-match HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:16 +0000] "GET /if-none-match HTTP/1.0" 304 0 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:16 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:18 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:18 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:18 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:18 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:18 +0000] "GET / HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:18 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:18 +0000] "GET /chunked.txt HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:19 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:19 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:19 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:19 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /99% HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /??blahblah HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /url%20with%20spaces?query%20with%20spaces HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /url%20with%20spaces?query%20with%20spaces HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /cp1251 HTTP/1.0" 200 189 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /unsupported-charset HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:20 +0000] "GET /invalid-charset HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "example.com" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:20 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "example.com" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:21 +0000] "POST / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - basic-auth-login [02/veebr/2017:08:23:21 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - basic-auth-login [02/veebr/2017:08:23:21 +0000] "GET /auth/2 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - digest-auth-login [02/veebr/2017:08:23:21 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - digest-auth-login [02/veebr/2017:08:23:21 +0000] "GET /auth/2 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:08:23:21 +0000] "GET /401-no-challenge HTTP/1.0" 401 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.FetchHTTP extractChallenges
WARNING: Failed to extract auth challenge headers for uri with response status 401: http://localhost:7777/401-no-challenge
Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.716 sec
Running org.archive.modules.fetcher.CookieStoreTest
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@302af117
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@5ee04bb6
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@6ed73b44
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@5a588fd6
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@1b89f847
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest testSaveLoadCookies
INFO: before: [[version: 0][name: name1][value: value1][domain: example.com][path: null][expiry: null], [version: 0][name: name2][value: value2][domain: example.com][path: null][expiry: null], [version: 0][name: name3][value: value3][domain: example.com][path: null][expiry: null], [version: 0][name: name5][value: value5][domain: example.com][path: null][expiry: Mon May 29 05:10:01 EEST 2017], [version: 0][name: name6][value: value6][domain: example.com][path: /path1][expiry: null], [version: 0][name: name4][value: value4][domain: example.org][path: null][expiry: null]]
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest testSaveLoadCookies
INFO:  after: [[version: 0][name: name1][value: value1][domain: example.com][path: /][expiry: null], [version: 0][name: name2][value: value2][domain: example.com][path: /][expiry: null], [version: 0][name: name3][value: value3][domain: example.com][path: /][expiry: null], [version: 0][name: name5][value: value5][domain: example.com][path: /][expiry: Mon May 29 05:10:01 EEST 2017], [version: 0][name: name6][value: value6][domain: example.com][path: /path1][expiry: null], [version: 0][name: name4][value: value4][domain: example.org][path: /][expiry: null]]
veebr 02, 2017 10:23:21 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@67438424
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.393 sec
Running org.archive.modules.fetcher.FetchDNSTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec

Results :

Failed tests:   testSerializationIfAppropriate(org.archive.modules.credential.CredentialStoreTest)
  testSerializationIfAppropriate(org.archive.modules.credential.HtmlFormCredentialTest)

Tests run: 179, Failures: 2, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Heritrix 3 ......................................... SUCCESS [  3.808 s]
[INFO] Heritrix 3: 'commons' subproject (utility classes) . SUCCESS [05:46 min]
[INFO] Heritrix 3: 'modules' subproject (reusable components) FAILURE [ 24.069 s]
[INFO] Heritrix 3: 'engine' subproject .................... SKIPPED
[INFO] Heritrix 3 (distribution bundles) .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:14 min
[INFO] Finished at: 2017-02-02T10:23:31+02:00
[INFO] Final Memory: 32M/290M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project heritrix-modules: There are test failures.
[ERROR] 
[ERROR] Please refer to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_03/v_x/modules/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :heritrix-modules
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ date
N veebr  2 10:27:25 EET 2017
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ uname -a
Linux mvahi 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 GNU/Linux
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ java -version
java version "1.7.0_76"
Java(TM) SE Runtime Environment (build 1.7.0_76-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.76-b04, mixed mode)
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ mvn -version
Apache Maven 3.3.9 (NON-CANONICAL_2016-12-13T22:49:44+02:00_mmmv; 2016-12-13T22:49:44+02:00)
Maven home: /home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9
Java version: 1.7.0_76, vendor: Oracle Corporation
Java home: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/Java_7/jdk_v_1_7_0_u76/jre
Default locale: et_EE, platform encoding: UTF-8
OS name: "linux", version: "3.16.0-4-amd64", arch: "amd64", family: "unix"
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ df
Failisüsteem   1K-blokke     Kasut      Vaba Kas% Haagitud
/dev/sda1        9480420   7885728   1090068  88% /
udev               10240         0     10240   0% /dev
tmpfs            1639564      8864   1630700   1% /run
tmpfs            4098908         4   4098904   1% /dev/shm
tmpfs               5120         0      5120   0% /run/lock
tmpfs            4098908         0   4098908   0% /sys/fs/cgroup
/dev/sda6      188824364 156934400  22275168  88% /home
/dev/sdb1      961301000 281642228 630804388  31% /opt/hdd_01_for_large_files
tmpfs             819784         0    819784   0% /run/user/1000
tmpfs             819784         0    819784   0% /run/user/1001
tmpfs             819784         0    819784   0% /run/user/1009
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$ free
             total       used       free     shared    buffers     cached
Mem:       8197820    4627376    3570444      11540     306664    1680000
-/+ buffers/cache:    2640712    5557108
Swap:      7977980    1276084    6701896
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_03/v_x$

from heritrix3.

anjackson avatar anjackson commented on July 24, 2024

I think we've resolved these issues now. I agree the situation is a mess and I am attempting to establish more regular builds so this situation can be avoided in the future.

from heritrix3.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.