Console Output

Skipping 1,225 KB.. Full Log
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-network-shuffle_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 13 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-shuffle/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 0.7 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-network-shuffle_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.spark.network.sasl.SaslIntegrationSuite
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.425 s - in org.apache.spark.network.sasl.SaslIntegrationSuite
[INFO] Running org.apache.spark.network.sasl.ShuffleSecretManagerSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s - in org.apache.spark.network.sasl.ShuffleSecretManagerSuite
[INFO] Running org.apache.spark.network.shuffle.CleanupNonShuffleServiceServedFilesSuite
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.426 s - in org.apache.spark.network.shuffle.CleanupNonShuffleServiceServedFilesSuite
[INFO] Running org.apache.spark.network.shuffle.ExternalShuffleIntegrationSuite
[INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.878 s - in org.apache.spark.network.shuffle.ExternalShuffleIntegrationSuite
[INFO] Running org.apache.spark.network.shuffle.ExternalShuffleBlockResolverSuite
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.166 s - in org.apache.spark.network.shuffle.ExternalShuffleBlockResolverSuite
[INFO] Running org.apache.spark.network.shuffle.ExternalBlockHandlerSuite
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.226 s - in org.apache.spark.network.shuffle.ExternalBlockHandlerSuite
[INFO] Running org.apache.spark.network.shuffle.ExternalShuffleCleanupSuite
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.161 s - in org.apache.spark.network.shuffle.ExternalShuffleCleanupSuite
[INFO] Running org.apache.spark.network.shuffle.RetryingBlockFetcherSuite
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.105 s - in org.apache.spark.network.shuffle.RetryingBlockFetcherSuite
[INFO] Running org.apache.spark.network.shuffle.AppIsolationSuite
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.263 s - in org.apache.spark.network.shuffle.AppIsolationSuite
[INFO] Running org.apache.spark.network.shuffle.OneForOneBlockFetcherSuite
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 s - in org.apache.spark.network.shuffle.OneForOneBlockFetcherSuite
[INFO] Running org.apache.spark.network.shuffle.BlockTransferMessagesSuite
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.apache.spark.network.shuffle.BlockTransferMessagesSuite
[INFO] Running org.apache.spark.network.shuffle.ExternalShuffleSecuritySuite
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.161 s - in org.apache.spark.network.shuffle.ExternalShuffleSecuritySuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 68, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-network-shuffle_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-network-shuffle_2.12 ---
Discovery starting.
Discovery completed in 104 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 165 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] -----------------< org.apache.spark:spark-unsafe_2.12 >-----------------
[INFO] Building Spark Project Unsafe 3.0.4-SNAPSHOT                      [7/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-unsafe_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-unsafe_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-unsafe_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-unsafe_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-unsafe_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-unsafe_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-unsafe_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-unsafe_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-unsafe_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 18 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/target/scala-2.12/classes ...
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:26: sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:30: sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:289: sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:291: sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:293: sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[INFO] Done compiling.
[INFO] compile in 0.4 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-unsafe_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-unsafe_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-unsafe_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-unsafe_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.10/byte-buddy-agent-1.9.10.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.14.2/scalacheck_2.12-1.14.2.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.1.0/mockito-core-3.1.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.9.10/byte-buddy-1.9.10.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-unsafe_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 1 Scala source and 5 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 9.1 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-unsafe_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.spark.unsafe.types.CalendarIntervalSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 s - in org.apache.spark.unsafe.types.CalendarIntervalSuite
[INFO] Running org.apache.spark.unsafe.types.UTF8StringSuite
[INFO] Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.09 s - in org.apache.spark.unsafe.types.UTF8StringSuite
[INFO] Running org.apache.spark.unsafe.array.LongArraySuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.apache.spark.unsafe.array.LongArraySuite
[INFO] Running org.apache.spark.unsafe.hash.Murmur3_x86_32Suite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.318 s - in org.apache.spark.unsafe.hash.Murmur3_x86_32Suite
[INFO] Running org.apache.spark.unsafe.PlatformUtilSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 s - in org.apache.spark.unsafe.PlatformUtilSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 57, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-unsafe_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-unsafe_2.12 ---
Discovery starting.
Discovery completed in 379 milliseconds.
Run starting. Expected test count is: 19
UTF8StringPropertyCheckSuite:
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/target/scala-2.12/classes/) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
- toString
- numChars
- startsWith
- endsWith
- toUpperCase
- toLowerCase
- compare
- substring
- contains
- trim, trimLeft, trimRight
- reverse
- indexOf
- repeat
- lpad, rpad
- concat
- concatWs
- split !!! IGNORED !!!
- levenshteinDistance
- hashCode
- equals
Run completed in 1 second, 64 milliseconds.
Total number of tests run: 19
Suites: completed 2, aborted 0
Tests: succeeded 19, failed 0, canceled 0, ignored 1, pending 0
All tests passed.
[INFO] 
[INFO] ----------------< org.apache.spark:spark-launcher_2.12 >----------------
[INFO] Building Spark Project Launcher 3.0.4-SNAPSHOT                    [8/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-launcher_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-launcher_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-launcher_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-launcher_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-launcher_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-launcher_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-launcher_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-launcher_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-launcher_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 20 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 0.5 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-launcher_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-launcher_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-launcher_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-launcher_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.10/byte-buddy-agent-1.9.10.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.1.0/mockito-core-3.1.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.9.10/byte-buddy-1.9.10.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-launcher_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 7 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 0.7 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-launcher_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.spark.launcher.SparkSubmitCommandBuilderSuite
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.211 s - in org.apache.spark.launcher.SparkSubmitCommandBuilderSuite
[INFO] Running org.apache.spark.launcher.CommandBuilderUtilsSuite
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s - in org.apache.spark.launcher.CommandBuilderUtilsSuite
[INFO] Running org.apache.spark.launcher.ChildProcAppHandleSuite
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.197 s - in org.apache.spark.launcher.ChildProcAppHandleSuite
[INFO] Running org.apache.spark.launcher.InProcessLauncherSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 s - in org.apache.spark.launcher.InProcessLauncherSuite
[INFO] Running org.apache.spark.launcher.SparkSubmitOptionParserSuite
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.489 s - in org.apache.spark.launcher.SparkSubmitOptionParserSuite
[INFO] Running org.apache.spark.launcher.LauncherServerSuite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.044 s - in org.apache.spark.launcher.LauncherServerSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 45, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-launcher_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-launcher_2.12 ---
Discovery starting.
Discovery completed in 112 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 183 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------< org.apache.spark:spark-core_2.12 >------------------
[INFO] Building Spark Project Core 3.0.4-SNAPSHOT                        [9/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-core_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-core_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-core_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (module-timestamp-property) @ spark-core_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (local-timestamp-property) @ spark-core_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-core_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/core/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/core/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-core_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/net/sf/ehcache/ehcache-core/2.4.4/ehcache-core-2.4.4.jar:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.40.v20210413/jetty-plus-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-model/1.0.0-M20/api-ldap-model-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-i18n/1.0.0-M20/api-i18n-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.40.v20210413/jetty-http-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.40.v20210413/jetty-jndi-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.40.v20210413/jetty-util-ajax-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.40.v20210413/jetty-util-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-ber/1.0.0-M20/api-asn1-ber-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/antlr/antlr/2.7.7/antlr-2.7.7.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.40.v20210413/jetty-security-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.40.v20210413/jetty-continuation-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.40.v20210413/jetty-servlet-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.40.v20210413/jetty-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.40.v20210413/jetty-servlets-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/org/apache/mina/mina-core/2.0.7/mina-core-2.0.7.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.40.v20210413/jetty-proxy-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:add-source (add-sources) @ spark-core_2.12 ---
[INFO] Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/core/src/main/scala-2.12 added.
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-core_2.12 ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (default) @ spark-core_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-core_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 49 resources
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-core_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-core_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 546 Scala sources and 96 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/core/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 67.8 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-core_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-core_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 77 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-core_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-core_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core/2.0.0-M15/apacheds-core-2.0.0-M15.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.10/byte-buddy-agent-1.9.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.40.v20210413/jetty-plus-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-shuffle/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/jakarta/servlet/jakarta.servlet-api/4.0.3/jakarta.servlet-api-4.0.3.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-leg-rc/2.52.0/selenium-leg-rc-2.52.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpmime/4.5.6/httpmime-4.5.6.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-model/1.0.0-M20/api-ldap-model-1.0.0-M20.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/org/apache/directory/api/api-i18n/1.0.0-M20/api-i18n-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-authn/2.0.0-M15/apacheds-interceptors-authn-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-jdbm-partition/2.0.0-M15/apacheds-jdbm-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.40.v20210413/jetty-http-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-firefox-driver/2.52.0/selenium-firefox-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.2.17.v20160517/websocket-api-9.2.17.v20160517.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.40.v20210413/jetty-jndi-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/net/sourceforge/cssparser/cssparser/0.9.19/cssparser-0.9.19.jar:/home/jenkins/.m2/repository/bouncycastle/bcprov-jdk15/140/bcprov-jdk15-140.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.40.v20210413/jetty-util-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-client-api/1.0.0-M20/api-ldap-client-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/test-framework/jersey-test-framework-core/2.30/jersey-test-framework-core-2.30.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/org/simpleframework/simple-transport/6.0.1/simple-transport-6.0.1.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-util/1.0.0-M20/api-ldap-extras-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-aci/1.0.0-M20/api-ldap-extras-aci-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/org/apache/directory/jdbm/apacheds-jdbm1/2.0.0-M2/apacheds-jdbm1-2.0.0-M2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-test/2.7.1/curator-test-2.7.1.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.9.10/byte-buddy-1.9.10.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-normalization/2.0.0-M15/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-shared/2.0.0-M15/apacheds-core-shared-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/net/java/dev/jna/jna-platform/4.1.0/jna-platform-4.1.0.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-minikdc/2.7.4/hadoop-minikdc-2.7.4.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-api/2.52.0/selenium-api-2.52.0.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptor-kerberos/2.0.0-M15/apacheds-interceptor-kerberos-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/antlr/antlr/2.7.7/antlr-2.7.7.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.40.v20210413/jetty-security-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-edge-driver/2.52.0/selenium-edge-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.40.v20210413/jetty-continuation-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-htmlunit-driver/2.52.0/selenium-htmlunit-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.40.v20210413/jetty-servlet-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-simple-http/2.30/jersey-container-simple-http-2.30.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-authz/2.0.0-M15/apacheds-interceptors-authz-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/derby/derby/10.12.1.1/derby-10.12.1.1.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.2.17.v20160517/websocket-client-9.2.17.v20160517.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-chrome-driver/2.52.0/selenium-chrome-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-protocol-shared/2.0.0-M15/apacheds-protocol-shared-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.40.v20210413/jetty-servlets-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-support/2.52.0/selenium-support-2.52.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-safari-driver/2.52.0/selenium-safari-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/test-framework/providers/jersey-test-framework-provider-simple/2.30/jersey-test-framework-provider-simple-2.30.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.14.2/scalacheck_2.12-1.14.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-java/2.52.0/selenium-java-2.52.0.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-codec-api/1.0.0-M20/api-ldap-extras-codec-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-codec-core/1.0.0-M20/api-ldap-codec-core-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-trigger/2.0.0-M15/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-all/1.0.0-M20/api-all-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/jenkins/.m2/repository/net/sf/ehcache/ehcache-core/2.4.4/ehcache-core-2.4.4.jar:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/w3c/css/sac/1.3/sac-1.3.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-changelog/2.0.0-M15/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-constants/2.0.0-M15/apacheds-core-constants-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-protocol-ldap/2.0.0-M15/apacheds-protocol-ldap-2.0.0-M15.jar:/home/jenkins/.m2/repository/xalan/serializer/2.7.2/serializer-2.7.2.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-codec/1.0.0-M20/api-ldap-extras-codec-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/xalan/xalan/2.7.2/xalan-2.7.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-schema/2.0.0-M15/apacheds-interceptors-schema-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.40.v20210413/jetty-util-ajax-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/mavibot/mavibot/1.0.0-M1/mavibot-1.0.0-M1.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.40.v20210413/jetty-xml-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/neko-htmlunit/2.21/neko-htmlunit-2.21.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-xdbm-partition/2.0.0-M15/apacheds-xdbm-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-avl/2.0.0-M15/apacheds-core-avl-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-trigger/1.0.0-M20/api-ldap-extras-trigger-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.1.0/mockito-core-3.1.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.40.v20210413/jetty-webapp-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-sp/1.0.0-M20/api-ldap-extras-sp-1.0.0-M20.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.2.17.v20160517/websocket-common-9.2.17.v20160517.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-ie-driver/2.52.0/selenium-ie-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/simpleframework/simple-common/6.0.1/simple-common-6.0.1.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-ber/1.0.0-M20/api-asn1-ber-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.22/htmlunit-2.22.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-mavibot-partition/2.0.0-M15/apacheds-mavibot-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-api/2.0.0-M15/apacheds-core-api-2.0.0-M15.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/simpleframework/simple-http/6.0.1/simple-http-6.0.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-subtree/2.0.0-M15/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-referral/2.0.0-M15/apacheds-interceptors-referral-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.40.v20210413/jetty-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-protocol-kerberos/2.0.0-M15/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-ldif-partition/2.0.0-M15/apacheds-ldif-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-admin/2.0.0-M15/apacheds-interceptors-admin-2.0.0-M15.jar:/home/jenkins/.m2/repository/commons-pool/commons-pool/1.6/commons-pool-1.6.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-collective/2.0.0-M15/apacheds-interceptors-collective-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-event/2.0.0-M15/apacheds-interceptors-event-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-exception/2.0.0-M15/apacheds-interceptors-exception-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.22/htmlunit-core-js-2.22.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-operational/2.0.0-M15/apacheds-interceptors-operational-2.0.0-M15.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/apache/mina/mina-core/2.0.7/mina-core-2.0.7.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-remote-driver/2.52.0/selenium-remote-driver-2.52.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.40.v20210413/jetty-proxy-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/net/java/dev/jna/jna/4.1.0/jna-4.1.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-journal/2.0.0-M15/apacheds-interceptors-journal-2.0.0-M15.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-core_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 285 Scala sources and 27 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/core/target/scala-2.12/test-classes ...
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/core/src/test/scala/org/apache/spark/util/UtilsSuite.scala:256: method isAccessible in class AccessibleObject is deprecated: see corresponding Javadoc for more information.
[WARNING] one warning found
[INFO] Done compiling.
[INFO] compile in 72.5 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-core_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running test.org.apache.spark.Java8RDDAPISuite
[INFO] Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.26 s - in test.org.apache.spark.Java8RDDAPISuite
[INFO] Running test.org.apache.spark.JavaAPISuite
[INFO] Tests run: 89, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.871 s - in test.org.apache.spark.JavaAPISuite
[INFO] Running test.org.apache.spark.JavaSparkContextSuite
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.066 s - in test.org.apache.spark.JavaSparkContextSuite
[INFO] Running org.apache.spark.resource.JavaResourceProfileSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 s - in org.apache.spark.resource.JavaResourceProfileSuite
[INFO] Running org.apache.spark.JavaJdbcRDDSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.043 s - in org.apache.spark.JavaJdbcRDDSuite
[INFO] Running org.apache.spark.unsafe.map.BytesToBytesMapOffHeapSuite
[INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.744 s - in org.apache.spark.unsafe.map.BytesToBytesMapOffHeapSuite
[INFO] Running org.apache.spark.unsafe.map.BytesToBytesMapOnHeapSuite
[INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.172 s - in org.apache.spark.unsafe.map.BytesToBytesMapOnHeapSuite
[INFO] Running org.apache.spark.io.ReadAheadInputStreamSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.517 s - in org.apache.spark.io.ReadAheadInputStreamSuite
[INFO] Running org.apache.spark.io.NioBufferedInputStreamSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.328 s - in org.apache.spark.io.NioBufferedInputStreamSuite
[INFO] Running org.apache.spark.shuffle.sort.UnsafeShuffleWriterSuite
[INFO] Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.735 s - in org.apache.spark.shuffle.sort.UnsafeShuffleWriterSuite
[INFO] Running org.apache.spark.shuffle.sort.ShuffleInMemorySorterSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.139 s - in org.apache.spark.shuffle.sort.ShuffleInMemorySorterSuite
[INFO] Running org.apache.spark.shuffle.sort.ShuffleInMemoryRadixSorterSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 s - in org.apache.spark.shuffle.sort.ShuffleInMemoryRadixSorterSuite
[INFO] Running org.apache.spark.shuffle.sort.PackedRecordPointerSuite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 s - in org.apache.spark.shuffle.sort.PackedRecordPointerSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterSuite
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.79 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterRadixSortSuite
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.81 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterRadixSortSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterRadixSortSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterRadixSortSuite
[INFO] Running org.apache.spark.util.SerializableConfigurationSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.129 s - in org.apache.spark.util.SerializableConfigurationSuite
[INFO] Running org.apache.spark.api.java.OptionalSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.apache.spark.api.java.OptionalSuite
[INFO] Running org.apache.spark.launcher.SparkLauncherSuite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.82 s - in org.apache.spark.launcher.SparkLauncherSuite
[INFO] Running org.apache.spark.memory.TaskMemoryManagerSuite
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 s - in org.apache.spark.memory.TaskMemoryManagerSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 253, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-core_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-core_2.12 ---
Discovery starting.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/unsafe/target/scala-2.12/classes/) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Discovery completed in 8 seconds, 453 milliseconds.
Run starting. Expected test count is: 2559
ExternalSorterSuite:
- empty data stream with kryo ser
- empty data stream with java ser
- few elements per partition with kryo ser
- few elements per partition with java ser
- empty partitions with spilling with kryo ser
- empty partitions with spilling with java ser
- spilling in local cluster with kryo ser
- spilling in local cluster with java ser
- spilling in local cluster with many reduce tasks with kryo ser
- spilling in local cluster with many reduce tasks with java ser
- cleanup of intermediate files in sorter
- cleanup of intermediate files in sorter with failures
- cleanup of intermediate files in shuffle
- cleanup of intermediate files in shuffle with failures
- no sorting or partial aggregation with kryo ser
- no sorting or partial aggregation with java ser
- no sorting or partial aggregation with spilling with kryo ser
- no sorting or partial aggregation with spilling with java ser
- sorting, no partial aggregation with kryo ser
- sorting, no partial aggregation with java ser
- sorting, no partial aggregation with spilling with kryo ser
- sorting, no partial aggregation with spilling with java ser
- partial aggregation, no sorting with kryo ser
- partial aggregation, no sorting with java ser
- partial aggregation, no sorting with spilling with kryo ser
- partial aggregation, no sorting with spilling with java ser
- partial aggregation and sorting with kryo ser
- partial aggregation and sorting with java ser
- partial aggregation and sorting with spilling with kryo ser
- partial aggregation and sorting with spilling with java ser
- sort without breaking sorting contracts with kryo ser
- sort without breaking sorting contracts with java ser
- sort without breaking timsort contracts for large arrays !!! IGNORED !!!
- spilling with hash collisions
- spilling with many hash collisions
- spilling with hash collisions using the Int.MaxValue key
- spilling with null keys and values
- sorting updates peak execution memory
- force to spill for external sorter
DAGSchedulerSuite:
- [SPARK-3353] parent stage should have lower stage id
- [SPARK-13902] Ensure no duplicate stages are created
- All shuffle files on the slave should be cleaned up when slave lost
- SPARK-32003: All shuffle files for executor should be cleaned up on fetch failure
- zero split job
- run trivial job
- run trivial job w/ dependency
- equals and hashCode AccumulableInfo
- cache location preferences w/ dependency
- regression test for getCacheLocs
- getMissingParentStages should consider all ancestor RDDs' cache statuses
- avoid exponential blowup when getting preferred locs list
- unserializable task
- trivial job failure
- trivial job cancellation
- job cancellation no-kill backend
- run trivial shuffle
- run trivial shuffle with fetch failure
- shuffle files not lost when slave lost with shuffle service
- shuffle files lost when worker lost with shuffle service
- shuffle files lost when worker lost without shuffle service
- shuffle files not lost when executor failure with shuffle service
- shuffle files lost when executor failure without shuffle service
- SPARK-28967 properties must be cloned before posting to listener bus for 0 partition
- Single stage fetch failure should not abort the stage.
- Multiple consecutive stage fetch failures should lead to job being aborted.
- Failures in different stages should not trigger an overall abort
- Non-consecutive stage failures don't trigger abort
- trivial shuffle with multiple fetch failures
- Retry all the tasks on a resubmitted attempt of a barrier stage caused by FetchFailure
- Retry all the tasks on a resubmitted attempt of a barrier stage caused by TaskKilled
- Fail the job if a barrier ResultTask failed
- late fetch failures don't cause multiple concurrent attempts for the same map stage
- extremely late fetch failures don't cause multiple concurrent attempts for the same stage
- task events always posted in speculation / when stage is killed
- ignore late map task completions
- run shuffle with map stage failure
- shuffle fetch failure in a reused shuffle dependency
- don't submit stage until its dependencies map outputs are registered (SPARK-5259)
- register map outputs correctly after ExecutorLost and task Resubmitted
- failure of stage used by two jobs
- stage used by two jobs, the first no longer active (SPARK-6880)
- stage used by two jobs, some fetch failures, and the first job no longer active (SPARK-6880)
- run trivial shuffle with out-of-band executor failure and retry
- recursive shuffle failures
- cached post-shuffle
- SPARK-30388: shuffle fetch failed on speculative task, but original task succeed
- misbehaved accumulator should not crash DAGScheduler and SparkContext
- misbehaved accumulator should not impact other accumulators
- misbehaved resultHandler should not crash DAGScheduler and SparkContext
- invalid spark.job.interruptOnCancel should not crash DAGScheduler
- getPartitions exceptions should not crash DAGScheduler and SparkContext (SPARK-8606)
- getPreferredLocations errors should not crash DAGScheduler and SparkContext (SPARK-8606)
- accumulator not calculated for resubmitted result stage
- accumulator not calculated for resubmitted task in result stage
- accumulators are updated on exception failures and task killed
- reduce tasks should be placed locally with map output
- reduce task locality preferences should only include machines with largest map outputs
- stages with both narrow and shuffle dependencies use narrow ones for locality
- Spark exceptions should include call site in stack trace
- catch errors in event loop
- simple map stage submission
- map stage submission with reduce stage also depending on the data
- map stage submission with fetch failure
- map stage submission with multiple shared stages and failures
- Trigger mapstage's job listener in submitMissingTasks
- map stage submission with executor failure late map task completions
- getShuffleDependencies correctly returns only direct shuffle parents
- SPARK-17644: After one stage is aborted for too many failed attempts, subsequent stagesstill behave correctly on fetch failures
- [SPARK-19263] DAGScheduler should not submit multiple active tasksets, even with late completions from earlier stage attempts
- task end event should have updated accumulators (SPARK-20342)
- Barrier task failures from the same stage attempt don't trigger multiple stage retries
- Barrier task failures from a previous stage attempt don't trigger stage retry
- SPARK-25341: abort stage while using old fetch protocol
- SPARK-25341: retry all the succeeding stages when the map stage is indeterminate
- SPARK-25341: continuous indeterminate stage roll back
- SPARK-29042: Sampled RDD with unordered input should be indeterminate
- SPARK-23207: cannot rollback a result stage
- SPARK-23207: local checkpoint fail to rollback (checkpointed before)
- SPARK-23207: local checkpoint fail to rollback (checkpointing now)
- SPARK-23207: reliable checkpoint can avoid rollback (checkpointed before)
- SPARK-23207: reliable checkpoint fail to rollback (checkpointing now)
- SPARK-27164: RDD.countApprox on empty RDDs schedules jobs which never complete
- Completions in zombie tasksets update status of non-zombie taskset
FsHistoryProviderSuite:
- Parse application logs (inMemory = true)
- Parse application logs (inMemory = false)
- SPARK-3697: ignore files that cannot be read.
- history file is renamed from inprogress to completed
- Parse logs that application is not started
- SPARK-5582: empty log directory
- apps with multiple attempts with order
- log urls without customization
- custom log urls, including FILE_NAME
- custom log urls, excluding FILE_NAME
- custom log urls with invalid attribute
- custom log urls, LOG_FILES not available while FILE_NAME is specified
- custom log urls, app not finished, applyIncompleteApplication: true
- custom log urls, app not finished, applyIncompleteApplication: false
- log cleaner
- should not clean inprogress application with lastUpdated time less than maxTime
- log cleaner for inProgress files
- Event log copy
- driver log cleaner
- SPARK-8372: new logs with no app ID are ignored
- provider correctly checks whether fs is in safe mode
- provider waits for safe mode to finish before initializing
- provider reports error after FS leaves safe mode
- ignore hidden files
- support history server ui admin acls
- mismatched version discards old listing
- invalidate cached UI
- clean up stale app information
- SPARK-21571: clean up removes invalid history files
- always find end event for finished apps
- parse event logs with optimizations off
- SPARK-24948: blacklist files we don't have read permission on
- check in-progress event logs absolute length
- log cleaner with the maximum number of log files
- backwards compatibility with LogInfo from Spark 2.4
- SPARK-29755 LogInfo should be serialized/deserialized by jackson properly
- SPARK-29755 AttemptInfoWrapper should be serialized/deserialized by jackson properly
- SPARK-29043: clean up specified event log
- compact event log files
- SPARK-33146: don't let one bad rolling log folder prevent loading other applications
RDDSuite:
- basic operations
- serialization
- distinct with known partitioner preserves partitioning
- countApproxDistinct
- SparkContext.union
- SparkContext.union parallel partition listing
- SparkContext.union creates UnionRDD if at least one RDD has no partitioner
- SparkContext.union creates PartitionAwareUnionRDD if all RDDs have partitioners
- PartitionAwareUnionRDD raises exception if at least one RDD has no partitioner
- SPARK-23778: empty RDD in union should not produce a UnionRDD
- partitioner aware union
- UnionRDD partition serialized size should be small
- fold
- fold with op modifying first arg
- aggregate
- treeAggregate
- treeAggregate with ops modifying first args
- treeReduce
- basic caching
- caching with failures
- empty RDD
- repartitioned RDDs
- repartitioned RDDs perform load balancing
- coalesced RDDs
- coalesced RDDs with locality
- coalesced RDDs with partial locality
- coalesced RDDs with locality, large scale (10K partitions)
- coalesced RDDs with partial locality, large scale (10K partitions)
- coalesced RDDs with locality, fail first pass
- zipped RDDs
- partition pruning
- collect large number of empty partitions
- take
- top with predefined ordering
- top with custom ordering
- takeOrdered with predefined ordering
- takeOrdered with limit 0
- takeOrdered with custom ordering
- isEmpty
- sample preserves partitioner
- takeSample
- takeSample from an empty rdd
- randomSplit
- runJob on an invalid partition
- sort an empty RDD
- sortByKey
- sortByKey ascending parameter
- sortByKey with explicit ordering
- repartitionAndSortWithinPartitions
- cartesian on empty RDD
- cartesian on non-empty RDDs
- intersection
- intersection strips duplicates in an input
- zipWithIndex
- zipWithIndex with a single partition
- zipWithIndex chained with other RDDs (SPARK-4433)
- zipWithUniqueId
- retag with implicit ClassTag
- parent method
- getNarrowAncestors
- getNarrowAncestors with multiple parents
- getNarrowAncestors with cycles
- task serialization exception should not hang scheduler
- RDD.partitions() fails fast when partitions indicies are incorrect (SPARK-13021)
- nested RDDs are not supported (SPARK-5063)
- actions cannot be performed inside of transformations (SPARK-5063)
- custom RDD coalescer
- SPARK-18406: race between end-of-task and completion iterator read lock release
- SPARK-27666: Do not release lock while TaskContext already completed
- SPARK-23496: order of input partitions can result in severe skew in coalesce
- cannot run actions after SparkContext has been stopped (SPARK-5063)
- cannot call methods on a stopped SparkContext (SPARK-5063)
ExecutorSuite:
- SPARK-15963: Catch `TaskKilledException` correctly in Executor.TaskRunner
- SPARK-19276: Handle FetchFailedExceptions that are hidden by user exceptions
- Executor's worker threads should be UninterruptibleThread
- SPARK-19276: OOMs correctly handled with a FetchFailure
- SPARK-23816: interrupts are not masked by a FetchFailure
- Gracefully handle error in task deserialization
- Heartbeat should drop zero accumulator updates
- Heartbeat should not drop zero accumulator updates when the conf is disabled
- Send task executor metrics in DirectTaskResult
- Send task executor metrics in TaskKilled
- Send task executor metrics in ExceptionFailure
- SPARK-34949: do not re-register BlockManager when executor is shutting down
SerDeUtilSuite:
- Converting an empty pair RDD to python does not throw an exception (SPARK-5441)
- Converting an empty python RDD to pair RDD does not throw an exception (SPARK-5441)
UtilsSuite:
- timeConversion
- Test byteString conversion
- bytesToString
- copyStream
- copyStreamUpTo
- memoryStringToMb
- splitCommandString
- string formatting of time durations
- reading offset bytes of a file
- reading offset bytes of a file (compressed)
- reading offset bytes across multiple files
- reading offset bytes across multiple files (compressed)
- deserialize long value
- writeByteBuffer should not change ByteBuffer position
- get iterator size
- getIteratorZipWithIndex
- doesDirectoryContainFilesNewerThan
- resolveURI
- resolveURIs with multiple paths
- nonLocalPaths
- isBindCollision
- log4j log level change
- deleteRecursively
- loading properties from file
- timeIt with prepare
- fetch hcfs dir
- shutdown hook manager
- isInDirectory
- circular buffer: if nothing was written to the buffer, display nothing
- circular buffer: if the buffer isn't full, print only the contents written
- circular buffer: data written == size of the buffer
- circular buffer: multiple overflow
- isDynamicAllocationEnabled
- getDynamicAllocationInitialExecutors
- Set Spark CallerContext
- encodeFileNameToURIRawPath
- decodeFileNameInURI
- Kill process
- chi square test of randomizeInPlace
- redact sensitive information
- redact sensitive information in command line args
- redact sensitive information in sequence of key value pairs
- tryWithSafeFinally
- tryWithSafeFinallyAndFailureCallbacks
- load extensions
- check Kubernetes master URL
- stringHalfWidth
- trimExceptCRLF standalone
PagedDataSourceSuite:
- basic
CheckpointStorageSuite:
- checkpoint compression
- cache checkpoint preferred location
SortingSuite:
- sortByKey
- large array
- large array with one split
- large array with many partitions
- sort descending
- sort descending with one split
- sort descending with many partitions
- more partitions than elements
- empty RDD
- partition balancing
- partition balancing for descending sort
- get a range of elements in a sorted RDD that is on one partition
- get a range of elements over multiple partitions in a descendingly sorted RDD
- get a range of elements in an array not partitioned by a range partitioner
- get a range of elements over multiple partitions but not taking up full partitions
RpcAddressSuite:
- hostPort
- fromSparkURL
- fromSparkURL: a typo url
- fromSparkURL: invalid scheme
- toSparkURL
JavaSerializerSuite:
- JavaSerializer instances are serializable
- Deserialize object containing a primitive Class as attribute
LocalDirsSuite:
- Utils.getLocalDir() returns a valid directory, even if some local dirs are missing
- SPARK_LOCAL_DIRS override also affects driver
- Utils.getLocalDir() throws an exception if any temporary directory cannot be retrieved
TaskContextSuite:
- provide metrics sources
- calls TaskCompletionListener after failure
- calls TaskFailureListeners after failure
- all TaskCompletionListeners should be called even if some fail
- all TaskFailureListeners should be called even if some fail
- TaskContext.attemptNumber should return attempt number, not task id (SPARK-4014)
- TaskContext.stageAttemptNumber getter
- accumulators are updated on exception failures
- failed tasks collect only accumulators whose values count during failures
- only updated internal accumulators will be sent back to driver
- localProperties are propagated to executors correctly
- immediately call a completion listener if the context is completed
- immediately call a failure listener if the context has failed
- TaskCompletionListenerException.getMessage should include previousError
- all TaskCompletionListeners should be called even if some fail or a task
HistoryServerSuite:
- application list json
- completed app list json
- running app list json
- minDate app list json
- maxDate app list json
- maxDate2 app list json
- minEndDate app list json
- maxEndDate app list json
- minEndDate and maxEndDate app list json
- minDate and maxEndDate app list json
- limit app list json
- one app json
- one app multi-attempt json
- job list json
- job list from multi-attempt app json(1)
- job list from multi-attempt app json(2)
- one job json
- succeeded job list json
- succeeded&failed job list json
- executor list json
- executor list with executor metrics json
- stage list json
- complete stage list json
- failed stage list json
- one stage json
- one stage attempt json
- stage task summary w shuffle write
- stage task summary w shuffle read
- stage task summary w/ custom quantiles
- stage task list
- stage task list w/ offset & length
- stage task list w/ sortBy
- stage task list w/ sortBy short names: -runtime
- stage task list w/ sortBy short names: runtime
- stage list with accumulable json
- stage with accumulable json
- stage task list from multi-attempt app json(1)
- stage task list from multi-attempt app json(2)
- blacklisting for stage
- blacklisting node for stage
- rdd list storage json
- executor node blacklisting
- executor node blacklisting unblacklisting
- executor memory usage
- executor resource information
- app environment
- one rdd storage json
- download all logs for app with multiple attempts
- download one log for app with multiple attempts
- response codes on bad paths
- automatically retrieve uiRoot from request through Knox
- static relative links are prefixed with uiRoot (spark.ui.proxyBase) !!! IGNORED !!!
- /version api endpoint
- ajax rendered relative links are prefixed with uiRoot (spark.ui.proxyBase)
- security manager starts with spark.authenticate set
- incomplete apps get refreshed
- ui and api authorization checks
- access history application defaults to the last attempt id
- SPARK-31697: HistoryServer should set Content-Type
NextIteratorSuite:
- one iteration
- two iterations
- empty iteration
- close is called once for empty iterations
- close is called once for non-empty iterations
ParallelCollectionSplitSuite:
- one element per slice
- one slice
- equal slices
- non-equal slices
- splitting exclusive range
- splitting inclusive range
- empty data
- zero slices
- negative number of slices
- exclusive ranges sliced into ranges
- inclusive ranges sliced into ranges
- identical slice sizes between Range and NumericRange
- identical slice sizes between List and NumericRange
- large ranges don't overflow
- random array tests
- random exclusive range tests
- random inclusive range tests
- exclusive ranges of longs
- inclusive ranges of longs
- exclusive ranges of doubles
- inclusive ranges of doubles
- inclusive ranges with Int.MaxValue and Int.MinValue
- empty ranges with Int.MaxValue and Int.MinValue
UISeleniumSuite:
- effects of unpersist() / persist() should be reflected
- failed stages should not appear to be active
- spark.ui.killEnabled should properly control kill button display
- jobs page should not display job group name unless some job was submitted in a job group
- job progress bars should handle stage / task failures
- job details page should display useful information for stages that haven't started
- job progress bars / cells reflect skipped stages / tasks
- stages that aren't run appear as 'skipped stages' after a job finishes
- jobs with stages that are skipped should show correct link descriptions on all jobs page
- attaching and detaching a new tab
- kill stage POST/GET response is correct
- kill job POST/GET response is correct
- stage & job retention
- live UI json application list
- job stages should have expected dotfile under DAG visualization
- stages page should show skipped stages
- Staleness of Spark UI should not last minutes or hours
- description for empty jobs
HadoopDelegationTokenManagerSuite:
- default configuration
- disable hadoopfs credential provider
- using deprecated configurations
- SPARK-29082: do not fail if current user does not have credentials
RollingEventLogFilesWriterSuite:
- create EventLogFileWriter with enable/disable rolling
- initialize, write, stop - with codec None
- initialize, write, stop - with codec Some(lz4)
- initialize, write, stop - with codec Some(lzf)
- initialize, write, stop - with codec Some(snappy)
- initialize, write, stop - with codec Some(zstd)
- spark.eventLog.compression.codec overrides spark.io.compression.codec
- Event log names
- Log overwriting
- rolling event log files - codec None
- rolling event log files - codec Some(lz4)
- rolling event log files - codec Some(lzf)
- rolling event log files - codec Some(snappy)
- rolling event log files - codec Some(zstd)
- rolling event log files - the max size of event log file size less than lower limit
RandomBlockReplicationPolicyBehavior:
- block replication - random block replication policy
LocalDiskShuffleMapOutputWriterSuite:
- writing to an outputstream
- writing to a channel
TestMemoryManagerSuite:
- tracks allocated execution memory by task
- markconsequentOOM
ExecutorRunnerTest:
- command includes appId
BlockTransferServiceSuite:
- fetchBlockSync should not hang when BlockFetchingListener.onBlockFetchSuccess fails
EventLoggingListenerSuite:
- Basic event logging with compression
- End-to-end event logging
- End-to-end event logging with compression
- Event logging with password redaction
- Spark-33504 sensitive attributes redaction in properties
- Executor metrics update
- SPARK-31764: isBarrier should be logged in event log
PluginContainerSuite:
- plugin initialization and communication
- do nothing if plugins are not configured
- merging of config options
- plugin initialization in non-local mode
- plugin initialization in non-local mode with resources
DriverRunnerTest:
- Process succeeds instantly
- Process failing several times and then succeeding
- Process doesn't restart if not supervised
- Process doesn't restart if killed
- Reset of backoff counter
- Kill process finalized with state KILLED
- Finalized with state FINISHED
- Finalized with state FAILED
- Handle exception starting process
PrefixComparatorsSuite:
- String prefix comparator
- Binary prefix comparator
- double prefix comparator handles NaNs properly
- double prefix comparator handles negative NaNs properly
- double prefix comparator handles other special values properly
NettyBlockTransferSecuritySuite:
- security default off
- security on same password
- security on mismatch password
- security mismatch auth off on server
- security mismatch auth off on client
- security with aes encryption
CommandUtilsSuite:
- set libraryPath correctly
- auth secret shouldn't appear in java opts
PairRDDFunctionsSuite:
- aggregateByKey
- groupByKey
- groupByKey with duplicates
- groupByKey with negative key hash codes
- groupByKey with many output partitions
- sampleByKey
- sampleByKeyExact
- reduceByKey
- reduceByKey with collectAsMap
- reduceByKey with many output partitions
- reduceByKey with partitioner
- countApproxDistinctByKey
- join
- join all-to-all
- leftOuterJoin
- cogroup with empty RDD
- cogroup with groupByed RDD having 0 partitions
- cogroup between multiple RDD with an order of magnitude difference in number of partitions
- cogroup between multiple RDD with number of partitions similar in order of magnitude
- cogroup between multiple RDD when defaultParallelism is set without proper partitioner
- cogroup between multiple RDD when defaultParallelism is set with proper partitioner
- cogroup between multiple RDD when defaultParallelism is set; with huge number of partitions in upstream RDDs
- rightOuterJoin
- fullOuterJoin
- join with no matches
- join with many output partitions
- groupWith
- groupWith3
- groupWith4
- zero-partition RDD
- keys and values
- default partitioner uses partition size
- default partitioner uses largest partitioner
- subtract
- subtract with narrow dependency
- subtractByKey
- subtractByKey with narrow dependency
- foldByKey
- foldByKey with mutable result type
- saveNewAPIHadoopFile should call setConf if format is configurable
- The JobId on the driver and executors should be the same during the commit
- saveAsHadoopFile should respect configured output committers
- failure callbacks should be called before calling writer.close() in saveNewAPIHadoopFile
- failure callbacks should be called before calling writer.close() in saveAsHadoopFile
- saveAsNewAPIHadoopDataset should support invalid output paths when there are no files to be committed to an absolute output location
- saveAsHadoopDataset should respect empty output directory when there are no files to be committed to an absolute output location
- lookup
- lookup with partitioner
- lookup with bad partitioner
RBackendSuite:
- close() clears jvmObjectTracker
PrimitiveVectorSuite:
- primitive value
- non-primitive value
- ideal growth
- ideal size
- resizing
MetricsConfigSuite:
- MetricsConfig with default properties
- MetricsConfig with properties set from a file
- MetricsConfig with properties set from a Spark configuration
- MetricsConfig with properties set from a file and a Spark configuration
- MetricsConfig with subProperties
PartiallySerializedBlockSuite:
- valuesIterator() and finishWritingToStream() cannot be called after discard() is called
- discard() can be called more than once
- cannot call valuesIterator() more than once
- cannot call finishWritingToStream() more than once
- cannot call finishWritingToStream() after valuesIterator()
- cannot call valuesIterator() after finishWritingToStream()
- buffers are deallocated in a TaskCompletionListener
- basic numbers with discard() and numBuffered = 50
- basic numbers with finishWritingToStream() and numBuffered = 50
- basic numbers with valuesIterator() and numBuffered = 50
- basic numbers with discard() and numBuffered = 0
- basic numbers with finishWritingToStream() and numBuffered = 0
- basic numbers with valuesIterator() and numBuffered = 0
- basic numbers with discard() and numBuffered = 1000
- basic numbers with finishWritingToStream() and numBuffered = 1000
- basic numbers with valuesIterator() and numBuffered = 1000
- case classes with discard() and numBuffered = 50
- case classes with finishWritingToStream() and numBuffered = 50
- case classes with valuesIterator() and numBuffered = 50
- case classes with discard() and numBuffered = 0
- case classes with finishWritingToStream() and numBuffered = 0
- case classes with valuesIterator() and numBuffered = 0
- case classes with discard() and numBuffered = 1000
- case classes with finishWritingToStream() and numBuffered = 1000
- case classes with valuesIterator() and numBuffered = 1000
- empty iterator with discard() and numBuffered = 0
- empty iterator with finishWritingToStream() and numBuffered = 0
- empty iterator with valuesIterator() and numBuffered = 0
SparkContextSchedulerCreationSuite:
- bad-master
- local
- local-*
- local-n
- local-*-n-failures
- local-n-failures
- bad-local-n
- bad-local-n-failures
- local-default-parallelism
- local-cluster
SerializationDebuggerSuite:
- primitives, strings, and nulls
- primitive arrays
- non-primitive arrays
- serializable object
- nested arrays
- nested objects
- cycles (should not loop forever)
- root object not serializable
- array containing not serializable element
- object containing not serializable field
- externalizable class writing out not serializable object
- externalizable class writing out serializable objects
- object containing writeReplace() which returns not serializable object
- object containing writeReplace() which returns serializable object
- no infinite loop with writeReplace() which returns class of its own type
- object containing writeObject() and not serializable field
- object containing writeObject() and serializable field
- object of serializable subclass with more fields than superclass (SPARK-7180)
- crazy nested objects
- improveException
- improveException with error in debugger
LoggingSuite:
- spark-shell logging filter
NettyRpcHandlerSuite:
- receive
- connectionTerminated
SamplingUtilsSuite:
- reservoirSampleAndCount
- SPARK-18678 reservoirSampleAndCount with tiny input
- computeFraction
TimeStampedHashMapSuite:
- HashMap - basic test
- TimeStampedHashMap - basic test
- TimeStampedHashMap - threading safety test
- TimeStampedHashMap - clearing by timestamp
RandomSamplerSuite:
- utilities
- sanity check medianKSD against references
- bernoulli sampling
- bernoulli sampling without iterator
- bernoulli sampling with gap sampling optimization
- bernoulli sampling (without iterator) with gap sampling optimization
- bernoulli boundary cases
- bernoulli (without iterator) boundary cases
- bernoulli data types
- bernoulli clone
- bernoulli set seed
- replacement sampling
- replacement sampling without iterator
- replacement sampling with gap sampling
- replacement sampling (without iterator) with gap sampling
- replacement boundary cases
- replacement (without) boundary cases
- replacement data types
- replacement clone
- replacement set seed
- bernoulli partitioning sampling
- bernoulli partitioning sampling without iterator
- bernoulli partitioning boundary cases
- bernoulli partitioning (without iterator) boundary cases
- bernoulli partitioning data
- bernoulli partitioning clone
ChunkedByteBufferOutputStreamSuite:
- empty output
- write a single byte
- write a single near boundary
- write a single at boundary
- single chunk output
- single chunk output at boundary size
- multiple chunk output
- multiple chunk output at boundary size
*** RUN ABORTED ***
  java.lang.OutOfMemoryError: Java heap space
  at java.base/java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:61)
  at java.base/java.nio.ByteBuffer.allocate(ByteBuffer.java:348)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite.$anonfun$new$23(ChunkedByteBufferOutputStreamSuite.scala:125)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite.$anonfun$new$23$adapted(ChunkedByteBufferOutputStreamSuite.scala:125)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite$$Lambda$8660/0x0000000842563040.apply(Unknown Source)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStream.allocateNewChunkIfNeeded(ChunkedByteBufferOutputStream.scala:87)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStream.write(ChunkedByteBufferOutputStream.scala:75)
  at java.base/java.io.OutputStream.write(OutputStream.java:122)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite.$anonfun$new$22(ChunkedByteBufferOutputStreamSuite.scala:127)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite$$Lambda$933/0x00000008408d0440.apply(Unknown Source)
  ...
[INFO] 
[INFO] --------------< org.apache.spark:spark-mllib-local_2.12 >---------------
[INFO] Building Spark Project ML Local Library 3.0.4-SNAPSHOT           [10/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-mllib-local_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-mllib-local_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-mllib-local_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-mllib-local_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/mllib-local/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/mllib-local/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-mllib-local_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/typelevel/spire-macros_2.12/0.17.0-M1/spire-macros_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/pl/edu/icm/JLargeArrays/1.5/JLargeArrays-1.5.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.1.1/scala-collection-compat_2.12-2.1.1.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/scalanlp/breeze-macros_2.12/1.0/breeze-macros_2.12-1.0.jar:/home/jenkins/.m2/repository/com/github/wendykierp/JTransforms/3.1/JTransforms-3.1.jar:/home/jenkins/.m2/repository/org/typelevel/spire-platform_2.12/0.17.0-M1/spire-platform_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/org/typelevel/macro-compat_2.12/1.1.1/macro-compat_2.12-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar:/home/jenkins/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/home/jenkins/.m2/repository/com/chuusai/shapeless_2.12/2.3.3/shapeless_2.12-2.3.3.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/typelevel/machinist_2.12/0.6.8/machinist_2.12-0.6.8.jar:/home/jenkins/.m2/repository/org/typelevel/spire-util_2.12/0.17.0-M1/spire-util_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/org/scalanlp/breeze_2.12/1.0/breeze_2.12-1.0.jar:/home/jenkins/.m2/repository/org/typelevel/spire_2.12/0.17.0-M1/spire_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/org/typelevel/algebra_2.12/2.0.0-M2/algebra_2.12-2.0.0-M2.jar:/home/jenkins/.m2/repository/com/github/fommil/netlib/core/1.1.2/core-1.1.2.jar:/home/jenkins/.m2/repository/org/typelevel/cats-kernel_2.12/2.0.0-M4/cats-kernel_2.12-2.0.0-M4.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-mllib-local_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-mllib-local_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/mllib-local/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-mllib-local_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-mllib-local_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 5 Scala sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/mllib-local/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 12.4 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-mllib-local_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-mllib-local_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/mllib-local/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-mllib-local_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-mllib-local_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/scalanlp/breeze-macros_2.12/1.0/breeze-macros_2.12-1.0.jar:/home/jenkins/.m2/repository/com/github/wendykierp/JTransforms/3.1/JTransforms-3.1.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.10/byte-buddy-agent-1.9.10.jar:/home/jenkins/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/scalanlp/breeze_2.12/1.0/breeze_2.12-1.0.jar:/home/jenkins/.m2/repository/org/typelevel/spire_2.12/0.17.0-M1/spire_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/typelevel/algebra_2.12/2.0.0-M2/algebra_2.12-2.0.0-M2.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.14.2/scalacheck_2.12-1.14.2.jar:/home/jenkins/.m2/repository/com/github/fommil/netlib/core/1.1.2/core-1.1.2.jar:/home/jenkins/.m2/repository/org/typelevel/spire-macros_2.12/0.17.0-M1/spire-macros_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/pl/edu/icm/JLargeArrays/1.5/JLargeArrays-1.5.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.1.1/scala-collection-compat_2.12-2.1.1.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/typelevel/spire-platform_2.12/0.17.0-M1/spire-platform_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/org/typelevel/macro-compat_2.12/1.1.1/macro-compat_2.12-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/com/chuusai/shapeless_2.12/2.3.3/shapeless_2.12-2.3.3.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/typelevel/machinist_2.12/0.6.8/machinist_2.12-0.6.8.jar:/home/jenkins/.m2/repository/org/typelevel/spire-util_2.12/0.17.0-M1/spire-util_2.12-0.17.0-M1.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.1.0/mockito-core-3.1.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.9.10/byte-buddy-1.9.10.jar:/home/jenkins/.m2/repository/org/typelevel/cats-kernel_2.12/2.0.0-M4/cats-kernel_2.12-2.0.0-M4.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-mllib-local_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 10 Scala sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/mllib-local/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 16.8 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-mllib-local_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-mllib-local_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-mllib-local_2.12 ---
Discovery starting.
Discovery completed in 258 milliseconds.
Run starting. Expected test count is: 95
BLASSuite:
Nov 21, 2021 6:39:46 PM com.github.fommil.netlib.BLAS <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
Nov 21, 2021 6:39:46 PM com.github.fommil.netlib.BLAS <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeRefBLAS
- nativeL1Threshold
- copy
- scal
- axpy
- dot
- spr
- syr
- gemm
- gemv
- spmv
UtilsSuite:
- EPSILON
TestingUtilsSuite:
- Comparing doubles using relative error.
- Comparing doubles using absolute error.
- Comparing vectors using relative error.
- Comparing vectors using absolute error.
- Comparing Matrices using absolute error.
- Comparing Matrices using relative error.
BreezeMatrixConversionSuite:
- dense matrix to breeze
- dense breeze matrix to matrix
- sparse matrix to breeze
- sparse breeze matrix to sparse matrix
BreezeVectorConversionSuite:
- dense to breeze
- sparse to breeze
- dense breeze to vector
- sparse breeze to vector
- sparse breeze with partially-used arrays to vector
MultivariateGaussianSuite:
Nov 21, 2021 6:39:47 PM com.github.fommil.netlib.LAPACK <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeSystemLAPACK
Nov 21, 2021 6:39:47 PM com.github.fommil.netlib.LAPACK <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeRefLAPACK
- univariate
- multivariate
- multivariate degenerate
- SPARK-11302
MatricesSuite:
- dense matrix construction
- dense matrix construction with wrong dimension
- sparse matrix construction
- sparse matrix construction with wrong number of elements
- index in matrices incorrect input
- equals
- matrix copies are deep copies
- matrix indexing and updating
- dense to dense
- dense to sparse
- sparse to sparse
- sparse to dense
- compressed dense
- compressed sparse
- map, update
- transpose
- foreachActive
- horzcat, vertcat, eye, speye
- zeros
- ones
- eye
- rand
- randn
- diag
- sprand
- sprandn
- toString
- numNonzeros and numActives
- fromBreeze with sparse matrix
- row/col iterator
VectorsSuite:
- dense vector construction with varargs
- dense vector construction from a double array
- sparse vector construction
- sparse vector construction with unordered elements
- sparse vector construction with mismatched indices/values array
- sparse vector construction with too many indices vs size
- sparse vector construction with negative indices
- dense to array
- dense argmax
- sparse to array
- sparse argmax
- vector equals
- vectors equals with explicit 0
- indexing dense vectors
- indexing sparse vectors
- zeros
- Vector.copy
- fromBreeze
- sqdist
- foreach
- foreachActive
- foreachNonZero
- vector p-norm
- Vector numActive and numNonzeros
- Vector toSparse and toDense
- Vector.compressed
- SparseVector.slice
- sparse vector only support non-negative length
- dot product only supports vectors of same size
- dense vector dot product
- sparse vector dot product
- mixed sparse and dense vector dot product
- iterator
- activeIterator
- nonZeroIterator
Run completed in 2 seconds, 196 milliseconds.
Total number of tests run: 95
Suites: completed 9, aborted 0
Tests: succeeded 95, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project GraphX
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Streaming
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Catalyst
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project SQL
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project ML Library
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] -----------------< org.apache.spark:spark-tools_2.12 >------------------
[INFO] Building Spark Project Tools 3.0.4-SNAPSHOT                      [11/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-tools_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-tools_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/tools/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/tools/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-tools_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm/7.1/asm-7.1.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-tree/7.1/asm-tree-7.1.jar:/home/jenkins/.m2/repository/org/clapper/grizzled-scala_2.12/4.9.3/grizzled-scala_2.12-4.9.3.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-compiler/2.12.10/scala-compiler-2.12.10.jar:/home/jenkins/.m2/repository/org/clapper/classutil_2.12/1.5.1/classutil_2.12-1.5.1.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-analysis/7.1/asm-analysis-7.1.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-commons/7.1/asm-commons-7.1.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.0.0/scala-collection-compat_2.12-2.0.0.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-util/7.1/asm-util-7.1.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-tools_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/tools/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-tools_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-tools_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 1 Scala source to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/tools/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 4.5 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-tools_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-tools_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/tools/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-tools_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-tools_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm/7.1/asm-7.1.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-tree/7.1/asm-tree-7.1.jar:/home/jenkins/.m2/repository/org/clapper/grizzled-scala_2.12/4.9.3/grizzled-scala_2.12-4.9.3.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-compiler/2.12.10/scala-compiler-2.12.10.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/clapper/classutil_2.12/1.5.1/classutil_2.12-1.5.1.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-analysis/7.1/asm-analysis-7.1.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-commons/7.1/asm-commons-7.1.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.0.0/scala-collection-compat_2.12-2.0.0.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-util/7.1/asm-util-7.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-tools_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-tools_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-tools_2.12 ---
Discovery starting.
Discovery completed in 102 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 154 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Hive
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project REPL
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --------------< org.apache.spark:spark-network-yarn_2.12 >--------------
[INFO] Building Spark Project YARN Shuffle Service 3.0.4-SNAPSHOT       [12/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (module-timestamp-property) @ spark-network-yarn_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (local-timestamp-property) @ spark-network-yarn_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:regex-property (regex-property) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-network-yarn_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-network-yarn_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-yarn/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-yarn/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-network-yarn_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-network-yarn_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-yarn/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-network-yarn_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-network-yarn_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 3 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-yarn/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 0.3 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-network-yarn_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-network-yarn_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-yarn/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-network-yarn_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-network-yarn_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-network-yarn_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-network-yarn_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-network-yarn_2.12 ---
Discovery starting.
Discovery completed in 90 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 138 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project YARN
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Mesos
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Hive Thrift Server
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Assembly
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Kafka 0.10+ Token Provider for Streaming
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Integration for Kafka 0.10
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Kafka 0.10+ Source for Structured Streaming
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Kinesis Integration
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Examples
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Integration for Kafka 0.10 Assembly
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Avro
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Kinesis Assembly
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.4-SNAPSHOT:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [  2.807 s]
[INFO] Spark Project Tags ................................. SUCCESS [  7.264 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 22.006 s]
[INFO] Spark Project Local DB ............................. SUCCESS [  4.749 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 51.032 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  8.400 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 13.346 s]
[INFO] Spark Project Launcher ............................. SUCCESS [  5.275 s]
[INFO] Spark Project Core ................................. FAILURE [06:41 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 33.209 s]
[INFO] Spark Project GraphX ............................... SKIPPED
[INFO] Spark Project Streaming ............................ SKIPPED
[INFO] Spark Project Catalyst ............................. SKIPPED
[INFO] Spark Project SQL .................................. SKIPPED
[INFO] Spark Project ML Library ........................... SKIPPED
[INFO] Spark Project Tools ................................ SUCCESS [  5.674 s]
[INFO] Spark Project Hive ................................. SKIPPED
[INFO] Spark Project REPL ................................. SKIPPED
[INFO] Spark Project YARN Shuffle Service ................. SUCCESS [  2.021 s]
[INFO] Spark Project YARN ................................. SKIPPED
[INFO] Spark Project Mesos ................................ SKIPPED
[INFO] Spark Project Hive Thrift Server ................... SKIPPED
[INFO] Spark Project Assembly ............................. SKIPPED
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SKIPPED
[INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
[INFO] Spark Kinesis Integration .......................... SKIPPED
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
[INFO] Spark Avro ......................................... SKIPPED
[INFO] Spark Project Kinesis Assembly ..................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  09:18 min
[INFO] Finished at: 2021-11-21T18:39:56-08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:2.0.0:test (test) on project spark-core_2.12: There are test failures -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :spark-core_2.12
+ retcode2=1
+ [[ 0 -ne 0 ]]
+ [[ 1 -ne 0 ]]
+ [[ 0 -ne 0 ]]
+ [[ 1 -ne 0 ]]
+ echo 'Testing Spark with Maven failed'
Testing Spark with Maven failed
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
Finished: FAILURE