Console Output

Skipping 1,425 KB.. Full Log
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-launcher_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-launcher_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-launcher_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-launcher_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.15__55.0-1.3.1_20191012T045515.jar
[INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null)
[INFO] Compiling 20 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/target/scala-2.12/classes ...
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/src/main/java/org/apache/spark/launcher/LauncherServer.java:270: DEPRECATED_CHILD_CONNECTION_TIMEOUT in org.apache.spark.launcher.SparkLauncher has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/src/main/java/org/apache/spark/launcher/LauncherServer.java:273: DEPRECATED_CHILD_CONNECTION_TIMEOUT in org.apache.spark.launcher.SparkLauncher has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java:99: deprecated item is not annotated with @Deprecated
[INFO] Done compiling.
[INFO] compile in 0.5 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-launcher_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-launcher_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-launcher_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-launcher_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scalatest/scalatest-matchers-core_2.12/3.2.9/scalatest-matchers-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-core_2.12/3.2.9/scalatest-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.6.2/zookeeper-jute-3.6.2.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.40.v20210413/websocket-common-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-propspec_2.12/3.2.9/scalatest-propspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.14/httpcore-4.4.14.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/com/shapesecurity/salvation2/3.0.0/salvation2-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-shouldmatchers_2.12/3.2.9/scalatest-shouldmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.2.9/scalatest_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/neko-htmlunit/2.50.0/neko-htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.50.0/htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.6.2/zookeeper-3.6.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funsuite_2.12/3.2.9/scalatest-funsuite_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-freespec_2.12/3.2.9/scalatest-freespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.12.5/jackson-databind-2.12.5.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/xalan/serializer/2.7.2/serializer-2.7.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/xalan/xalan/2.7.2/xalan-2.7.2.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funspec_2.12/3.2.9/scalatest-funspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-cssparser/1.7.0/htmlunit-cssparser-1.7.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.10.13/byte-buddy-1.10.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-diagrams_2.12/3.2.9/scalatest-diagrams_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-ie-driver/3.141.59/selenium-ie-driver-3.141.59.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/scalatestplus/selenium-3-141_2.12/3.2.9.0/selenium-3-141_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-mustmatchers_2.12/3.2.9/scalatest-mustmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-edge-driver/3.141.59/selenium-edge-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.40.v20210413/websocket-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.10.2/avro-1.10.2.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-wordspec_2.12/3.2.9/scalatest-wordspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.15/scala-reflect-2.12.15.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.2.9/scalactic_2.12-3.2.9.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.68.Final/netty-all-4.1.68.Final.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.15.4/scalacheck_2.12-1.15.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-compatible/3.2.9/scalatest-compatible-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.12.5/jackson-core-2.12.5.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.12.5/jackson-annotations-2.12.5.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-chrome-driver/3.141.59/selenium-chrome-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-opera-driver/3.141.59/selenium-opera-driver-3.141.59.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.10.13/byte-buddy-agent-1.10.13.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-flatspec_2.12/3.2.9/scalatest-flatspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/com/squareup/okio/okio/1.14.0/okio-1.14.0.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.11/jaxb-api-2.2.11.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-support/3.141.59/selenium-support-3.141.59.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.40.v20210413/websocket-api-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-remote-driver/3.141.59/selenium-remote-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpmime/4.5.13/httpmime-4.5.13.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/brotli/dec/0.1.2/dec-0.1.2.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-featurespec_2.12/3.2.9/scalatest-featurespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scalatestplus/mockito-3-4_2.12/3.2.9.0/mockito-3-4_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-api/3.141.59/selenium-api-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-java/3.141.59/selenium-java-3.141.59.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.50.0/htmlunit-core-js-2.50.0.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.4.6/mockito-core-3.4.6.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/htmlunit-driver/2.50.0/htmlunit-driver-2.50.0.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-firefox-driver/3.141.59/selenium-firefox-driver-3.141.59.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-safari-driver/3.141.59/selenium-safari-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/scalatestplus/scalacheck-1-15_2.12/3.2.9.0/scalacheck-1-15_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-refspec_2.12/3.2.9/scalatest-refspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-launcher_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.15__55.0-1.3.1_20191012T045515.jar
[INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null)
[INFO] Compiling 7 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 0.6 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (default-test) @ spark-launcher_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.spark.launcher.LauncherServerSuite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.299 s - in org.apache.spark.launcher.LauncherServerSuite
[INFO] Running org.apache.spark.launcher.CommandBuilderUtilsSuite
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 s - in org.apache.spark.launcher.CommandBuilderUtilsSuite
[INFO] Running org.apache.spark.launcher.InProcessLauncherSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.036 s - in org.apache.spark.launcher.InProcessLauncherSuite
[INFO] Running org.apache.spark.launcher.SparkSubmitOptionParserSuite
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.439 s - in org.apache.spark.launcher.SparkSubmitOptionParserSuite
[INFO] Running org.apache.spark.launcher.SparkSubmitCommandBuilderSuite
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.082 s - in org.apache.spark.launcher.SparkSubmitCommandBuilderSuite
[INFO] Running org.apache.spark.launcher.ChildProcAppHandleSuite
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.12 s - in org.apache.spark.launcher.ChildProcAppHandleSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 46, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (test) @ spark-launcher_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.2:test (test) @ spark-launcher_2.12 ---
Discovery starting.
Discovery completed in 113 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 157 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------< org.apache.spark:spark-core_2.12 >------------------
[INFO] Building Spark Project Core 3.3.0-SNAPSHOT                        [9/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-core_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-core_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.4:format (default) @ spark-core_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (module-timestamp-property) @ spark-core_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (local-timestamp-property) @ spark-core_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-core_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-core_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/net/sf/ehcache/ehcache-core/2.4.4/ehcache-core-2.4.4.jar:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.10.2/avro-mapred-1.10.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.6.2/zookeeper-jute-3.6.2.jar:/home/jenkins/.m2/repository/jakarta/servlet/jakarta.servlet-api/4.0.3/jakarta.servlet-api-4.0.3.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.43.v20210629/jetty-security-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.7.0-M11/json4s-jackson_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.6.2/zookeeper-3.6.2.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-model/1.0.0-M20/api-ldap-model-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-i18n/1.0.0-M20/api-i18n-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.12.5/jackson-databind-2.12.5.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.43.v20210629/jetty-continuation-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.34/jersey-server-2.34.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.2.2/metrics-graphite-4.2.2.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.43.v20210629/jetty-servlet-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.7.0-M11/json4s-core_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.34/jersey-container-servlet-core-2.34.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.10.2/avro-1.10.2.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm9-shaded/4.20/xbean-asm9-shaded-4.20.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.8/xz-1.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.10.0/chill_2.12-0.10.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.43.v20210629/jetty-io-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.15/scala-reflect-2.12.15.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.5.0/ivy-2.5.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.43.v20210629/jetty-server-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.7.0-M11/json4s-scalap_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.68.Final/netty-all-4.1.68.Final.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.4/snappy-java-1.1.8.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-ber/1.0.0-M20/api-asn1-ber-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.12.5/jackson-core-2.12.5.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.12.5/jackson-module-scala_2.12-2.12.5.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.12.5/jackson-annotations-2.12.5.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.9.0/shims-0.9.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.34/jersey-client-2.34.jar:/home/jenkins/.m2/repository/antlr/antlr/2.7.7/antlr-2.7.7.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.10.2/avro-ipc-1.10.2.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.10.0/chill-java-0.10.0.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.11/jaxb-api-2.2.11.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.2.2/metrics-json-4.2.2.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.43.v20210629/jetty-servlets-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.43.v20210629/jetty-jndi-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.2.2/metrics-core-4.2.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.5.0-4/zstd-jni-1.5.0-4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.43.v20210629/jetty-util-ajax-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.2.2/metrics-jvm-4.2.2.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.34/jersey-common-2.34.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.43.v20210629/jetty-plus-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.9.0/RoaringBitmap-0.9.0.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.34/jersey-container-servlet-2.34.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.2.2/metrics-jmx-4.2.2.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.34/jersey-hk2-2.34.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.43.v20210629/jetty-proxy-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/org/apache/mina/mina-core/2.0.7/mina-core-2.0.7.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9.2/py4j-0.10.9.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.7.0-M11/json4s-ast_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:add-source (add-sources) @ spark-core_2.12 ---
[INFO] Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/scala-2.12 added.
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-core_2.12 ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (default) @ spark-core_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-core_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 53 resources
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-core_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-core_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.15__55.0-1.3.1_20191012T045515.jar
[INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null)
[INFO] Compiling 568 Scala sources and 104 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/target/scala-2.12/classes ...
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:184: onNodeUnblacklisted(org.apache.spark.scheduler.SparkListenerNodeUnblacklisted) in org.apache.spark.scheduler.SparkListenerInterface has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:174: onNodeBlacklisted(org.apache.spark.scheduler.SparkListenerNodeBlacklisted) in org.apache.spark.scheduler.SparkListenerInterface has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:162: onExecutorUnblacklisted(org.apache.spark.scheduler.SparkListenerExecutorUnblacklisted) in org.apache.spark.scheduler.SparkListenerInterface has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:150: onNodeBlacklistedForStage(org.apache.spark.scheduler.SparkListenerNodeBlacklistedForStage) in org.apache.spark.scheduler.SparkListenerInterface has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:138: onExecutorBlacklistedForStage(org.apache.spark.scheduler.SparkListenerExecutorBlacklistedForStage) in org.apache.spark.scheduler.SparkListenerInterface has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:128: onExecutorBlacklisted(org.apache.spark.scheduler.SparkListenerExecutorBlacklisted) in org.apache.spark.scheduler.SparkListenerInterface has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:128: org.apache.spark.scheduler.SparkListenerExecutorBlacklisted in org.apache.spark.scheduler has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:139: org.apache.spark.scheduler.SparkListenerExecutorBlacklistedForStage in org.apache.spark.scheduler has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:151: org.apache.spark.scheduler.SparkListenerNodeBlacklistedForStage in org.apache.spark.scheduler has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:163: org.apache.spark.scheduler.SparkListenerExecutorUnblacklisted in org.apache.spark.scheduler has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:174: org.apache.spark.scheduler.SparkListenerNodeBlacklisted in org.apache.spark.scheduler has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/src/main/java/org/apache/spark/SparkFirehoseListener.java:184: org.apache.spark.scheduler.SparkListenerNodeUnblacklisted in org.apache.spark.scheduler has been deprecated
[INFO] Done compiling.
[INFO] compile in 65.6 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-core_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-core_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 89 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-core_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-core_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scalatest/scalatest-matchers-core_2.12/3.2.9/scalatest-matchers-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core/2.0.0-M15/apacheds-core-2.0.0-M15.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-core_2.12/3.2.9/scalatest-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.6.2/zookeeper-jute-3.6.2.jar:/home/jenkins/.m2/repository/jakarta/servlet/jakarta.servlet-api/4.0.3/jakarta.servlet-api-4.0.3.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-propspec_2.12/3.2.9/scalatest-propspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.7.0-M11/json4s-jackson_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/com/shapesecurity/salvation2/3.0.0/salvation2-3.0.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.2.9/scalatest_2.12-3.2.9.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/neko-htmlunit/2.50.0/neko-htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.6.2/zookeeper-3.6.2.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-model/1.0.0-M20/api-ldap-model-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-i18n/1.0.0-M20/api-i18n-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-authn/2.0.0-M15/apacheds-interceptors-authn-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-jdbm-partition/2.0.0-M15/apacheds-jdbm-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.12.5/jackson-databind-2.12.5.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/bouncycastle/bcprov-jdk15/140/bcprov-jdk15-140.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/jakarta/xml/bind/jakarta.xml.bind-api/2.3.3/jakarta.xml.bind-api-2.3.3.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.10.13/byte-buddy-1.10.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-diagrams_2.12/3.2.9/scalatest-diagrams_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/test-framework/providers/jersey-test-framework-provider-simple/2.34/jersey-test-framework-provider-simple-2.34.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.2.2/metrics-graphite-4.2.2.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-client-api/1.0.0-M20/api-ldap-client-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-edge-driver/3.141.59/selenium-edge-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-mustmatchers_2.12/3.2.9/scalatest-mustmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/org/simpleframework/simple-transport/6.0.1/simple-transport-6.0.1.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.10.2/avro-1.10.2.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-util/1.0.0-M20/api-ldap-extras-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-aci/1.0.0-M20/api-ldap-extras-aci-1.0.0-M20.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/org/apache/directory/jdbm/apacheds-jdbm1/2.0.0-M2/apacheds-jdbm1-2.0.0-M2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/curator/curator-test/2.7.1/curator-test-2.7.1.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.15/scala-reflect-2.12.15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-normalization/2.0.0-M15/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-shared/2.0.0-M15/apacheds-core-shared-2.0.0-M15.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.68.Final/netty-all-4.1.68.Final.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-minikdc/2.7.4/hadoop-minikdc-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptor-kerberos/2.0.0-M15/apacheds-interceptor-kerberos-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.4/snappy-java-1.1.8.4.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.12.5/jackson-core-2.12.5.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.9.0/shims-0.9.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.34/jersey-client-2.34.jar:/home/jenkins/.m2/repository/antlr/antlr/2.7.7/antlr-2.7.7.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/jakarta/activation/jakarta.activation-api/1.2.2/jakarta.activation-api-1.2.2.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.10.13/byte-buddy-agent-1.10.13.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.10.2/avro-ipc-1.10.2.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/com/squareup/okio/okio/1.14.0/okio-1.14.0.jar:/home/jenkins/.m2/repository/org/apache/derby/derby/10.14.2.0/derby-10.14.2.0.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.11/jaxb-api-2.2.11.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.43.v20210629/jetty-servlets-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-authz/2.0.0-M15/apacheds-interceptors-authz-2.0.0-M15.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-shuffle/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.5.0-4/zstd-jni-1.5.0-4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.43.v20210629/jetty-util-ajax-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.2.2/metrics-jvm-4.2.2.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-remote-driver/3.141.59/selenium-remote-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpmime/4.5.13/httpmime-4.5.13.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-protocol-shared/2.0.0-M15/apacheds-protocol-shared-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-featurespec_2.12/3.2.9/scalatest-featurespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scalatestplus/mockito-3-4_2.12/3.2.9.0/mockito-3-4_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.43.v20210629/jetty-plus-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.4.6/mockito-core-3.4.6.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.2.2/metrics-jmx-4.2.2.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-codec-api/1.0.0-M20/api-ldap-extras-codec-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/htmlunit-driver/2.50.0/htmlunit-driver-2.50.0.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-codec-core/1.0.0-M20/api-ldap-codec-core-1.0.0-M20.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9.2/py4j-0.10.9.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-trigger/2.0.0-M15/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/test-framework/jersey-test-framework-core/2.34/jersey-test-framework-core-2.34.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-all/1.0.0-M20/api-all-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-refspec_2.12/3.2.9/scalatest-refspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/jenkins/.m2/repository/net/sf/ehcache/ehcache-core/2.4.4/ehcache-core-2.4.4.jar:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.10.2/avro-mapred-1.10.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-changelog/2.0.0-M15/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.40.v20210413/websocket-common-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.43.v20210629/jetty-security-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.14/httpcore-4.4.14.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-shouldmatchers_2.12/3.2.9/scalatest-shouldmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.50.0/htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-constants/2.0.0-M15/apacheds-core-constants-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funsuite_2.12/3.2.9/scalatest-funsuite_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-simple-http/2.34/jersey-container-simple-http-2.34.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-freespec_2.12/3.2.9/scalatest-freespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-protocol-ldap/2.0.0-M15/apacheds-protocol-ldap-2.0.0-M15.jar:/home/jenkins/.m2/repository/xalan/serializer/2.7.2/serializer-2.7.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-codec/1.0.0-M20/api-ldap-extras-codec-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/xalan/xalan/2.7.2/xalan-2.7.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-schema/2.0.0-M15/apacheds-interceptors-schema-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funspec_2.12/3.2.9/scalatest-funspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-cssparser/1.7.0/htmlunit-cssparser-1.7.0.jar:/home/jenkins/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.43.v20210629/jetty-continuation-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.34/jersey-server-2.34.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.43.v20210629/jetty-servlet-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-ie-driver/3.141.59/selenium-ie-driver-3.141.59.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.7.0-M11/json4s-core_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.34/jersey-container-servlet-core-2.34.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/scalatestplus/selenium-3-141_2.12/3.2.9.0/selenium-3-141_2.12-3.2.9.0.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/directory/mavibot/mavibot/1.0.0-M1/mavibot-1.0.0-M1.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.40.v20210413/websocket-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.43.v20210629/jetty-webapp-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-xdbm-partition/2.0.0-M15/apacheds-xdbm-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm9-shaded/4.20/xbean-asm9-shaded-4.20.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.8/xz-1.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-avl/2.0.0-M15/apacheds-core-avl-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-trigger/1.0.0-M20/api-ldap-extras-trigger-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-wordspec_2.12/3.2.9/scalatest-wordspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.10.0/chill_2.12-0.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-ldap-extras-sp/1.0.0-M20/api-ldap-extras-sp-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.43.v20210629/jetty-io-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.5.0/ivy-2.5.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.43.v20210629/jetty-server-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.7.0-M11/json4s-scalap_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.2.9/scalactic_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.15.4/scalacheck_2.12-1.15.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-compatible/3.2.9/scalatest-compatible-3.2.9.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.43.v20210629/jetty-xml-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/home/jenkins/.m2/repository/org/simpleframework/simple-common/6.0.1/simple-common-6.0.1.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-ber/1.0.0-M20/api-asn1-ber-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.12.5/jackson-module-scala_2.12-2.12.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.12.5/jackson-annotations-2.12.5.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-chrome-driver/3.141.59/selenium-chrome-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-opera-driver/3.141.59/selenium-opera-driver-3.141.59.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-mavibot-partition/2.0.0-M15/apacheds-mavibot-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-flatspec_2.12/3.2.9/scalatest-flatspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-core-api/2.0.0-M15/apacheds-core-api-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.10.0/chill-java-0.10.0.jar:/home/jenkins/.m2/repository/org/simpleframework/simple-http/6.0.1/simple-http-6.0.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.2.2/metrics-json-4.2.2.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-support/3.141.59/selenium-support-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-aws/2.7.4/hadoop-aws-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-subtree/2.0.0-M15/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.40.v20210413/websocket-api-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-referral/2.0.0-M15/apacheds-interceptors-referral-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.43.v20210629/jetty-jndi-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.2.2/metrics-core-4.2.2.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.34/jersey-common-2.34.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-protocol-kerberos/2.0.0-M15/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/brotli/dec/0.1.2/dec-0.1.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-ldif-partition/2.0.0-M15/apacheds-ldif-partition-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-admin/2.0.0-M15/apacheds-interceptors-admin-2.0.0-M15.jar:/home/jenkins/.m2/repository/commons-pool/commons-pool/1.6/commons-pool-1.6.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-api/3.141.59/selenium-api-3.141.59.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-java/3.141.59/selenium-java-3.141.59.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.50.0/htmlunit-core-js-2.50.0.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.9.0/RoaringBitmap-0.9.0.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-collective/2.0.0-M15/apacheds-interceptors-collective-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.34/jersey-container-servlet-2.34.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-event/2.0.0-M15/apacheds-interceptors-event-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.34/jersey-hk2-2.34.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.43.v20210629/jetty-proxy-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-exception/2.0.0-M15/apacheds-interceptors-exception-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.34/jersey-media-jaxb-2.34.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-operational/2.0.0-M15/apacheds-interceptors-operational-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/mina/mina-core/2.0.7/mina-core-2.0.7.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-firefox-driver/3.141.59/selenium-firefox-driver-3.141.59.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.7.0-M11/json4s-ast_2.12-3.7.0-M11.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-safari-driver/3.141.59/selenium-safari-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-interceptors-journal/2.0.0-M15/apacheds-interceptors-journal-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/scalatestplus/scalacheck-1-15_2.12/3.2.9.0/scalacheck-1-15_2.12-3.2.9.0.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-core_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.15__55.0-1.3.1_20191012T045515.jar
[INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null)
[INFO] Compiling 314 Scala sources and 28 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/core/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 73.0 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (default-test) @ spark-core_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running test.org.apache.spark.JavaAPISuite
[ERROR] WARNING: An illegal reflective access operation has occurred
[ERROR] WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar) to method sun.security.krb5.Config.getInstance()
[ERROR] WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
[ERROR] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[ERROR] WARNING: All illegal access operations will be denied in a future release
[INFO] Tests run: 92, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.297 s - in test.org.apache.spark.JavaAPISuite
[INFO] Running test.org.apache.spark.Java8RDDAPISuite
[INFO] Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.75 s - in test.org.apache.spark.Java8RDDAPISuite
[INFO] Running test.org.apache.spark.JavaSparkContextSuite
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.148 s - in test.org.apache.spark.JavaSparkContextSuite
[INFO] Running org.apache.spark.JavaJdbcRDDSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.099 s - in org.apache.spark.JavaJdbcRDDSuite
[INFO] Running org.apache.spark.unsafe.map.BytesToBytesMapOffHeapSuite
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.742 s - in org.apache.spark.unsafe.map.BytesToBytesMapOffHeapSuite
[INFO] Running org.apache.spark.unsafe.map.BytesToBytesMapOnHeapSuite
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.339 s - in org.apache.spark.unsafe.map.BytesToBytesMapOnHeapSuite
[INFO] Running org.apache.spark.io.ReadAheadInputStreamSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.977 s - in org.apache.spark.io.ReadAheadInputStreamSuite
[INFO] Running org.apache.spark.io.NioBufferedInputStreamSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.167 s - in org.apache.spark.io.NioBufferedInputStreamSuite
[INFO] Running org.apache.spark.resource.JavaResourceProfileSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 s - in org.apache.spark.resource.JavaResourceProfileSuite
[INFO] Running org.apache.spark.api.java.OptionalSuite
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 s - in org.apache.spark.api.java.OptionalSuite
[INFO] Running org.apache.spark.memory.TaskMemoryManagerSuite
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 s - in org.apache.spark.memory.TaskMemoryManagerSuite
[INFO] Running org.apache.spark.launcher.SparkLauncherSuite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.262 s - in org.apache.spark.launcher.SparkLauncherSuite
[INFO] Running org.apache.spark.shuffle.sort.ShuffleInMemorySorterSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.151 s - in org.apache.spark.shuffle.sort.ShuffleInMemorySorterSuite
[INFO] Running org.apache.spark.shuffle.sort.ShuffleInMemoryRadixSorterSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 s - in org.apache.spark.shuffle.sort.ShuffleInMemoryRadixSorterSuite
[INFO] Running org.apache.spark.shuffle.sort.UnsafeShuffleWriterSuite
[INFO] Tests run: 27, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.819 s - in org.apache.spark.shuffle.sort.UnsafeShuffleWriterSuite
[INFO] Running org.apache.spark.shuffle.sort.PackedRecordPointerSuite
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.apache.spark.shuffle.sort.PackedRecordPointerSuite
[INFO] Running org.apache.spark.util.SerializableConfigurationSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.112 s - in org.apache.spark.util.SerializableConfigurationSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterSuite
[INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.756 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterRadixSortSuite
[INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.785 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeExternalSorterRadixSortSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterSuite
[INFO] Running org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterRadixSortSuite
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s - in org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorterRadixSortSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 262, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (test) @ spark-core_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.2:test (test) @ spark-core_2.12 ---
Discovery starting.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar) to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Discovery completed in 8 seconds, 105 milliseconds.
Run starting. Expected test count is: 2870
ExternalSorterSuite:
- empty data stream with kryo ser
- empty data stream with java ser
- few elements per partition with kryo ser
- few elements per partition with java ser
- empty partitions with spilling with kryo ser
- empty partitions with spilling with java ser
- spilling in local cluster with kryo ser
- spilling in local cluster with java ser
- spilling in local cluster with many reduce tasks with kryo ser
- spilling in local cluster with many reduce tasks with java ser
- cleanup of intermediate files in sorter
- cleanup of intermediate files in sorter with failures
- cleanup of intermediate files in shuffle
- cleanup of intermediate files in shuffle with failures
- no sorting or partial aggregation with kryo ser
- no sorting or partial aggregation with java ser
- no sorting or partial aggregation with spilling with kryo ser
- no sorting or partial aggregation with spilling with java ser
- sorting, no partial aggregation with kryo ser
- sorting, no partial aggregation with java ser
- sorting, no partial aggregation with spilling with kryo ser
- sorting, no partial aggregation with spilling with java ser
- partial aggregation, no sorting with kryo ser
- partial aggregation, no sorting with java ser
- partial aggregation, no sorting with spilling with kryo ser
- partial aggregation, no sorting with spilling with java ser
- partial aggregation and sorting with kryo ser
- partial aggregation and sorting with java ser
- partial aggregation and sorting with spilling with kryo ser
- partial aggregation and sorting with spilling with java ser
- sort without breaking sorting contracts with kryo ser
- sort without breaking sorting contracts with java ser
- sort without breaking timsort contracts for large arrays !!! IGNORED !!!
- spilling with hash collisions
- spilling with many hash collisions
- spilling with hash collisions using the Int.MaxValue key
- spilling with null keys and values
- sorting updates peak execution memory
- force to spill for external sorter
DAGSchedulerSuite:
- [SPARK-3353] parent stage should have lower stage id
- [SPARK-13902] Ensure no duplicate stages are created
- All shuffle files on the storage endpoint should be cleaned up when it is lost
- SPARK-32003: All shuffle files for executor should be cleaned up on fetch failure
- zero split job
- run trivial job
- run trivial job w/ dependency
- equals and hashCode AccumulableInfo
- cache location preferences w/ dependency
- regression test for getCacheLocs
- getMissingParentStages should consider all ancestor RDDs' cache statuses
- avoid exponential blowup when getting preferred locs list
- unserializable task
- trivial job failure
- trivial job cancellation
- job cancellation no-kill backend
- run trivial shuffle
- run trivial shuffle with fetch failure
- shuffle files not lost when executor process lost with shuffle service
- shuffle files lost when worker lost with shuffle service
- shuffle files lost when worker lost without shuffle service
- shuffle files not lost when executor failure with shuffle service
- shuffle files lost when executor failure without shuffle service
- SPARK-28967 properties must be cloned before posting to listener bus for 0 partition
- Single stage fetch failure should not abort the stage.
- Multiple consecutive stage fetch failures should lead to job being aborted.
- Failures in different stages should not trigger an overall abort
- Non-consecutive stage failures don't trigger abort
- trivial shuffle with multiple fetch failures
- Retry all the tasks on a resubmitted attempt of a barrier stage caused by FetchFailure
- Retry all the tasks on a resubmitted attempt of a barrier stage caused by TaskKilled
- Fail the job if a barrier ResultTask failed
- late fetch failures don't cause multiple concurrent attempts for the same map stage
- extremely late fetch failures don't cause multiple concurrent attempts for the same stage
- task events always posted in speculation / when stage is killed
- ignore late map task completions
- run shuffle with map stage failure
- shuffle fetch failure in a reused shuffle dependency
- don't submit stage until its dependencies map outputs are registered (SPARK-5259)
- register map outputs correctly after ExecutorLost and task Resubmitted
- failure of stage used by two jobs
- stage used by two jobs, the first no longer active (SPARK-6880)
- stage used by two jobs, some fetch failures, and the first job no longer active (SPARK-6880)
- run trivial shuffle with out-of-band executor failure and retry
- recursive shuffle failures
- cached post-shuffle
- SPARK-30388: shuffle fetch failed on speculative task, but original task succeed
- misbehaved accumulator should not crash DAGScheduler and SparkContext
- misbehaved accumulator should not impact other accumulators
- misbehaved resultHandler should not crash DAGScheduler and SparkContext
- invalid spark.job.interruptOnCancel should not crash DAGScheduler
- getPartitions exceptions should not crash DAGScheduler and SparkContext (SPARK-8606)
- getPreferredLocations errors should not crash DAGScheduler and SparkContext (SPARK-8606)
- accumulator not calculated for resubmitted result stage
- accumulator not calculated for resubmitted task in result stage
- accumulators are updated on exception failures and task killed
- reduce tasks should be placed locally with map output
- reduce task locality preferences should only include machines with largest map outputs
- stages with both narrow and shuffle dependencies use narrow ones for locality
- Spark exceptions should include call site in stack trace
- catch errors in event loop
- simple map stage submission
- map stage submission with reduce stage also depending on the data
- map stage submission with fetch failure
- map stage submission with multiple shared stages and failures
- Trigger mapstage's job listener in submitMissingTasks
- map stage submission with executor failure late map task completions
- getShuffleDependenciesAndResourceProfiles correctly returns only direct shuffle parents
- SPARK-17644: After one stage is aborted for too many failed attempts, subsequent stagesstill behave correctly on fetch failures
- [SPARK-19263] DAGScheduler should not submit multiple active tasksets, even with late completions from earlier stage attempts
- task end event should have updated accumulators (SPARK-20342)
- Barrier task failures from the same stage attempt don't trigger multiple stage retries
- Barrier task failures from a previous stage attempt don't trigger stage retry
- SPARK-25341: abort stage while using old fetch protocol
- SPARK-25341: retry all the succeeding stages when the map stage is indeterminate
- SPARK-25341: continuous indeterminate stage roll back
- SPARK-29042: Sampled RDD with unordered input should be indeterminate
- SPARK-23207: cannot rollback a result stage
- SPARK-23207: local checkpoint fail to rollback (checkpointed before)
- SPARK-23207: local checkpoint fail to rollback (checkpointing now)
- SPARK-23207: reliable checkpoint can avoid rollback (checkpointed before)
- SPARK-23207: reliable checkpoint fail to rollback (checkpointing now)
- SPARK-27164: RDD.countApprox on empty RDDs schedules jobs which never complete
- Completions in zombie tasksets update status of non-zombie taskset
- test default resource profile
- test 1 resource profile
- test 2 resource profiles errors by default
- test 2 resource profile with merge conflict config true
- test multiple resource profiles created from merging use same rp
- test merge 2 resource profiles multiple configs
- test merge 3 resource profiles
- getShuffleDependenciesAndResourceProfiles returns deps and profiles correctly
- SPARK-32920: shuffle merge finalization
- SPARK-32920: merger locations not empty
- SPARK-32920: merger locations reuse from shuffle dependency
- SPARK-32920: Disable shuffle merge due to not enough mergers available
- SPARK-32920: Ensure child stage should not start before all the parent stages are completed with shuffle merge finalized for all the parent stages
- SPARK-32920: Reused ShuffleDependency with Shuffle Merge disabled for the corresponding ShuffleDependency should not cause DAGScheduler to hang
- SPARK-32920: Reused ShuffleDependency with Shuffle Merge disabled for the corresponding ShuffleDependency with shuffle data loss should recompute missing partitions
- SPARK-32920: Empty RDD should not be computed
- SPARK-32920: Merge results should be unregistered if the running stage is cancelled before shuffle merge is finalized
- SPARK-32920: SPARK-35549: Merge results should not get registered after shuffle merge finalization
- SPARK-32920: Disable push based shuffle in the case of a barrier stage
- SPARK-32920: metadata fetch failure should not unregister map status
- SPARK-32923: handle stage failure for indeterminate map stage with push-based shuffle
FsHistoryProviderSuite:
- Parse application logs (inMemory = true)
- Parse application logs (inMemory = false)
- SPARK-31608: parse application logs with HybridStore
- SPARK-3697: ignore files that cannot be read.
- history file is renamed from inprogress to completed
- Parse logs that application is not started
- SPARK-5582: empty log directory
- apps with multiple attempts with order
- log urls without customization
- custom log urls, including FILE_NAME
- custom log urls, excluding FILE_NAME
- custom log urls with invalid attribute
- custom log urls, LOG_FILES not available while FILE_NAME is specified
- custom log urls, app not finished, applyIncompleteApplication: true
- custom log urls, app not finished, applyIncompleteApplication: false
- log cleaner
- should not clean inprogress application with lastUpdated time less than maxTime
- log cleaner for inProgress files
- Event log copy
- driver log cleaner
- SPARK-8372: new logs with no app ID are ignored
- provider correctly checks whether fs is in safe mode
- provider waits for safe mode to finish before initializing
- provider reports error after FS leaves safe mode
- ignore hidden files
- support history server ui admin acls
- mismatched version discards old listing
- invalidate cached UI
- clean up stale app information
- SPARK-21571: clean up removes invalid history files
- always find end event for finished apps
- parse event logs with optimizations off
- SPARK-24948: ignore files we don't have read permission on
- check in-progress event logs absolute length
- log cleaner with the maximum number of log files
- backwards compatibility with LogInfo from Spark 2.4
- SPARK-29755 LogInfo should be serialized/deserialized by jackson properly
- SPARK-29755 AttemptInfoWrapper should be serialized/deserialized by jackson properly
- SPARK-29043: clean up specified event log
- compact event log files
- SPARK-33146: don't let one bad rolling log folder prevent loading other applications
- SPARK-36354: EventLogFileReader should skip rolling event log directories with no logs
- SPARK-33215: check ui view permissions without retrieving ui
RDDSuite:
- basic operations
- serialization
- distinct with known partitioner preserves partitioning
- countApproxDistinct
- SparkContext.union
- SparkContext.union parallel partition listing
- SparkContext.union creates UnionRDD if at least one RDD has no partitioner
- SparkContext.union creates PartitionAwareUnionRDD if all RDDs have partitioners
- PartitionAwareUnionRDD raises exception if at least one RDD has no partitioner
- SPARK-23778: empty RDD in union should not produce a UnionRDD
- partitioner aware union
- UnionRDD partition serialized size should be small
- fold
- fold with op modifying first arg
- aggregate
- treeAggregate
- treeAggregate with ops modifying first args
- SPARK-36419: treeAggregate with finalAggregateOnExecutor set to true
- treeReduce
- basic caching
- caching with failures
- empty RDD
- repartitioned RDDs
- repartitioned RDDs perform load balancing
- coalesced RDDs
- coalesced RDDs with locality
- coalesced RDDs with partial locality
- coalesced RDDs with locality, large scale (10K partitions)
- coalesced RDDs with partial locality, large scale (10K partitions)
- coalesced RDDs with locality, fail first pass
- zipped RDDs
- partition pruning
- collect large number of empty partitions
- take
- top with predefined ordering
- top with custom ordering
- takeOrdered with predefined ordering
- takeOrdered with limit 0
- takeOrdered with custom ordering
- isEmpty
- sample preserves partitioner
- takeSample
- takeSample from an empty rdd
- randomSplit
- runJob on an invalid partition
- sort an empty RDD
- sortByKey
- sortByKey ascending parameter
- sortByKey with explicit ordering
- repartitionAndSortWithinPartitions
- SPARK-32384: repartitionAndSortWithinPartitions without shuffle
- cartesian on empty RDD
- cartesian on non-empty RDDs
- intersection
- intersection strips duplicates in an input
- zipWithIndex
- zipWithIndex with a single partition
- zipWithIndex chained with other RDDs (SPARK-4433)
- zipWithUniqueId
- retag with implicit ClassTag
- parent method
- getNarrowAncestors
- getNarrowAncestors with multiple parents
- getNarrowAncestors with cycles
- task serialization exception should not hang scheduler
- RDD.partitions() fails fast when partitions indices are incorrect (SPARK-13021)
- nested RDDs are not supported (SPARK-5063)
- actions cannot be performed inside of transformations (SPARK-5063)
- custom RDD coalescer
- SPARK-18406: race between end-of-task and completion iterator read lock release
- SPARK-27666: Do not release lock while TaskContext already completed
- SPARK-23496: order of input partitions can result in severe skew in coalesce
- cannot run actions after SparkContext has been stopped (SPARK-5063)
- cannot call methods on a stopped SparkContext (SPARK-5063)
ExecutorSuite:
- SPARK-15963: Catch `TaskKilledException` correctly in Executor.TaskRunner
- SPARK-19276: Handle FetchFailedExceptions that are hidden by user exceptions
- Executor's worker threads should be UninterruptibleThread
- SPARK-19276: OOMs correctly handled with a FetchFailure
- SPARK-23816: interrupts are not masked by a FetchFailure
- Gracefully handle error in task deserialization
- Heartbeat should drop zero accumulator updates
- Heartbeat should not drop zero accumulator updates when the conf is disabled
- Send task executor metrics in DirectTaskResult
- Send task executor metrics in TaskKilled
- Send task executor metrics in ExceptionFailure
- SPARK-34949: do not re-register BlockManager when executor is shutting down
- SPARK-33587: isFatalError
SerDeUtilSuite:
- Converting an empty pair RDD to python does not throw an exception (SPARK-5441)
- Converting an empty python RDD to pair RDD does not throw an exception (SPARK-5441)
UtilsSuite:
- timeConversion
- Test byteString conversion
- bytesToString
- copyStream
- copyStreamUpTo
- memoryStringToMb
- splitCommandString
- string formatting of time durations
- reading offset bytes of a file
- reading offset bytes of a file (compressed)
- reading offset bytes across multiple files
- reading offset bytes across multiple files (compressed)
- deserialize long value
- writeByteBuffer should not change ByteBuffer position
- get iterator size
- getIteratorZipWithIndex
- SPARK-35907: createDirectory
- doesDirectoryContainFilesNewerThan
- resolveURI
- resolveURIs with multiple paths
- nonLocalPaths
- isBindCollision
- log4j log level change
- deleteRecursively
- loading properties from file
- timeIt with prepare
- fetch hcfs dir
- shutdown hook manager
- isInDirectory
- circular buffer: if nothing was written to the buffer, display nothing
- circular buffer: if the buffer isn't full, print only the contents written
- circular buffer: data written == size of the buffer
- circular buffer: multiple overflow
- isDynamicAllocationEnabled
- getDynamicAllocationInitialExecutors
- Set Spark CallerContext
- encodeFileNameToURIRawPath
- decodeFileNameInURI
- Kill process
- chi square test of randomizeInPlace
- redact sensitive information
- redact sensitive information in command line args
- redact sensitive information in sequence of key value pairs
- tryWithSafeFinally
- tryWithSafeFinallyAndFailureCallbacks
- load extensions
- check Kubernetes master URL
- stringHalfWidth
- trimExceptCRLF standalone
- pathsToMetadata
- checkHost supports both IPV4 and IPV6
- checkHostPort support IPV6 and IPV4
- parseHostPort support IPV6 and IPV4
- executorOffHeapMemorySizeAsMb when MEMORY_OFFHEAP_ENABLED is false
- executorOffHeapMemorySizeAsMb when MEMORY_OFFHEAP_ENABLED is true
- executorMemoryOverhead when MEMORY_OFFHEAP_ENABLED is true, but MEMORY_OFFHEAP_SIZE not config scene
- isPushBasedShuffleEnabled when PUSH_BASED_SHUFFLE_ENABLED and SHUFFLE_SERVICE_ENABLED are both set to true in YARN mode with maxAttempts set to 1
PagedDataSourceSuite:
- basic
CheckpointStorageSuite:
- checkpoint compression
- cache checkpoint preferred location
- SPARK-31484: checkpoint should not fail in retry
SortingSuite:
- sortByKey
- large array
- large array with one split
- large array with many partitions
- sort descending
- sort descending with one split
- sort descending with many partitions
- more partitions than elements
- empty RDD
- partition balancing
- partition balancing for descending sort
- get a range of elements in a sorted RDD that is on one partition
- get a range of elements over multiple partitions in a descendingly sorted RDD
- get a range of elements in an array not partitioned by a range partitioner
- get a range of elements over multiple partitions but not taking up full partitions
RpcAddressSuite:
- hostPort
- fromSparkURL
- fromSparkURL: a typo url
- fromSparkURL: invalid scheme
- toSparkURL
JavaSerializerSuite:
- JavaSerializer instances are serializable
- Deserialize object containing a primitive Class as attribute
LocalDirsSuite:
- Utils.getLocalDir() returns a valid directory, even if some local dirs are missing
- SPARK_LOCAL_DIRS override also affects driver
- Utils.getLocalDir() throws an exception if any temporary directory cannot be retrieved
TaskContextSuite:
- provide metrics sources
- calls TaskCompletionListener after failure
- calls TaskFailureListeners after failure
- all TaskCompletionListeners should be called even if some fail
- all TaskFailureListeners should be called even if some fail
- TaskContext.attemptNumber should return attempt number, not task id (SPARK-4014)
- TaskContext.stageAttemptNumber getter
- accumulators are updated on exception failures
- failed tasks collect only accumulators whose values count during failures
- only updated internal accumulators will be sent back to driver
- localProperties are propagated to executors correctly
- immediately call a completion listener if the context is completed
- immediately call a failure listener if the context has failed
- TaskCompletionListenerException.getMessage should include previousError
- all TaskCompletionListeners should be called even if some fail or a task
HistoryServerSuite:
- application list json
- completed app list json
- running app list json
- minDate app list json
- maxDate app list json
- maxDate2 app list json
- minEndDate app list json
- maxEndDate app list json
- minEndDate and maxEndDate app list json
- minDate and maxEndDate app list json
- limit app list json
- one app json
- one app multi-attempt json
- job list json
- job list from multi-attempt app json(1)
- job list from multi-attempt app json(2)
- one job json
- succeeded job list json
- succeeded&failed job list json
- executor list json
- executor list with executor metrics json
- stage list json
- complete stage list json
- failed stage list json
- one stage json
- one stage json with details
- one stage attempt json
- one stage attempt json details with failed task
- stage task summary w shuffle write
- stage task summary w shuffle read
- stage task summary w/ custom quantiles
- stage task list
- stage task list w/ offset & length
- stage task list w/ sortBy
- stage task list w/ sortBy short names: -runtime
- stage task list w/ sortBy short names: runtime
- stage task list w/ status
- stage task list w/ status & offset & length
- stage task list w/ status & sortBy short names: runtime
- stage list with accumulable json
- stage with accumulable json
- stage task list from multi-attempt app json(1)
- stage task list from multi-attempt app json(2)
- excludeOnFailure for stage
- excludeOnFailure node for stage
- rdd list storage json
- executor node excludeOnFailure
- executor node excludeOnFailure unexcluding
- executor memory usage
- executor resource information
- multiple resource profiles
- stage list with peak metrics
- stage with peak metrics
- stage with summaries
- app environment
- one rdd storage json
- miscellaneous process
- download all logs for app with multiple attempts
- download one log for app with multiple attempts
- response codes on bad paths
- automatically retrieve uiRoot from request through Knox
- static relative links are prefixed with uiRoot (spark.ui.proxyBase)
- /version api endpoint
- security manager starts with spark.authenticate set
- incomplete apps get refreshed
- ui and api authorization checks
- SPARK-33215: speed up event log download by skipping UI rebuild
- access history application defaults to the last attempt id
- SPARK-31697: HistoryServer should set Content-Type
- Redirect to the root page when accessed to /history/
NextIteratorSuite:
- one iteration
- two iterations
- empty iteration
- close is called once for empty iterations
- close is called once for non-empty iterations
ParallelCollectionSplitSuite:
- one element per slice
- one slice
- equal slices
- non-equal slices
- splitting exclusive range
- splitting inclusive range
- empty data
- zero slices
- negative number of slices
- exclusive ranges sliced into ranges
- inclusive ranges sliced into ranges
- identical slice sizes between Range and NumericRange
- identical slice sizes between List and NumericRange
- large ranges don't overflow
- random array tests
- random exclusive range tests
- random inclusive range tests
- exclusive ranges of longs
- inclusive ranges of longs
- exclusive ranges of doubles
- inclusive ranges of doubles
- inclusive ranges with Int.MaxValue and Int.MinValue
- empty ranges with Int.MaxValue and Int.MinValue
UISeleniumSuite:
- all jobs page should be rendered even though we configure the scheduling mode to fair
- effects of unpersist() / persist() should be reflected
- failed stages should not appear to be active
- spark.ui.killEnabled should properly control kill button display
- jobs page should not display job group name unless some job was submitted in a job group
- job progress bars should handle stage / task failures
- job details page should display useful information for stages that haven't started
- job progress bars / cells reflect skipped stages / tasks
- stages that aren't run appear as 'skipped stages' after a job finishes
- jobs with stages that are skipped should show correct link descriptions on all jobs page
- attaching and detaching a new tab
- kill stage POST/GET response is correct
- kill job POST/GET response is correct
- stage & job retention
- live UI json application list
- job stages should have expected dotfile under DAG visualization
- stages page should show skipped stages
- Staleness of Spark UI should not last minutes or hours
- description for empty jobs
HadoopDelegationTokenManagerSuite:
- default configuration
- disable hadoopfs credential provider
- using deprecated configurations
- SPARK-29082: do not fail if current user does not have credentials
RollingEventLogFilesWriterSuite:
- create EventLogFileWriter with enable/disable rolling
- initialize, write, stop - with codec None
- initialize, write, stop - with codec Some(lz4)
- initialize, write, stop - with codec Some(lzf)
- initialize, write, stop - with codec Some(snappy)
- initialize, write, stop - with codec Some(zstd)
- Use the defalut value of spark.eventLog.compression.codec
- Event log names
- Log overwriting
- rolling event log files - codec None
- rolling event log files - codec Some(lz4)
- rolling event log files - codec Some(lzf)
- rolling event log files - codec Some(snappy)
- rolling event log files - codec Some(zstd)
- rolling event log files - the max size of event log file size less than lower limit
RandomBlockReplicationPolicyBehavior:
- block replication - random block replication policy
RDDCleanerSuite:
- RDD shuffle cleanup standalone
LocalDiskShuffleMapOutputWriterSuite:
- writing to an outputstream
- writing to a channel
TestMemoryManagerSuite:
- tracks allocated execution memory by task
- markconsequentOOM
ResourceProfileManagerSuite:
- ResourceProfileManager
- isSupported yarn no dynamic allocation
- isSupported yarn with dynamic allocation
- isSupported k8s with dynamic allocation
- isSupported with local mode
- ResourceProfileManager has equivalent profile
ExecutorRunnerTest:
- command includes appId
BlockTransferServiceSuite:
- fetchBlockSync should not hang when BlockFetchingListener.onBlockFetchSuccess fails
EventLoggingListenerSuite:
- Basic event logging with compression
- End-to-end event logging
- End-to-end event logging with compression
- Event logging with password redaction
- Spark-33504 sensitive attributes redaction in properties
- Executor metrics update
- SPARK-31764: isBarrier should be logged in event log
PluginContainerSuite:
- plugin initialization and communication
- do nothing if plugins are not configured
- merging of config options
- SPARK-33088: executor tasks trigger plugin calls
- SPARK-33088: executor failed tasks trigger plugin calls
- plugin initialization in non-local mode
- plugin initialization in non-local mode with resources
DriverRunnerTest:
- Process succeeds instantly
- Process failing several times and then succeeding
- Process doesn't restart if not supervised
- Process doesn't restart if killed
- Reset of backoff counter
- Kill process finalized with state KILLED
- Finalized with state FINISHED
- Finalized with state FAILED
- Handle exception starting process
PrefixComparatorsSuite:
- String prefix comparator
- Binary prefix comparator
- double prefix comparator handles NaNs properly
- double prefix comparator handles negative NaNs properly
- double prefix comparator handles other special values properly
NettyBlockTransferSecuritySuite:
- security default off
- security on same password
- security on mismatch password
- security mismatch auth off on server
- security mismatch auth off on client
- security with aes encryption
CommandUtilsSuite:
- set libraryPath correctly
- auth secret shouldn't appear in java opts
PairRDDFunctionsSuite:
- aggregateByKey
- groupByKey
- groupByKey with duplicates
- groupByKey with negative key hash codes
- groupByKey with many output partitions
- sampleByKey
- sampleByKeyExact
- reduceByKey
- reduceByKey with collectAsMap
- reduceByKey with many output partitions
- reduceByKey with partitioner
- countApproxDistinctByKey
- join
- join all-to-all
- leftOuterJoin
- cogroup with empty RDD
- cogroup with groupByed RDD having 0 partitions
- cogroup between multiple RDD with an order of magnitude difference in number of partitions
- cogroup between multiple RDD with number of partitions similar in order of magnitude
- cogroup between multiple RDD when defaultParallelism is set without proper partitioner
- cogroup between multiple RDD when defaultParallelism is set with proper partitioner
- cogroup between multiple RDD when defaultParallelism is set; with huge number of partitions in upstream RDDs
- rightOuterJoin
- fullOuterJoin
- join with no matches
- join with many output partitions
- groupWith
- groupWith3
- groupWith4
- zero-partition RDD
- keys and values
- default partitioner uses partition size
- default partitioner uses largest partitioner
- subtract
- subtract with narrow dependency
- subtractByKey
- subtractByKey with narrow dependency
- foldByKey
- foldByKey with mutable result type
- saveNewAPIHadoopFile should call setConf if format is configurable
- The JobId on the driver and executors should be the same during the commit
- saveAsHadoopFile should respect configured output committers
- failure callbacks should be called before calling writer.close() in saveNewAPIHadoopFile
- failure callbacks should be called before calling writer.close() in saveAsHadoopFile
- saveAsNewAPIHadoopDataset should support invalid output paths when there are no files to be committed to an absolute output location
- saveAsHadoopDataset should respect empty output directory when there are no files to be committed to an absolute output location
- lookup
- lookup with partitioner
- lookup with bad partitioner
RBackendSuite:
- close() clears jvmObjectTracker
PrimitiveVectorSuite:
- primitive value
- non-primitive value
- ideal growth
- ideal size
- resizing
MetricsConfigSuite:
- MetricsConfig with default properties
- MetricsConfig with properties set from a file
- MetricsConfig with properties set from a Spark configuration
- MetricsConfig with properties set from a file and a Spark configuration
- MetricsConfig with subProperties
PartiallySerializedBlockSuite:
- valuesIterator() and finishWritingToStream() cannot be called after discard() is called
- discard() can be called more than once
- cannot call valuesIterator() more than once
- cannot call finishWritingToStream() more than once
- cannot call finishWritingToStream() after valuesIterator()
- cannot call valuesIterator() after finishWritingToStream()
- buffers are deallocated in a TaskCompletionListener
- basic numbers with discard() and numBuffered = 50
- basic numbers with finishWritingToStream() and numBuffered = 50
- basic numbers with valuesIterator() and numBuffered = 50
- basic numbers with discard() and numBuffered = 0
- basic numbers with finishWritingToStream() and numBuffered = 0
- basic numbers with valuesIterator() and numBuffered = 0
- basic numbers with discard() and numBuffered = 1000
- basic numbers with finishWritingToStream() and numBuffered = 1000
- basic numbers with valuesIterator() and numBuffered = 1000
- case classes with discard() and numBuffered = 50
- case classes with finishWritingToStream() and numBuffered = 50
- case classes with valuesIterator() and numBuffered = 50
- case classes with discard() and numBuffered = 0
- case classes with finishWritingToStream() and numBuffered = 0
- case classes with valuesIterator() and numBuffered = 0
- case classes with discard() and numBuffered = 1000
- case classes with finishWritingToStream() and numBuffered = 1000
- case classes with valuesIterator() and numBuffered = 1000
- empty iterator with discard() and numBuffered = 0
- empty iterator with finishWritingToStream() and numBuffered = 0
- empty iterator with valuesIterator() and numBuffered = 0
SparkContextSchedulerCreationSuite:
- bad-master
- local
- local-*
- local-n
- local-*-n-failures
- local-n-failures
- bad-local-n
- bad-local-n-failures
- local-default-parallelism
- local-cluster
SerializationDebuggerSuite:
- primitives, strings, and nulls
- primitive arrays
- non-primitive arrays
- serializable object
- nested arrays
- nested objects
- cycles (should not loop forever)
- root object not serializable
- array containing not serializable element
- object containing not serializable field
- externalizable class writing out not serializable object
- externalizable class writing out serializable objects
- object containing writeReplace() which returns not serializable object
- object containing writeReplace() which returns serializable object
- no infinite loop with writeReplace() which returns class of its own type
- object containing writeObject() and not serializable field
- object containing writeObject() and serializable field
- object of serializable subclass with more fields than superclass (SPARK-7180)
- crazy nested objects
- improveException
- improveException with error in debugger
LoggingSuite:
- spark-shell logging filter
NettyRpcHandlerSuite:
- receive
- connectionTerminated
SamplingUtilsSuite:
- reservoirSampleAndCount
- SPARK-18678 reservoirSampleAndCount with tiny input
- computeFraction
TimeStampedHashMapSuite:
- HashMap - basic test
- TimeStampedHashMap - basic test
- TimeStampedHashMap - threading safety test
- TimeStampedHashMap - clearing by timestamp
RandomSamplerSuite:
- utilities
- sanity check medianKSD against references
- bernoulli sampling
- bernoulli sampling without iterator
- bernoulli sampling with gap sampling optimization
- bernoulli sampling (without iterator) with gap sampling optimization
- bernoulli boundary cases
- bernoulli (without iterator) boundary cases
- bernoulli data types
- bernoulli clone
- bernoulli set seed
- replacement sampling
- replacement sampling without iterator
- replacement sampling with gap sampling
- replacement sampling (without iterator) with gap sampling
- replacement boundary cases
- replacement (without) boundary cases
- replacement data types
- replacement clone
- replacement set seed
- bernoulli partitioning sampling
- bernoulli partitioning sampling without iterator
- bernoulli partitioning boundary cases
- bernoulli partitioning (without iterator) boundary cases
- bernoulli partitioning data
- bernoulli partitioning clone
ChunkedByteBufferOutputStreamSuite:
- empty output
- write a single byte
- write a single near boundary
- write a single at boundary
- single chunk output
- single chunk output at boundary size
- multiple chunk output
- multiple chunk output at boundary size
*** RUN ABORTED ***
  java.lang.OutOfMemoryError: Java heap space
  at java.base/java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:61)
  at java.base/java.nio.ByteBuffer.allocate(ByteBuffer.java:348)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite.$anonfun$new$23(ChunkedByteBufferOutputStreamSuite.scala:125)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite.$anonfun$new$23$adapted(ChunkedByteBufferOutputStreamSuite.scala:125)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite$$Lambda$9370/0x0000000842750840.apply(Unknown Source)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStream.allocateNewChunkIfNeeded(ChunkedByteBufferOutputStream.scala:87)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStream.write(ChunkedByteBufferOutputStream.scala:75)
  at java.base/java.io.OutputStream.write(OutputStream.java:122)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite.$anonfun$new$22(ChunkedByteBufferOutputStreamSuite.scala:127)
  at org.apache.spark.util.io.ChunkedByteBufferOutputStreamSuite$$Lambda$981/0x000000084090dc40.apply(Unknown Source)
  ...
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project ML Local Library
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project GraphX
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Streaming
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Catalyst
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project SQL
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project ML Library
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] -----------------< org.apache.spark:spark-tools_2.12 >------------------
[INFO] Building Spark Project Tools 3.3.0-SNAPSHOT                      [10/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.4:format (default) @ spark-tools_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-tools_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/tools/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/tools/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-tools_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm/7.1/asm-7.1.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-tree/7.1/asm-tree-7.1.jar:/home/jenkins/.m2/repository/org/clapper/grizzled-scala_2.12/4.9.3/grizzled-scala_2.12-4.9.3.jar:/home/jenkins/.m2/repository/org/clapper/classutil_2.12/1.5.1/classutil_2.12-1.5.1.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-compiler/2.12.15/scala-compiler-2.12.15.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-analysis/7.1/asm-analysis-7.1.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.15/scala-reflect-2.12.15.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-commons/7.1/asm-commons-7.1.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.0.0/scala-collection-compat_2.12-2.0.0.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-util/7.1/asm-util-7.1.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-tools_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/tools/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-tools_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-tools_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.15__55.0-1.3.1_20191012T045515.jar
[INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null)
[INFO] Compiling 1 Scala source to /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/tools/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 4.5 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-tools_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-tools_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/tools/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-tools_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-tools_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scalatest/scalatest-matchers-core_2.12/3.2.9/scalatest-matchers-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.2.9/scalactic_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-tree/7.1/asm-tree-7.1.jar:/home/jenkins/.m2/repository/org/clapper/grizzled-scala_2.12/4.9.3/grizzled-scala_2.12-4.9.3.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.15.4/scalacheck_2.12-1.15.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-compatible/3.2.9/scalatest-compatible-3.2.9.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-core_2.12/3.2.9/scalatest-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.40.v20210413/websocket-common-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-propspec_2.12/3.2.9/scalatest-propspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.14/httpcore-4.4.14.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-chrome-driver/3.141.59/selenium-chrome-driver-3.141.59.jar:/home/jenkins/.m2/repository/com/shapesecurity/salvation2/3.0.0/salvation2-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-opera-driver/3.141.59/selenium-opera-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-shouldmatchers_2.12/3.2.9/scalatest-shouldmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.2.9/scalatest_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/neko-htmlunit/2.50.0/neko-htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.50.0/htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.0.0/scala-collection-compat_2.12-2.0.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.10.13/byte-buddy-agent-1.10.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-flatspec_2.12/3.2.9/scalatest-flatspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funsuite_2.12/3.2.9/scalatest-funsuite_2.12-3.2.9.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/com/squareup/okio/okio/1.14.0/okio-1.14.0.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm/7.1/asm-7.1.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-freespec_2.12/3.2.9/scalatest-freespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-support/3.141.59/selenium-support-3.141.59.jar:/home/jenkins/.m2/repository/xalan/serializer/2.7.2/serializer-2.7.2.jar:/home/jenkins/.m2/repository/org/clapper/classutil_2.12/1.5.1/classutil_2.12-1.5.1.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/xalan/xalan/2.7.2/xalan-2.7.2.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.40.v20210413/websocket-api-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funspec_2.12/3.2.9/scalatest-funspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-cssparser/1.7.0/htmlunit-cssparser-1.7.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.10.13/byte-buddy-1.10.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-diagrams_2.12/3.2.9/scalatest-diagrams_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-remote-driver/3.141.59/selenium-remote-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpmime/4.5.13/httpmime-4.5.13.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-ie-driver/3.141.59/selenium-ie-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/home/jenkins/.m2/repository/org/brotli/dec/0.1.2/dec-0.1.2.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-featurespec_2.12/3.2.9/scalatest-featurespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-compiler/2.12.15/scala-compiler-2.12.15.jar:/home/jenkins/.m2/repository/org/scalatestplus/mockito-3-4_2.12/3.2.9.0/mockito-3-4_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-api/3.141.59/selenium-api-3.141.59.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-java/3.141.59/selenium-java-3.141.59.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.50.0/htmlunit-core-js-2.50.0.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.4.6/mockito-core-3.4.6.jar:/home/jenkins/.m2/repository/org/scalatestplus/selenium-3-141_2.12/3.2.9.0/selenium-3-141_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-mustmatchers_2.12/3.2.9/scalatest-mustmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-edge-driver/3.141.59/selenium-edge-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-commons/7.1/asm-commons-7.1.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-util/7.1/asm-util-7.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.40.v20210413/websocket-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/htmlunit-driver/2.50.0/htmlunit-driver-2.50.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-firefox-driver/3.141.59/selenium-firefox-driver-3.141.59.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-wordspec_2.12/3.2.9/scalatest-wordspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-safari-driver/3.141.59/selenium-safari-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/ow2/asm/asm-analysis/7.1/asm-analysis-7.1.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.15/scala-reflect-2.12.15.jar:/home/jenkins/.m2/repository/org/scalatestplus/scalacheck-1-15_2.12/3.2.9.0/scalacheck-1-15_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-refspec_2.12/3.2.9/scalatest-refspec_2.12-3.2.9.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-tools_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (default-test) @ spark-tools_2.12 ---
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (test) @ spark-tools_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.2:test (test) @ spark-tools_2.12 ---
Discovery starting.
Discovery completed in 105 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 135 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Hive
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project REPL
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --------------< org.apache.spark:spark-network-yarn_2.12 >--------------
[INFO] Building Spark Project YARN Shuffle Service 3.3.0-SNAPSHOT       [11/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (module-timestamp-property) @ spark-network-yarn_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:timestamp-property (local-timestamp-property) @ spark-network-yarn_2.12 ---
[WARNING] Using platform locale (en_US actually) to format date/time, i.e. build is platform dependent!
[INFO] 
[INFO] --- build-helper-maven-plugin:3.2.0:regex-property (regex-property) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.4:format (default) @ spark-network-yarn_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-network-yarn_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-yarn/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-yarn/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-network-yarn_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.68.Final/netty-all-4.1.68.Final.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.12.5/jackson-core-2.12.5.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.14/httpcore-4.4.14.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.12.5/jackson-annotations-2.12.5.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.9.0/shims-0.9.0.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.12.5/jackson-databind-2.12.5.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.2.2/metrics-core-4.2.2.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.9.0/RoaringBitmap-0.9.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.10.2/avro-1.10.2.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-network-yarn_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-yarn/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-network-yarn_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-network-yarn_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.15__55.0-1.3.1_20191012T045515.jar
[INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null)
[INFO] Compiling 3 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-yarn/target/scala-2.12/classes ...
[INFO] Done compiling.
[INFO] compile in 0.3 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-network-yarn_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-network-yarn_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-yarn/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-network-yarn_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-network-yarn_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/scalatest/scalatest-matchers-core_2.12/3.2.9/scalatest-matchers-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-core_2.12/3.2.9/scalatest-core_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.6.2/zookeeper-jute-3.6.2.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.40.v20210413/websocket-common-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-propspec_2.12/3.2.9/scalatest-propspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.14/httpcore-4.4.14.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/shapesecurity/salvation2/3.0.0/salvation2-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-shouldmatchers_2.12/3.2.9/scalatest-shouldmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.2.9/scalatest_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/neko-htmlunit/2.50.0/neko-htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.50.0/htmlunit-2.50.0.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.6.2/zookeeper-3.6.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funsuite_2.12/3.2.9/scalatest-funsuite_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-freespec_2.12/3.2.9/scalatest-freespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.12.5/jackson-databind-2.12.5.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/xalan/serializer/2.7.2/serializer-2.7.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/xalan/xalan/2.7.2/xalan-2.7.2.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-funspec_2.12/3.2.9/scalatest-funspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-cssparser/1.7.0/htmlunit-cssparser-1.7.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.10.13/byte-buddy-1.10.13.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-diagrams_2.12/3.2.9/scalatest-diagrams_2.12-3.2.9.jar:/home/jenkins/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-ie-driver/3.141.59/selenium-ie-driver-3.141.59.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/scalatestplus/selenium-3-141_2.12/3.2.9.0/selenium-3-141_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-mustmatchers_2.12/3.2.9/scalatest-mustmatchers_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-edge-driver/3.141.59/selenium-edge-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.40.v20210413/websocket-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.10.2/avro-1.10.2.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/scalatest/scalatest-wordspec_2.12/3.2.9/scalatest-wordspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.15/scala-reflect-2.12.15.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.2.9/scalactic_2.12-3.2.9.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.68.Final/netty-all-4.1.68.Final.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.15.4/scalacheck_2.12-1.15.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-compatible/3.2.9/scalatest-compatible-3.2.9.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.12.5/jackson-core-2.12.5.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.12.5/jackson-annotations-2.12.5.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.9.0/shims-0.9.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-chrome-driver/3.141.59/selenium-chrome-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-opera-driver/3.141.59/selenium-opera-driver-3.141.59.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.10.13/byte-buddy-agent-1.10.13.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-flatspec_2.12/3.2.9/scalatest-flatspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/com/squareup/okio/okio/1.14.0/okio-1.14.0.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.11/jaxb-api-2.2.11.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-support/3.141.59/selenium-support-3.141.59.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.40.v20210413/websocket-api-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.2.2/metrics-core-4.2.2.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-remote-driver/3.141.59/selenium-remote-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpmime/4.5.13/httpmime-4.5.13.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/brotli/dec/0.1.2/dec-0.1.2.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-featurespec_2.12/3.2.9/scalatest-featurespec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/org/scalatestplus/mockito-3-4_2.12/3.2.9.0/mockito-3-4_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-api/3.141.59/selenium-api-3.141.59.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-java/3.141.59/selenium-java-3.141.59.jar:/home/jenkins/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.50.0/htmlunit-core-js-2.50.0.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.4.6/mockito-core-3.4.6.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.9.0/RoaringBitmap-0.9.0.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/htmlunit-driver/2.50.0/htmlunit-driver-2.50.0.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-jdk-11/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-firefox-driver/3.141.59/selenium-firefox-driver-3.141.59.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/seleniumhq/selenium/selenium-safari-driver/3.141.59/selenium-safari-driver-3.141.59.jar:/home/jenkins/.m2/repository/org/scalatestplus/scalacheck-1-15_2.12/3.2.9.0/scalacheck-1-15_2.12-3.2.9.0.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest-refspec_2.12/3.2.9/scalatest-refspec_2.12-3.2.9.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-network-yarn_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (default-test) @ spark-network-yarn_2.12 ---
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M5:test (test) @ spark-network-yarn_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.2:test (test) @ spark-network-yarn_2.12 ---
Discovery starting.
Discovery completed in 125 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 159 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project YARN
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Mesos
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Hive Thrift Server
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Assembly
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Kafka 0.10+ Token Provider for Streaming
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Integration for Kafka 0.10
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Kafka 0.10+ Source for Structured Streaming
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Kinesis Integration
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Examples
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Integration for Kafka 0.10 Assembly
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Avro
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Kinesis Assembly
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.3.0-SNAPSHOT:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [  3.429 s]
[INFO] Spark Project Tags ................................. SUCCESS [  7.963 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 25.203 s]
[INFO] Spark Project Local DB ............................. SUCCESS [  5.420 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 54.098 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  9.786 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 11.055 s]
[INFO] Spark Project Launcher ............................. SUCCESS [  4.664 s]
[INFO] Spark Project Core ................................. FAILURE [06:38 min]
[INFO] Spark Project ML Local Library ..................... SKIPPED
[INFO] Spark Project GraphX ............................... SKIPPED
[INFO] Spark Project Streaming ............................ SKIPPED
[INFO] Spark Project Catalyst ............................. SKIPPED
[INFO] Spark Project SQL .................................. SKIPPED
[INFO] Spark Project ML Library ........................... SKIPPED
[INFO] Spark Project Tools ................................ SUCCESS [  5.700 s]
[INFO] Spark Project Hive ................................. SKIPPED
[INFO] Spark Project REPL ................................. SKIPPED
[INFO] Spark Project YARN Shuffle Service ................. SUCCESS [  2.187 s]
[INFO] Spark Project YARN ................................. SKIPPED
[INFO] Spark Project Mesos ................................ SKIPPED
[INFO] Spark Project Hive Thrift Server ................... SKIPPED
[INFO] Spark Project Assembly ............................. SKIPPED
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SKIPPED
[INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
[INFO] Spark Kinesis Integration .......................... SKIPPED
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
[INFO] Spark Avro ......................................... SKIPPED
[INFO] Spark Project Kinesis Assembly ..................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  08:49 min
[INFO] Finished at: 2021-09-20T10:07:03-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:2.0.2:test (test) on project spark-core_2.12: There are test failures -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :spark-core_2.12
+ retcode2=1
+ [[ 0 -ne 0 ]]
+ [[ 1 -ne 0 ]]
+ [[ 0 -ne 0 ]]
+ [[ 1 -ne 0 ]]
+ echo 'Testing Spark with Maven failed'
Testing Spark with Maven failed
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
Finished: FAILURE