Console Output

Skipping 10,558 KB.. Full Log
00C0: 66 10 63 41 4D C5 AA D5   8F 32 38 E4 DA B0 C3 A4  f.cAM....28.....
00D0: B9 42 31 23 42 83 CC 4C   65 3A 52 FD 58 FC 97 B3  .B1#B..Le:R.X...
00E0: DF 28 E3 B2 4D 82 63 C1   8C 11 AE 4F 79 EE E0 5A  .(..M.c....Oy..Z
00F0: D6 BF B3 8E 1A 22 ED 18   DB 65 41 D5 9F 7C BD FE  ....."...eA.....
0100: 37 36 89 46 A5 A5 11 32   90 9D 6D 8E DA 92 77 C0  76.F...2..m...w.
0110: 10 2C E6 9B 29 76 8A AD   5C 7E B8 15 12 33 77 41  .,..)v..\....3wA
0120: 2D B8 BE B0 80 F9 76 6A   87 FC A4 81 CA 30 81 C7  -.....vj.....0..
0130: A0 03 02 01 11 A2 81 BF   04 81 BC 33 E7 DA E7 EC  ...........3....
0140: 60 45 F7 E0 5B A8 E1 37   F1 27 BB 97 6D CB 83 CD  `E..[..7.'..m...
0150: 5D 99 24 D9 C0 6C D0 8E   0C 1D D5 1A 0B D6 7A 99  ].$..l........z.
0160: 40 E1 5A B2 11 6A 73 53   42 8F B9 BD 0B FA 91 DD  @.Z..jsSB.......
0170: 99 01 DE EE 3B 6B FF 6E   3A 1A 05 E6 77 D3 F3 C8  ....;k.n:...w...
0180: 4A 20 59 1D 21 96 26 B1   25 4E 65 6E 2A 41 CE 79  J Y.!.&.%Nen*A.y
0190: 00 85 91 36 FB 85 6F 5E   EC BF E5 DA 71 DE 8C 28  ...6..o^....q..(
01A0: D1 B4 7B 11 C6 C3 97 51   DF 5C 17 5C 4A 88 39 89  .......Q.\.\J.9.
01B0: CA EC E2 95 04 D8 9C 13   0C E2 7A ED E0 F4 B2 C8  ..........z.....
01C0: A9 00 18 4F 91 93 31 BE   93 8F D9 94 D4 30 22 CE  ...O..1......0".
01D0: D4 20 9F 40 CF 8F DF 18   13 B0 13 B3 D4 08 10 D5  . .@............
01E0: 13 E0 2A 5E 54 1D 79 8F   82 7C 73 24 67 87 86 E0  ..*^T.y...s$g...
01F0: F8 5F 26 06 C4 82 44                               ._&...D

Entered Krb5Context.acceptSecContext with state=STATE_NEW
Krb5Context setting peerSeqNumber to: 699870380
Krb5Context setting mySeqNumber to: 699870380
Krb5Context.wrap: data=[01 01 00 00 ]
Krb5Context.wrap: token=[05 04 01 ff 00 0c 00 00 00 00 00 00 29 b7 2c ac 01 01 00 00 27 20 cb f2 61 e5 28 e9 50 58 23 63 ]
Krb5Context.unwrap: token=[05 04 01 ff 00 0c 00 00 00 00 00 00 29 b7 2c ac 01 01 00 00 27 20 cb f2 61 e5 28 e9 50 58 23 63 ]
Krb5Context.unwrap: data=[01 01 00 00 ]
Krb5Context.wrap: data=[01 01 00 00 63 6c 69 65 6e 74 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d ]
Krb5Context.wrap: token=[05 04 00 ff 00 0c 00 00 00 00 00 00 29 b7 2c ac 01 01 00 00 63 6c 69 65 6e 74 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d 7a f8 1d c0 ab bf 8f 20 60 70 af f1 ]
Krb5Context.unwrap: token=[05 04 00 ff 00 0c 00 00 00 00 00 00 29 b7 2c ac 01 01 00 00 63 6c 69 65 6e 74 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d 7a f8 1d c0 ab bf 8f 20 60 70 af f1 ]
Krb5Context.unwrap: data=[01 01 00 00 63 6c 69 65 6e 74 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d ]
- Roundtrip
Found ticket for kafka/localhost@EXAMPLE.COM to go to krbtgt/EXAMPLE.COM@EXAMPLE.COM expiring on Fri Sep 24 02:50:20 PDT 2021
Entered Krb5Context.initSecContext with state=STATE_NEW
Found KeyTab /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-sql/target/tmp/spark-6dbfca05-b36e-439d-b793-d476cc2fb285/kafka.keytab for kafka/localhost@EXAMPLE.COM
Found ticket for kafka/localhost@EXAMPLE.COM to go to krbtgt/EXAMPLE.COM@EXAMPLE.COM expiring on Fri Sep 24 02:50:20 PDT 2021
Found ticket for kafka/localhost@EXAMPLE.COM to go to krbtgt/EXAMPLE.COM@EXAMPLE.COM expiring on Fri Sep 24 02:50:20 PDT 2021
Found ticket for kafka/localhost@EXAMPLE.COM to go to kafka/localhost@EXAMPLE.COM expiring on Fri Sep 24 02:50:20 PDT 2021
Found service ticket in the subjectTicket (hex) = 
0000: 61 82 01 04 30 82 01 00   A0 03 02 01 05 A1 0D 1B  a...0...........
0010: 0B 45 58 41 4D 50 4C 45   2E 43 4F 4D A2 1D 30 1B  .EXAMPLE.COM..0.
0020: A0 03 02 01 03 A1 14 30   12 1B 05 6B 61 66 6B 61  .......0...kafka
0030: 1B 09 6C 6F 63 61 6C 68   6F 73 74 A3 81 CA 30 81  ..localhost...0.
0040: C7 A0 03 02 01 11 A2 81   BF 04 81 BC DF D0 C2 23  ...............#
0050: DF 3E 13 D9 86 69 BC 85   D5 9B 3F 2D 41 F4 3F 5A  .>...i....?-A.?Z
0060: 96 D9 65 69 4E B8 FF 04   44 B6 84 DB 2C A2 E3 8B  ..eiN...D...,...
0070: F4 09 19 1B D5 DC F9 02   0B 22 4C 94 B2 6C EF 79  ........."L..l.y
0080: 3D E5 2F F9 CA 88 50 11   FC A4 BB CD 96 54 D8 CD  =./...P......T..
0090: D9 B4 46 A9 A2 17 47 B8   A3 4F C6 45 CF 13 E0 A7  ..F...G..O.E....
00A0: 5A DD 67 AA EF 76 17 CE   E2 00 94 15 1E A2 8C 27  Z.g..v.........'
00B0: C2 AC 63 FF 0D 75 73 0C   1B A1 EF AF 58 C3 F7 5F  ..c..us.....X.._
00C0: 68 E8 F3 25 9F E9 E0 50   0D 10 F3 E4 09 C0 D9 05  h..%...P........
00D0: BC 24 EA 38 A0 96 38 3A   42 24 DF BF 36 14 54 C8  .$.8..8:B$..6.T.
00E0: 8B 3E 7B 50 F2 FB 0B 88   AD 3E 7D 93 BB 3C 8E D5  .>.P.....>...<..
00F0: 8E 16 FC FE 46 21 76 AB   9D 53 C1 43 B7 DA 63 38  ....F!v..S.C..c8
0100: CC 8C C5 18 6B E3 45 59                            ....k.EY

Client Principal = kafka/localhost@EXAMPLE.COM
Server Principal = kafka/localhost@EXAMPLE.COM
Session Key = EncryptionKey: keyType=17 keyBytes (hex dump)=
0000: 35 9D 78 D8 0A 35 18 36   E3 E5 B3 EB 2B 22 0C 3F  5.x..5.6....+".?


Forwardable Ticket false
Forwarded Ticket false
Proxiable Ticket false
Proxy Ticket false
Postdated Ticket false
Renewable Ticket false
Initial Ticket false
Auth Time = Thu Sep 23 02:50:20 PDT 2021
Start Time = Thu Sep 23 02:50:21 PDT 2021
End Time = Fri Sep 24 02:50:20 PDT 2021
Renew Till = null
Client Addresses  Null 
Krb5Context setting mySeqNumber to: 340512630
Krb5Context setting peerSeqNumber to: 340512630
Created InitSecContextToken:
0000: 01 00 6E 82 01 EF 30 82   01 EB A0 03 02 01 05 A1  ..n...0.........
0010: 03 02 01 0E A2 07 03 05   00 00 00 00 00 A3 82 01  ................
0020: 08 61 82 01 04 30 82 01   00 A0 03 02 01 05 A1 0D  .a...0..........
0030: 1B 0B 45 58 41 4D 50 4C   45 2E 43 4F 4D A2 1D 30  ..EXAMPLE.COM..0
0040: 1B A0 03 02 01 03 A1 14   30 12 1B 05 6B 61 66 6B  ........0...kafk
0050: 61 1B 09 6C 6F 63 61 6C   68 6F 73 74 A3 81 CA 30  a..localhost...0
0060: 81 C7 A0 03 02 01 11 A2   81 BF 04 81 BC DF D0 C2  ................
0070: 23 DF 3E 13 D9 86 69 BC   85 D5 9B 3F 2D 41 F4 3F  #.>...i....?-A.?
0080: 5A 96 D9 65 69 4E B8 FF   04 44 B6 84 DB 2C A2 E3  Z..eiN...D...,..
0090: 8B F4 09 19 1B D5 DC F9   02 0B 22 4C 94 B2 6C EF  .........."L..l.
00A0: 79 3D E5 2F F9 CA 88 50   11 FC A4 BB CD 96 54 D8  y=./...P......T.
00B0: CD D9 B4 46 A9 A2 17 47   B8 A3 4F C6 45 CF 13 E0  ...F...G..O.E...
00C0: A7 5A DD 67 AA EF 76 17   CE E2 00 94 15 1E A2 8C  .Z.g..v.........
00D0: 27 C2 AC 63 FF 0D 75 73   0C 1B A1 EF AF 58 C3 F7  '..c..us.....X..
00E0: 5F 68 E8 F3 25 9F E9 E0   50 0D 10 F3 E4 09 C0 D9  _h..%...P.......
00F0: 05 BC 24 EA 38 A0 96 38   3A 42 24 DF BF 36 14 54  ..$.8..8:B$..6.T
0100: C8 8B 3E 7B 50 F2 FB 0B   88 AD 3E 7D 93 BB 3C 8E  ..>.P.....>...<.
0110: D5 8E 16 FC FE 46 21 76   AB 9D 53 C1 43 B7 DA 63  .....F!v..S.C..c
0120: 38 CC 8C C5 18 6B E3 45   59 A4 81 C9 30 81 C6 A0  8....k.EY...0...
0130: 03 02 01 11 A2 81 BE 04   81 BB 5F 47 6E 92 1F 8E  .........._Gn...
0140: F4 7A E9 73 D3 FC 6A 4D   88 A3 35 39 5B 6F A5 CD  .z.s..jM..59[o..
0150: C2 AC A5 01 55 93 76 91   E6 75 62 7E A0 50 C5 FF  ....U.v..ub..P..
0160: AE 50 BD 9B A4 3E 31 ED   A2 4C 5A 15 64 04 06 5E  .P...>1..LZ.d..^
0170: 7E 0F BC B7 45 42 46 F7   65 93 39 20 47 31 E2 BF  ....EBF.e.9 G1..
0180: B0 7D 47 D9 46 14 3F 9B   24 13 23 CE B2 A5 BC 28  ..G.F.?.$.#....(
0190: 17 E7 65 4A 10 FB 70 24   40 9E DD F1 F0 6A 03 3C  ..eJ..p$@....j.<
01A0: 93 88 14 9B 7B ED 48 F2   BE CD 63 F9 BF AA F7 F6  ......H...c.....
01B0: 12 57 4A 0C 85 F5 9B CD   08 B0 41 99 ED A6 52 10  .WJ.......A...R.
01C0: A6 95 A9 CD A0 34 85 18   8E A6 19 ED 98 EC 09 45  .....4.........E
01D0: 12 30 4E 89 02 C1 87 1D   A1 D4 51 42 44 BF FA F4  .0N.......QBD...
01E0: 38 47 66 5B A3 B1 7B 4E   C4 B0 01 9B E9 BD 1C E8  8Gf[...N........
01F0: 2E 00 18 35 D6                                     ...5.

Entered Krb5Context.acceptSecContext with state=STATE_NEW
Krb5Context setting peerSeqNumber to: 340512630
Krb5Context setting mySeqNumber to: 340512630
Krb5Context.wrap: data=[01 01 00 00 ]
Krb5Context.wrap: token=[05 04 01 ff 00 0c 00 00 00 00 00 00 14 4b cf 76 01 01 00 00 2a 21 f5 d4 10 01 2b 4d b0 66 a2 d1 ]
Krb5Context.unwrap: token=[05 04 01 ff 00 0c 00 00 00 00 00 00 14 4b cf 76 01 01 00 00 2a 21 f5 d4 10 01 2b 4d b0 66 a2 d1 ]
Krb5Context.unwrap: data=[01 01 00 00 ]
Krb5Context.wrap: data=[01 01 00 00 6b 61 66 6b 61 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d ]
Krb5Context.wrap: token=[05 04 00 ff 00 0c 00 00 00 00 00 00 14 4b cf 76 01 01 00 00 6b 61 66 6b 61 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d b6 6c 90 c7 65 d4 f5 80 19 39 d4 d7 ]
Krb5Context.unwrap: token=[05 04 00 ff 00 0c 00 00 00 00 00 00 14 4b cf 76 01 01 00 00 6b 61 66 6b 61 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d b6 6c 90 c7 65 d4 f5 80 19 39 d4 d7 ]
Krb5Context.unwrap: data=[01 01 00 00 6b 61 66 6b 61 2f 6c 6f 63 61 6c 68 6f 73 74 40 45 58 41 4d 50 4c 45 2e 43 4f 4d ]
KafkaSourceOffsetSuite:
- comparison {"t":{"0":1}} <=> {"t":{"0":2}}
- comparison {"t":{"1":0,"0":1}} <=> {"t":{"1":1,"0":2}}
- comparison {"t":{"0":1},"T":{"0":0}} <=> {"t":{"0":2},"T":{"0":1}}
- comparison {"t":{"0":1}} <=> {"t":{"1":1,"0":2}}
- comparison {"t":{"0":1}} <=> {"t":{"1":3,"0":2}}
- basic serialization - deserialization
- OffsetSeqLog serialization - deserialization
- read Spark 2.1.0 offset format
KafkaOffsetReaderSuite:
- SPARK-30656: getOffsetRangesFromUnresolvedOffsets - using specific offsets
- SPARK-30656: getOffsetRangesFromUnresolvedOffsets - using special offsets
- SPARK-30656: getOffsetRangesFromUnresolvedOffsets - multiple topic partitions
- SPARK-30656: getOffsetRangesFromResolvedOffsets
KafkaSinkBatchSuiteV2:
- batch - write to kafka
- batch - partition column and partitioner priorities
- batch - null topic field value, and no topic option
- SPARK-20496: batch - enforce analyzed plans
- batch - unsupported save modes
- generic - write big data with small producer buffer
KafkaSourceStressSuite:
- stress test with multiple topics and partitions
KafkaDontFailOnDataLossSuite:
- failOnDataLoss=false should not return duplicated records: microbatch v1
- failOnDataLoss=false should not return duplicated records: microbatch v2
- failOnDataLoss=false should not return duplicated records: continuous processing
- failOnDataLoss=false should not return duplicated records: batch v1
- failOnDataLoss=false should not return duplicated records: batch v2
KafkaSinkBatchSuiteV1:
- batch - write to kafka
- batch - partition column and partitioner priorities
- batch - null topic field value, and no topic option
- SPARK-20496: batch - enforce analyzed plans
- batch - unsupported save modes
KafkaSparkConfSuite:
- deprecated configs
KafkaContinuousSourceSuite:
- cannot stop Kafka stream
- assign from latest offsets (failOnDataLoss: true)
- assign from earliest offsets (failOnDataLoss: true)
- assign from specific offsets (failOnDataLoss: true)
- assign from specific timestamps (failOnDataLoss: true)
- subscribing topic by name from latest offsets (failOnDataLoss: true)
- subscribing topic by name from earliest offsets (failOnDataLoss: true)
- subscribing topic by name from specific offsets (failOnDataLoss: true)
- subscribing topic by name from specific timestamps (failOnDataLoss: true)
- subscribing topic by pattern from latest offsets (failOnDataLoss: true)
- subscribing topic by pattern from earliest offsets (failOnDataLoss: true)
- subscribing topic by pattern from specific offsets (failOnDataLoss: true)
- subscribing topic by pattern from specific timestamps (failOnDataLoss: true)
- assign from latest offsets (failOnDataLoss: false)
- assign from earliest offsets (failOnDataLoss: false)
- assign from specific offsets (failOnDataLoss: false)
- assign from specific timestamps (failOnDataLoss: false)
- subscribing topic by name from latest offsets (failOnDataLoss: false)
- subscribing topic by name from earliest offsets (failOnDataLoss: false)
- subscribing topic by name from specific offsets (failOnDataLoss: false)
- subscribing topic by name from specific timestamps (failOnDataLoss: false)
- subscribing topic by pattern from latest offsets (failOnDataLoss: false)
- subscribing topic by pattern from earliest offsets (failOnDataLoss: false)
- subscribing topic by pattern from specific offsets (failOnDataLoss: false)
- subscribing topic by pattern from specific timestamps (failOnDataLoss: false)
- bad source options
- unsupported kafka configs
- get offsets from case insensitive parameters
- Kafka column types
- ensure continuous stream is being used
- read Kafka transactional messages: read_committed
- read Kafka transactional messages: read_uncommitted
- SPARK-27494: read kafka record containing null key/values.
KafkaSourceStressForDontFailOnDataLossSuite:
- stress test for failOnDataLoss=false
KafkaContinuousSourceTopicDeletionSuite:
- ensure continuous stream is being used
- subscribing topic by pattern with topic deletions
InternalKafkaProducerPoolSuite:
- Should return same cached instance on calling acquire with same params.
- Should return different cached instances on calling acquire with different params.
- expire instances
- reference counting with concurrent access
Run completed in 14 minutes, 17 seconds.
Total number of tests run: 260
Suites: completed 26, aborted 0
Tests: succeeded 260, failed 0, canceled 0, ignored 4, pending 0
All tests passed.
[INFO] 
[INFO] ---------< org.apache.spark:spark-streaming-kinesis-asl_2.12 >----------
[INFO] Building Spark Kinesis Integration 3.0.4-SNAPSHOT                [25/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-streaming-kinesis-asl_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.10.0/jackson-dataformat-cbor-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-core/1.11.655/aws-java-sdk-core-1.11.655.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-sts/1.11.655/aws-java-sdk-sts-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-cloudwatch/1.11.655/aws-java-sdk-cloudwatch-1.11.655.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kms/1.11.655/aws-java-sdk-kms-1.11.655.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/joda-time/joda-time/2.10.5/joda-time-2.10.5.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-s3/1.11.655/aws-java-sdk-s3-1.11.655.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-dynamodb/1.11.655/aws-java-sdk-dynamodb-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/com/amazonaws/amazon-kinesis-client/1.12.0/amazon-kinesis-client-1.12.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kinesis/1.11.655/aws-java-sdk-kinesis-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/streaming/target/scala-2.12/classes:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/amazonaws/jmespath-java/1.11.655/jmespath-java-1.11.655.jar:/home/jenkins/.m2/repository/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__52.0-1.3.1_20191012T045515.jar
[INFO] Compiling 11 Scala sources and 2 Java sources to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/target/scala-2.12/classes ...
OpenJDK 64-Bit Server VM warning: CodeCache is full. Compiler has been disabled.
OpenJDK 64-Bit Server VM warning: Try increasing the code cache size using -XX:ReservedCodeCacheSize=
CodeCache: size=1048576Kb used=1037186Kb max_used=1042180Kb free=11389Kb
 bounds [0x00007f4e78000000, 0x00007f4eb8000000, 0x00007f4eb8000000]
 total_blobs=250787 nmethods=250141 adapters=549
 compilation: enabled
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala:107: constructor AmazonKinesisClient in class AmazonKinesisClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala:108: method setEndpoint in class AmazonWebServiceClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala:223: constructor AmazonKinesisClient in class AmazonKinesisClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala:224: method setEndpoint in class AmazonWebServiceClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala:142: constructor AmazonKinesisClient in class AmazonKinesisClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala:152: method setEndpoint in class AmazonWebServiceClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala:221: method setRequestCredentials in class AmazonWebServiceRequest is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala:242: method setRequestCredentials in class AmazonWebServiceRequest is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisReceiver.scala:192: constructor Worker in class Worker is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisTestUtils.scala:58: constructor AmazonKinesisClient in class AmazonKinesisClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisTestUtils.scala:59: method setEndpoint in class AmazonWebServiceClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisTestUtils.scala:64: constructor AmazonDynamoDBClient in class AmazonDynamoDBClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisTestUtils.scala:65: method setRegion in class AmazonWebServiceClient is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/SparkAWSCredentials.scala:74: method withLongLivedCredentialsProvider in class Builder is deprecated: see corresponding Javadoc for more information.
[WARNING] 14 warnings found
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java:110: AmazonKinesisClient(com.amazonaws.auth.AWSCredentialsProvider) in com.amazonaws.services.kinesis.AmazonKinesisClient has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java:111: setEndpoint(java.lang.String) in com.amazonaws.AmazonWebServiceClient has been deprecated
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java:157: found raw type: org.apache.spark.streaming.api.java.JavaDStream
  missing type arguments for generic class org.apache.spark.streaming.api.java.JavaDStream<T>
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java:157: unchecked method invocation: method union in class org.apache.spark.streaming.api.java.JavaStreamingContext is applied to given types
  required: org.apache.spark.streaming.api.java.JavaDStream<T>[]
  found: org.apache.spark.streaming.api.java.JavaDStream[]
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java:157: unchecked conversion
  required: org.apache.spark.streaming.api.java.JavaDStream<T>[]
  found:    org.apache.spark.streaming.api.java.JavaDStream[]
[INFO] Done compiling.
[INFO] compile in 18.1 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.10/byte-buddy-agent-1.9.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.40.v20210413/jetty-plus-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.10.0/jackson-dataformat-cbor-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-core/1.11.655/aws-java-sdk-core-1.11.655.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-sts/1.11.655/aws-java-sdk-sts-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-cloudwatch/1.11.655/aws-java-sdk-cloudwatch-1.11.655.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.40.v20210413/jetty-http-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.40.v20210413/jetty-jndi-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.40.v20210413/jetty-util-ajax-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.40.v20210413/jetty-util-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/streaming/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kms/1.11.655/aws-java-sdk-kms-1.11.655.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/com/amazonaws/amazon-kinesis-producer/0.12.8/amazon-kinesis-producer-0.12.8.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/joda-time/joda-time/2.10.5/joda-time-2.10.5.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-s3/1.11.655/aws-java-sdk-s3-1.11.655.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-dynamodb/1.11.655/aws-java-sdk-dynamodb-1.11.655.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.40.v20210413/jetty-xml-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/com/amazonaws/amazon-kinesis-client/1.12.0/amazon-kinesis-client-1.12.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/mockito/mockito-core/3.1.0/mockito-core-3.1.0.jar:/home/jenkins/.m2/repository/net/bytebuddy/byte-buddy/1.9.10/byte-buddy-1.9.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.40.v20210413/jetty-webapp-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kinesis/1.11.655/aws-java-sdk-kinesis-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.40.v20210413/jetty-security-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/streaming/target/scala-2.12/classes:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.40.v20210413/jetty-continuation-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.40.v20210413/jetty-servlet-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.40.v20210413/jetty-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.40.v20210413/jetty-servlets-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.14.2/scalacheck_2.12-1.14.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.40.v20210413/jetty-proxy-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/amazonaws/jmespath-java/1.11.655/jmespath-java-1.11.655.jar:/home/jenkins/.m2/repository/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__52.0-1.3.1_20191012T045515.jar
[INFO] Compiling 8 Scala sources and 1 Java source to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/target/scala-2.12/test-classes ...
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisInputDStreamBuilderSuite.scala:182: method initialPositionInStream in class Builder is deprecated (since 2.3.0): use initialPosition(initialPosition: KinesisInitialPosition)
[WARNING] one warning found
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/test/java/org/apache/spark/streaming/kinesis/JavaKinesisInputDStreamBuilderSuite.java:39: auxiliary class org.apache.spark.streaming.kinesis.KinesisInitialPosition in KinesisInitialPositions.java should not be accessed from outside its own source file
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/src/test/java/org/apache/spark/streaming/kinesis/JavaKinesisInputDStreamBuilderSuite.java:84: initialPositionInStream(com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStream) in org.apache.spark.streaming.kinesis.KinesisInputDStream.Builder has been deprecated
[INFO] Done compiling.
[INFO] compile in 30.2 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.spark.streaming.kinesis.JavaKinesisInputDStreamBuilderSuite
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.045 s - in org.apache.spark.streaming.kinesis.JavaKinesisInputDStreamBuilderSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-streaming-kinesis-asl_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-streaming-kinesis-asl_2.12 ---
Discovery starting.
Discovery completed in 2 seconds, 331 milliseconds.
Run starting. Expected test count is: 35
KinesisInputDStreamBuilderSuite:
- should raise an exception if the StreamingContext is missing
- should raise an exception if the stream name is missing
- should raise an exception if the checkpoint app name is missing
- should propagate required values to KinesisInputDStream
- should propagate default values to KinesisInputDStream
- should propagate custom non-auth values to KinesisInputDStream
- old Api should throw UnsupportedOperationExceptionexception with AT_TIMESTAMP
WithoutAggregationKinesisBackedBlockRDDSuite:
- Basic reading from Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available in both block manager and Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available only in block manager, not in Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available only in Kinesis, not in block manager [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available partially in block manager, rest in Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Test isBlockValid skips block fetching from block manager [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Test whether RDD is valid after removing blocks from block manager [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
KinesisReceiverSuite:
- process records including store and set checkpointer
- split into multiple processes if a limitation is set
- shouldn't store and update checkpointer when receiver is stopped
- shouldn't update checkpointer when exception occurs during store
- shutdown should checkpoint if the reason is TERMINATE
- shutdown should not checkpoint if the reason is something other than TERMINATE
- retry success on first attempt
- retry success on second attempt after a Kinesis throttling exception
- retry success on second attempt after a Kinesis dependency exception
- retry failed after a shutdown exception
- retry failed after an invalid state exception
- retry failed after unexpected exception
- retry failed after exhausting all retries
WithAggregationKinesisBackedBlockRDDSuite:
- Basic reading from Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available in both block manager and Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available only in block manager, not in Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available only in Kinesis, not in block manager [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Read data available partially in block manager, rest in Kinesis [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Test isBlockValid skips block fetching from block manager [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Test whether RDD is valid after removing blocks from block manager [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
WithAggregationKinesisStreamSuite:
- RDD generation
- basic operation [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- custom message handling [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Kinesis read with custom configurations
- split and merge shards in a stream [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- failure recovery [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Prepare KinesisTestUtils [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
KinesisCheckpointerSuite:
- checkpoint is not called twice for the same sequence number
- checkpoint is called after sequence number increases
- should checkpoint if we have exceeded the checkpoint interval
- shouldn't checkpoint if we have not exceeded the checkpoint interval
- should not checkpoint for the same sequence number
- removing checkpointer checkpoints one last time
- if checkpointing is going on, wait until finished before removing and checkpointing
SparkAWSCredentialsBuilderSuite:
- should build DefaultCredentials when given no params
- should build BasicCredentials
- should build STSCredentials
- SparkAWSCredentials classes should be serializable
WithoutAggregationKinesisStreamSuite:
- RDD generation
- basic operation [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- custom message handling [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Kinesis read with custom configurations
- split and merge shards in a stream [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- failure recovery [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
- Prepare KinesisTestUtils [enable by setting env var ENABLE_KINESIS_TESTS=1] !!! IGNORED !!!
Run completed in 4 seconds, 557 milliseconds.
Total number of tests run: 35
Suites: completed 9, aborted 0
Tests: succeeded 35, failed 0, canceled 0, ignored 24, pending 0
All tests passed.
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Spark Project Examples
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] -----< org.apache.spark:spark-streaming-kafka-0-10-assembly_2.12 >------
[INFO] Building Spark Integration for Kafka 0.10 Assembly 3.0.4-SNAPSHOT [26/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-assembly/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-assembly/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-token-provider/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/apache/kafka/kafka-clients/2.4.1/kafka-clients-2.4.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-assembly/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-assembly/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10-token-provider/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.40.v20210413/jetty-plus-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/kafka/kafka-clients/2.4.1/kafka-clients-2.4.1.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.40.v20210413/jetty-http-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.40.v20210413/jetty-jndi-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.40.v20210413/jetty-util-ajax-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.40.v20210413/jetty-util-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.40.v20210413/jetty-xml-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.40.v20210413/jetty-webapp-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.40.v20210413/jetty-security-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/streaming/target/scala-2.12/classes:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.40.v20210413/jetty-continuation-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.40.v20210413/jetty-servlet-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kafka-0-10/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.40.v20210413/jetty-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.40.v20210413/jetty-servlets-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.40.v20210413/jetty-proxy-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-streaming-kafka-0-10-assembly_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-streaming-kafka-0-10-assembly_2.12 ---
Discovery starting.
Discovery completed in 59 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 122 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] 
[INFO] ------------------< org.apache.spark:spark-avro_2.12 >------------------
[INFO] Building Spark Avro 3.0.4-SNAPSHOT                               [27/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-avro_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-avro_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-avro_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-avro_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-avro_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/org/threeten/threeten-extra/1.5.0/threeten-extra-1.5.0.jar:/home/jenkins/.m2/repository/org/apache/hive/hive-storage-api/2.7.1/hive-storage-api-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-column/1.10.1/parquet-column-1.10.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-hadoop/1.10.1/parquet-hadoop-1.10.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/apache/orc/orc-core/1.5.10/orc-core-1.5.10.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-common/1.10.1/parquet-common-1.10.1.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-format/2.4.0/parquet-format-2.4.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/io/airlift/aircompressor/0.10/aircompressor-0.10.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-encoding/1.10.1/parquet-encoding-1.10.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/org/apache/orc/orc-mapreduce/1.5.10/orc-mapreduce-1.5.10.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-jackson/1.10.1/parquet-jackson-1.10.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/apache/orc/orc-shims/1.5.10/orc-shims-1.5.10.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-avro_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-avro_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-avro_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-avro_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__52.0-1.3.1_20191012T045515.jar
[INFO] Compiling 18 Scala sources and 1 Java source to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/target/scala-2.12/classes ...
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala:99: value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala:56: value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/scala/org/apache/spark/sql/v2/avro/AvroPartitionReaderFactory.scala:63: value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
[WARNING] three warnings found
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/java/org/apache/spark/sql/avro/SparkAvroKeyOutputFormat.java:55: found raw type: org.apache.spark.sql.avro.SparkAvroKeyRecordWriter
  missing type arguments for generic class org.apache.spark.sql.avro.SparkAvroKeyRecordWriter<T>
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/java/org/apache/spark/sql/avro/SparkAvroKeyOutputFormat.java:55: unchecked call to SparkAvroKeyRecordWriter(org.apache.avro.Schema,org.apache.avro.generic.GenericData,org.apache.avro.file.CodecFactory,java.io.OutputStream,int,java.util.Map<java.lang.String,java.lang.String>) as a member of the raw type org.apache.spark.sql.avro.SparkAvroKeyRecordWriter
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/java/org/apache/spark/sql/avro/SparkAvroKeyOutputFormat.java:74: found raw type: org.apache.avro.file.DataFileWriter
  missing type arguments for generic class org.apache.avro.file.DataFileWriter<D>
[WARNING] [Warn] /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/src/main/java/org/apache/spark/sql/avro/SparkAvroKeyOutputFormat.java:74: unchecked call to DataFileWriter(org.apache.avro.io.DatumWriter<D>) as a member of the raw type org.apache.avro.file.DataFileWriter
[INFO] Done compiling.
[INFO] compile in 50.7 s
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-avro_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-avro_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 22 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-avro_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-avro_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/test-classes:/home/jenkins/.m2/repository/org/threeten/threeten-extra/1.5.0/threeten-extra-1.5.0.jar:/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-column/1.10.1/parquet-column-1.10.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.40.v20210413/jetty-plus-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/arrow/arrow-vector/0.15.1/arrow-vector-0.15.1.jar:/home/jenkins/.m2/repository/org/antlr/antlr4-runtime/4.7.1/antlr4-runtime-4.7.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/arrow/arrow-memory/0.15.1/arrow-memory-0.15.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.40.v20210413/jetty-http-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-hadoop/1.10.1/parquet-hadoop-1.10.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.40.v20210413/jetty-jndi-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/apache/orc/orc-core/1.5.10/orc-core-1.5.10.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.40.v20210413/jetty-util-ajax-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.40.v20210413/jetty-util-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/com/google/flatbuffers/flatbuffers-java/1.9.0/flatbuffers-java-1.9.0.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.12/1.1.2/scala-parser-combinators_2.12-1.1.2.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/codehaus/janino/janino/3.0.16/janino-3.0.16.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-encoding/1.10.1/parquet-encoding-1.10.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.40.v20210413/jetty-xml-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/org/apache/orc/orc-mapreduce/1.5.10/orc-mapreduce-1.5.10.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.40.v20210413/jetty-webapp-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hive/hive-storage-api/2.7.1/hive-storage-api-2.7.1.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/org/codehaus/janino/commons-compiler/3.0.16/commons-compiler-3.0.16.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/sql/catalyst/target/scala-2.12/classes:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.40.v20210413/jetty-security-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/sql/core/target/spark-sql_2.12-3.0.4-SNAPSHOT-tests.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/sketch/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.40.v20210413/jetty-continuation-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.40.v20210413/jetty-servlet-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/sql/catalyst/target/spark-catalyst_2.12-3.0.4-SNAPSHOT-tests.jar:/home/jenkins/.m2/repository/org/apache/arrow/arrow-format/0.15.1/arrow-format-0.15.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-common/1.10.1/parquet-common-1.10.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.40.v20210413/jetty-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.40.v20210413/jetty-servlets-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-format/2.4.0/parquet-format-2.4.0.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/io/airlift/aircompressor/0.10/aircompressor-0.10.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/org/scalacheck/scalacheck_2.12/1.14.2/scalacheck_2.12-1.14.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/org/apache/parquet/parquet-jackson/1.10.1/parquet-jackson-1.10.1.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.40.v20210413/jetty-proxy-9.4.40.v20210413.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/launcher/target/scala-2.12/classes:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/sql/core/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/univocity/univocity-parsers/2.9.0/univocity-parsers-2.9.0.jar:/home/jenkins/.m2/repository/org/apache/orc/orc-shims/1.5.10/orc-shims-1.5.10.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-avro_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/jenkins/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__52.0-1.3.1_20191012T045515.jar
[INFO] Compiling 9 Scala sources and 1 Java source to /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/avro/target/scala-2.12/test-classes ...
[INFO] Done compiling.
[INFO] compile in 118.3 s
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-avro_2.12 ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.spark.sql.avro.JavaAvroFunctionsSuite
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.695 s - in org.apache.spark.sql.avro.JavaAvroFunctionsSuite
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-avro_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-avro_2.12 ---
Discovery starting.
Discovery completed in 1 second, 280 milliseconds.
Run starting. Expected test count is: 220
AvroReadSchemaSuite:
- append column at the end
- hide column at the end
- append column into middle
- hide column in the middle
- add a nested column at the end of the leaf struct column
- add a nested column in the middle of the leaf struct column
- add a nested column at the end of the middle struct column
- add a nested column in the middle of the middle struct column
- hide a nested column at the end of the leaf struct column
- hide a nested column in the middle of the leaf struct column
- hide a nested column at the end of the middle struct column
- hide a nested column in the middle of the middle struct column
- change column position
AvroScanSuite:
- SPARK-33482: Test AvroScan equals
- SPARK-33482: Test AvroScan fileIndex not equals
- SPARK-33482: Test AvroScan dataSchema not equals
- SPARK-33482: Test AvroScan readDataSchema not equals
- SPARK-33482: Test AvroScan readPartitionSchema not equals
- SPARK-33482: Test AvroScan options not equals
- SPARK-33482: Test AvroScan partitionFilters not equals
- SPARK-33482: Test AvroScan dataFilters not equals
AvroCatalystDataConversionSuite:
- single BooleanType with seed -4115033047915014663
- single ByteType with seed 2034951764583440238
- single ShortType with seed -361554270545005332
- single IntegerType with seed 6428797019239985673
- single LongType with seed 4987030202065680351
- single FloatType with seed -527969047515511510
- single DoubleType with seed 8525486458879895330
- single DecimalType(8,0) with seed -8180861443823280501
- single DecimalType(8,4) with seed 5562521832678183885
- single DecimalType(16,0) with seed -2156899254025771492
- single DecimalType(16,11) with seed -8929728002080271119
- single DecimalType(38,0) with seed 8946789337072961630
- single DecimalType(38,38) with seed 1910426881209476112
- single StringType with seed 581217278608108017
- single BinaryType with seed -7493708559796761394
- flat schema struct<col_0:boolean,col_1:decimal(8,4),col_2:smallint,col_3:decimal(8,4),col_4:boolean> with seed -4694136188272836501
- flat schema struct<col_0:int,col_1:int,col_2:decimal(38,38),col_3:int,col_4:decimal(38,38)> with seed -8376555795139255321
- flat schema struct<col_0:decimal(38,0),col_1:float,col_2:bigint,col_3:decimal(8,0),col_4:decimal(8,0)> with seed 2917150210028397674
- flat schema struct<col_0:int,col_1:double,col_2:decimal(16,0),col_3:int,col_4:decimal(38,0)> with seed 8033023352697338211
- flat schema struct<col_0:double,col_1:decimal(8,4),col_2:decimal(8,0),col_3:boolean,col_4:decimal(8,0)> with seed 830504871683600620
- nested schema struct<col_0:array<decimal(38,0)>,col_1:struct<col_0:boolean,col_1:struct<col_0:struct<col_0:array<binary>>>,col_2:struct<col_0:array<int>,col_1:decimal(38,0),col_2:decimal(16,0),col_3:struct<col_0:string>>,col_3:tinyint>,col_2:array<decimal(38,0)>,col_3:array<decimal(8,0)>> with seed -3368203732807468536
- nested schema struct<col_0:array<string>,col_1:array<bigint>,col_2:bigint,col_3:struct<col_0:struct<col_0:array<decimal(8,4)>>>,col_4:struct<col_0:array<binary>,col_1:struct<col_0:struct<col_0:decimal(16,0)>>,col_2:array<float>,col_3:struct<col_0:struct<col_0:struct<col_0:struct<col_0:array<int>>>>>,col_4:struct<col_0:float>>,col_5:array<decimal(16,0)>> with seed 2667360326180389853
- nested schema struct<col_0:array<float>,col_1:array<decimal(38,0)>,col_2:struct<col_0:tinyint,col_1:int,col_2:string,col_3:array<binary>>,col_3:struct<col_0:decimal(8,0),col_1:struct<col_0:array<decimal(38,0)>>>,col_4:decimal(38,38),col_5:array<double>> with seed -3792174775478914032
- nested schema struct<col_0:struct<col_0:struct<col_0:array<double>,col_1:binary,col_2:struct<col_0:struct<col_0:decimal(16,0)>>,col_3:bigint,col_4:decimal(38,0),col_5:decimal(8,0)>,col_1:array<string>,col_2:array<float>>,col_1:binary,col_2:array<boolean>> with seed -7401567185857678351
- nested schema struct<col_0:array<float>,col_1:decimal(38,0),col_2:decimal(8,4),col_3:struct<col_0:struct<col_0:array<decimal(16,11)>>,col_1:array<binary>,col_2:struct<col_0:struct<col_0:decimal(16,0)>>>,col_4:struct<col_0:array<smallint>,col_1:struct<col_0:struct<col_0:struct<col_0:array<tinyint>>>>>,col_5:double,col_6:double> with seed 2717023560169255708
- array of nested schema with seed
- read int as string
- read string as int
- read float as double
- read double as float
- Handle unsupported input of record type
- user-specified output schema
- invalid user-specified output schema
- avro array can be generic java collection
AvroV1Suite:
- resolve avro data source
- reading from multiple paths
- reading and writing partitioned data
- request no fields
- convert formats
- rearrange internal schema
- union(int, long) is read as long
- union(float, double) is read as double
- union(float, double, null) is read as nullable double
- Union of a single type
- SPARK-27858 Union type: More than one non-null type
- Complex Union Type
- Lots of nulls
- Struct field type
- Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled
- Throws IOException on reading corrupt Avro file if flag IGNORE_CORRUPT_FILES disabled
- Date field type
- Array data types
- write with compression - sql configs
- dsl test
- old avro data source name works
- support of various data types
- sql test
- conversion to avro and back
- conversion to avro and back with namespace
- SPARK-34229: Avro should read decimal values with the file schema
- converting some specific sparkSQL types to avro
- correctly read long as date/timestamp type
- support of globbed paths
- does not coerce null date/timestamp value to 0 epoch.
- support user provided avro schema
- support user provided avro schema with defaults for missing fields
- support user provided avro schema for writing nullable enum type
- support user provided avro schema for writing non-nullable enum type
- support user provided avro schema for writing nullable fixed type
- support user provided avro schema for writing non-nullable fixed type
- support user provided avro schema for writing / reading fields with different ordering
- support user provided non-nullable avro schema for nullable catalyst schema without any null record
- error handling for unsupported Interval data types
- support Null data types
- throw exception if unable to write with user provided Avro schema
- reading from invalid path throws exception
- SQL test insert overwrite
- test save and load
- test load with non-Avro file
- read avro with user defined schema: read partial columns
- read avro with user defined schema: read non-exist columns
- read avro file partitioned
- Validate namespace in avro file that has nested records with the same name
- saving avro that has nested records with the same name
- check namespace - toAvroType
- check empty namespace - toAvroType
- saving avro that has nested records with the same name inside an array
- saving avro that has nested records with the same name inside a map
- SPARK-24805: do not ignore files without .avro extension by default
- SPARK-24836: checking the ignoreExtension option
- SPARK-24836: ignoreExtension must override hadoop's config
- SPARK-24881: write with compression - avro options
- Detect recursive loop
- log a warning of ignoreExtension deprecation
- SPARK-31855: generate test files for checking compatibility with Spark 2.4 !!! IGNORED !!!
- SPARK-31183: compatibility with Spark 2.4 in reading dates/timestamps
- SPARK-31183: rebasing microseconds timestamps in write
- SPARK-31183: rebasing milliseconds timestamps in write
- SPARK-31183: rebasing dates in write
- SPARK-31327: Write Spark version into Avro file metadata
- SPARK-33089: should propagate Hadoop config from DS options to underlying file system
- SPARK-33163: write the metadata key 'org.apache.spark.legacyDateTime'
DeprecatedAvroFunctionsSuite:
- roundtrip in to_avro and from_avro - int and string
- roundtrip in to_avro and from_avro - struct
- roundtrip in to_avro and from_avro - array with null
- SPARK-27798: from_avro produces same value when converted to local relation
AvroV1LogicalTypeSuite:
- Logical type: date
- Logical type: timestamp_millis
- Logical type: timestamp_micros
- Logical type: user specified output schema with different timestamp types
- Read Long type as Timestamp
- Logical type: user specified read schema
- Logical type: Decimal
- Logical type: write Decimal with BYTES type
- Logical type: Decimal with too large precision
AvroFunctionsSuite:
- roundtrip in to_avro and from_avro - int and string
- roundtrip in to_avro and from_avro - struct
- handle invalid input in from_avro
- roundtrip in to_avro and from_avro - array with null
- SPARK-27798: from_avro produces same value when converted to local relation
- SPARK-27506: roundtrip in to_avro and from_avro with different compatible schemas
AvroV2Suite:
- resolve avro data source
- reading from multiple paths
- reading and writing partitioned data
- request no fields
- convert formats
- rearrange internal schema
- union(int, long) is read as long
- union(float, double) is read as double
- union(float, double, null) is read as nullable double
- Union of a single type
- SPARK-27858 Union type: More than one non-null type
- Complex Union Type
- Lots of nulls
- Struct field type
- Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled
- Throws IOException on reading corrupt Avro file if flag IGNORE_CORRUPT_FILES disabled
- Date field type
- Array data types
- write with compression - sql configs
- dsl test
- old avro data source name works
- support of various data types
- sql test
- conversion to avro and back
- conversion to avro and back with namespace
- SPARK-34229: Avro should read decimal values with the file schema
- converting some specific sparkSQL types to avro
- correctly read long as date/timestamp type
- support of globbed paths
- does not coerce null date/timestamp value to 0 epoch.
- support user provided avro schema
- support user provided avro schema with defaults for missing fields
- support user provided avro schema for writing nullable enum type
- support user provided avro schema for writing non-nullable enum type
- support user provided avro schema for writing nullable fixed type
- support user provided avro schema for writing non-nullable fixed type
- support user provided avro schema for writing / reading fields with different ordering
- support user provided non-nullable avro schema for nullable catalyst schema without any null record
- error handling for unsupported Interval data types
- support Null data types
- throw exception if unable to write with user provided Avro schema
- reading from invalid path throws exception
- SQL test insert overwrite
- test save and load
- test load with non-Avro file
- read avro with user defined schema: read partial columns
- read avro with user defined schema: read non-exist columns
- read avro file partitioned
- Validate namespace in avro file that has nested records with the same name
- saving avro that has nested records with the same name
- check namespace - toAvroType
- check empty namespace - toAvroType
- saving avro that has nested records with the same name inside an array
- saving avro that has nested records with the same name inside a map
- SPARK-24805: do not ignore files without .avro extension by default
- SPARK-24836: checking the ignoreExtension option
- SPARK-24836: ignoreExtension must override hadoop's config
- SPARK-24881: write with compression - avro options
- Detect recursive loop
- log a warning of ignoreExtension deprecation
- SPARK-31855: generate test files for checking compatibility with Spark 2.4 !!! IGNORED !!!
- SPARK-31183: compatibility with Spark 2.4 in reading dates/timestamps
- SPARK-31183: rebasing microseconds timestamps in write
- SPARK-31183: rebasing milliseconds timestamps in write
- SPARK-31183: rebasing dates in write
- SPARK-31327: Write Spark version into Avro file metadata
- SPARK-33089: should propagate Hadoop config from DS options to underlying file system
- SPARK-33163: write the metadata key 'org.apache.spark.legacyDateTime'
- Avro source v2: support partition pruning
- Avro source v2: support passing data filters to FileScan without partitionFilters
- Avro source v2: same result with different orders of data filters and partition filters
AvroV2LogicalTypeSuite:
- Logical type: date
- Logical type: timestamp_millis
- Logical type: timestamp_micros
- Logical type: user specified output schema with different timestamp types
- Read Long type as Timestamp
- Logical type: user specified read schema
- Logical type: Decimal
- Logical type: write Decimal with BYTES type
- Logical type: Decimal with too large precision
Run completed in 57 seconds, 642 milliseconds.
Total number of tests run: 220
Suites: completed 10, aborted 0
Tests: succeeded 220, failed 0, canceled 0, ignored 2, pending 0
All tests passed.
[INFO] 
[INFO] -----< org.apache.spark:spark-streaming-kinesis-asl-assembly_2.12 >-----
[INFO] Building Spark Project Kinesis Assembly 3.0.4-SNAPSHOT           [28/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-versions) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] 
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-no-duplicate-dependencies) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] 
[INFO] --- mvn-scalafmt_2.12:1.0.3:format (default) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:add-source (eclipse-add-source) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Add Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl-assembly/src/main/scala
[INFO] Add Test Source directory: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl-assembly/src/test/scala
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (default-cli) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kms/1.11.655/aws-java-sdk-kms-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kinesis/1.11.655/aws-java-sdk-kinesis-1.11.655.jar:/home/jenkins/.m2/repository/joda-time/joda-time/2.10.5/joda-time-2.10.5.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-s3/1.11.655/aws-java-sdk-s3-1.11.655.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-dynamodb/1.11.655/aws-java-sdk-dynamodb-1.11.655.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.10.0/jackson-dataformat-cbor-2.10.0.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-core/1.11.655/aws-java-sdk-core-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.6.1/protobuf-java-2.6.1.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-sts/1.11.655/aws-java-sdk-sts-1.11.655.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-cloudwatch/1.11.655/aws-java-sdk-cloudwatch-1.11.655.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/com/amazonaws/amazon-kinesis-client/1.12.0/amazon-kinesis-client-1.12.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/com/amazonaws/jmespath-java/1.11.655/jmespath-java-1.11.655.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl-assembly/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Not compiling main sources
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl-assembly/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.1:testCompile (default-testCompile) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Not compiling test sources
[INFO] 
[INFO] --- maven-dependency-plugin:3.1.1:build-classpath (generate-test-classpath) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Dependencies classpath:
/home/jenkins/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/jenkins/.m2/repository/com/google/crypto/tink/tink/1.6.0/tink-1.6.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/jenkins/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-plus/9.4.40.v20210413/jetty-plus-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.10.0/jackson-dataformat-cbor-2.10.0.jar:/home/jenkins/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/jenkins/.m2/repository/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/jenkins/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-core/1.11.655/aws-java-sdk-core-1.11.655.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.6.1/protobuf-java-2.6.1.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/core/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-sts/1.11.655/aws-java-sdk-sts-1.11.655.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-cloudwatch/1.11.655/aws-java-sdk-cloudwatch-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-http/9.4.40.v20210413/jetty-http-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/scalatest/scalatest_2.12/3.0.8/scalatest_2.12-3.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/jenkins/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-jndi/9.4.40.v20210413/jetty-jndi-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/jenkins/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/jenkins/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/jenkins/.m2/repository/xerces/xercesImpl/2.12.0/xercesImpl-2.12.0.jar:/home/jenkins/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/external/kinesis-asl/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.40.v20210413/jetty-util-ajax-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-util/9.4.40.v20210413/jetty-util-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar:/home/jenkins/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/jenkins/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kms/1.11.655/aws-java-sdk-kms-1.11.655.jar:/home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/jenkins/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jenkins/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jenkins/.m2/repository/joda-time/joda-time/2.10.5/joda-time-2.10.5.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-s3/1.11.655/aws-java-sdk-s3-1.11.655.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-dynamodb/1.11.655/aws-java-sdk-dynamodb-1.11.655.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/jenkins/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/home/jenkins/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.40.v20210413/jetty-xml-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar:/home/jenkins/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-io/9.4.40.v20210413/jetty-io-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/jenkins/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/jenkins/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/jenkins/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jenkins/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/jenkins/.m2/repository/com/amazonaws/amazon-kinesis-client/1.12.0/amazon-kinesis-client-1.12.0.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/kvstore/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/jenkins/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.40.v20210413/jetty-webapp-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/jenkins/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jenkins/.m2/repository/com/novocode/junit-interface/0.11/junit-interface-0.11.jar:/home/jenkins/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/jenkins/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/scalactic/scalactic_2.12/3.0.8/scalactic_2.12-3.0.8.jar:/home/jenkins/.m2/repository/com/amazonaws/aws-java-sdk-kinesis/1.11.655/aws-java-sdk-kinesis-1.11.655.jar:/home/jenkins/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/jenkins/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-security/9.4.40.v20210413/jetty-security-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/jenkins/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/streaming/target/scala-2.12/classes:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/jenkins/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/tags/target/scala-2.12/classes:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.40.v20210413/jetty-continuation-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-common/target/scala-2.12/classes:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.40.v20210413/jetty-servlet-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/jenkins/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/jenkins/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/jenkins/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/network-shuffle/target/scala-2.12/classes:/home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/jenkins/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/jenkins/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-client/9.4.40.v20210413/jetty-client-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/home/jenkins/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.40.v20210413/jetty-servlets-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/jenkins/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/home/jenkins/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/jenkins/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/jenkins/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/jenkins/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.8.2/snappy-java-1.1.8.2.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/jenkins/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/jenkins/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/common/unsafe/target/scala-2.12/classes:/home/jenkins/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/jenkins/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar:/home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.5.6/httpclient-4.5.6.jar:/home/jenkins/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.40.v20210413/jetty-proxy-9.4.40.v20210413.jar:/home/jenkins/.m2/repository/com/amazonaws/jmespath-java/1.11.655/jmespath-java-1.11.655.jar:/home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3/launcher/target/scala-2.12/classes:/home/jenkins/.m2/repository/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar:/home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar
[INFO] 
[INFO] --- scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] compile in 0.0 s
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Skipping execution of surefire because it has already been run for this configuration
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-streaming-kinesis-asl-assembly_2.12 ---
Discovery starting.
Discovery completed in 64 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 127 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
No tests were executed.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.4-SNAPSHOT:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [  3.284 s]
[INFO] Spark Project Tags ................................. SUCCESS [  4.111 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 17.553 s]
[INFO] Spark Project Local DB ............................. SUCCESS [  3.456 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 51.722 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 10.319 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [  3.769 s]
[INFO] Spark Project Launcher ............................. SUCCESS [  3.824 s]
[INFO] Spark Project Core ................................. SUCCESS [28:53 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 31.149 s]
[INFO] Spark Project GraphX ............................... SUCCESS [02:59 min]
[INFO] Spark Project Streaming ............................ SUCCESS [06:01 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [18:44 min]
[INFO] Spark Project SQL .................................. SUCCESS [  01:11 h]
[INFO] Spark Project ML Library ........................... SUCCESS [26:41 min]
[INFO] Spark Project Tools ................................ SUCCESS [  1.354 s]
[INFO] Spark Project Hive ................................. FAILURE [  01:22 h]
[INFO] Spark Project REPL ................................. SUCCESS [01:59 min]
[INFO] Spark Project YARN Shuffle Service ................. SUCCESS [  2.154 s]
[INFO] Spark Project YARN ................................. SUCCESS [08:42 min]
[INFO] Spark Project Mesos ................................ SUCCESS [01:08 min]
[INFO] Spark Project Hive Thrift Server ................... SKIPPED
[INFO] Spark Project Assembly ............................. SKIPPED
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 30.220 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:49 min]
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [15:19 min]
[INFO] Spark Kinesis Integration .......................... SUCCESS [ 59.129 s]
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  2.033 s]
[INFO] Spark Avro ......................................... SUCCESS [03:57 min]
[INFO] Spark Project Kinesis Assembly ..................... SUCCESS [  2.490 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  04:34 h
[INFO] Finished at: 2021-09-23T03:00:21-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:2.0.0:test (test) on project spark-hive_2.12: There are test failures -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :spark-hive_2.12
+ retcode2=1
+ [[ 0 -ne 0 ]]
+ [[ 1 -ne 0 ]]
+ [[ 0 -ne 0 ]]
+ [[ 1 -ne 0 ]]
+ echo 'Testing Spark with Maven failed'
Testing Spark with Maven failed
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
Finished: FAILURE