Test Result : DatasetSuite

0 failures (±0)
169 tests (±0)
Took 17 sec.

All Tests

Test nameDurationStatus
Check KeyValueGroupedDataset toString: Named KV-pair9 msPassed
Check KeyValueGroupedDataset toString: Single data7 msPassed
Check KeyValueGroupedDataset toString: Unnamed KV-pair20 msPassed
Check KeyValueGroupedDataset toString: over length schema11 msPassed
Check RelationalGroupedDataset toString: Single data3 msPassed
Check RelationalGroupedDataset toString: over length schema16 msPassed
Dataset should support flat input object to be null7 msPassed
Dataset should throw RuntimeException if top-level product input object is null3 msPassed
Dataset.checkpoint() - basic (eager = false, reliable = false)0.1 secPassed
Dataset.checkpoint() - basic (eager = false, reliable = true)0.17 secPassed
Dataset.checkpoint() - basic (eager = true, reliable = false)0.11 secPassed
Dataset.checkpoint() - basic (eager = true, reliable = true)0.28 secPassed
Dataset.checkpoint() - should preserve partitioning information (eager = false, reliable = false)0.23 secPassed
Dataset.checkpoint() - should preserve partitioning information (eager = false, reliable = true)0.3 secPassed
Dataset.checkpoint() - should preserve partitioning information (eager = true, reliable = false)0.23 secPassed
Dataset.checkpoint() - should preserve partitioning information (eager = true, reliable = true)0.41 secPassed
Java encoder69 msPassed
Java encoder self join44 msPassed
Kryo encoder0.14 secPassed
Kryo encoder self join53 msPassed
Kryo encoder: check the schema mismatch when converting DataFrame to Dataset7 msPassed
REGEX column specification0.36 secPassed
SPARK-11436: we should rebind right encoder when join 2 datasets76 msPassed
SPARK-11894: Incorrect results are returned when using null89 msPassed
SPARK-12404: Datatype Helper Serializability57 msPassed
SPARK-12478: top level null field0.13 secPassed
SPARK-13440: Resolving option fields37 msPassed
SPARK-13540 Dataset of nested class defined in Scala object23 msPassed
SPARK-14000: case class with tuple type field33 msPassed
SPARK-14554: Dataset.map may generate wrong java code for wide table0.89 secPassed
SPARK-14696: implicit encoders for boxed types50 msPassed
SPARK-14838: estimating sizeInBytes in operators with ObjectProducer shouldn't fail0.19 secPassed
SPARK-15097: implicits on dataset's spark can be imported32 msPassed
SPARK-15112: EmbedDeserializerInFilter should not optimize plan fragment that changes schema75 msPassed
SPARK-15381: physical object operator should define `reference` correctly80 msPassed
SPARK-15441: Dataset outer join79 msPassed
SPARK-15550 Dataset.show() should show contents of the underlying logical plan64 msPassed
SPARK-15550 Dataset.show() should show inner nested products as rows48 msPassed
SPARK-15632: typed filter should preserve the underlying logical schema8 msPassed
SPARK-16097: Encoders.tuple should handle null object correctly38 msPassed
SPARK-16686: Dataset.sample with seed results shouldn't depend on downstream usage0.16 secPassed
SPARK-16853: select, case class and tuple91 msPassed
SPARK-16995: flat mapping on Dataset containing a column created with lit/expr0.28 secPassed
SPARK-17460: the sizeInBytes in Statistics shouldn't overflow to a negative number0.11 secPassed
SPARK-18125: Spark generated code causes CompileException0.26 secPassed
SPARK-18189: Fix serialization issue in KeyValueGroupedDataset0.1 secPassed
SPARK-18284: Serializer should have correct nullable value0.11 secPassed
SPARK-18717: code generation works for both scala.collection.Map and scala.collection.immutable.Map0.16 secPassed
SPARK-18746: add implicit encoder for BigDecimal, date, timestamp0.23 secPassed
SPARK-19896: cannot have circular references in case class8 msPassed
SPARK-20125: option of map27 msPassed
SPARK-20399: do not unescaped regex pattern when ESCAPED_STRING_LITERALS is enabled0.13 secPassed
SPARK-21538: Attribute resolution inconsistency in Dataset API0.83 secPassed
SPARK-21567: Dataset should work with type alias0.18 secPassed
SPARK-22442: Generate correct field names for special characters0.19 secPassed
SPARK-22472: add null check for top-level primitive values0.32 secPassed
SPARK-23025: Add support for null type in scala reflection32 msPassed
SPARK-23614: Union produces incorrect results when caching is used0.22 secPassed
SPARK-23627: provide isEmpty in DataSet22 msPassed
SPARK-23835: null primitive data type should throw NullPointerException30 msPassed
SPARK-23862: Spark ExpressionEncoder should support Java Enum type from Scala0.12 secPassed
SPARK-24548: Dataset with tuple encoders should have correct schema84 msPassed
SPARK-24569: Option of primitive types are mistakenly mapped to struct type87 msPassed
SPARK-24571: filtering of string values by char literal85 msPassed
SPARK-24762: Enable top-level Option of Product encoders62 msPassed
SPARK-24762: Resolving Option[Product] field34 msPassed
SPARK-24762: joinWith on Option[Product]0.1 secPassed
SPARK-24762: select Option[Product] field85 msPassed
SPARK-24762: typed agg on Option[Product] type0.19 secPassed
SPARK-25108 Fix the show method to display the full width character alignment problem73 msPassed
SPARK-25153: Improve error messages for columns with dots/periods38 msPassed
SPARK-25942: typed aggregation on primitive type0.13 secPassed
SPARK-25942: typed aggregation on product type0.12 secPassed
SPARK-26085: fix key attribute name for atomic type for typed aggregation7 msPassed
SPARK-26233: serializer should enforce decimal precision and scale0.14 secPassed
SPARK-26366: return nulls which are not filtered in except0.13 secPassed
SPARK-26690: checkpoints should be executed with an execution id37 msPassed
SPARK-26706: Fix Cast.mayTruncate for bytes3 msPassed
SPARK-30791: sameSemantics and semanticHash work18 msPassed
SPARK-31854: Invoke in MapElementsExec should not propagate null89 msPassed
SPARK-32585: Support scala enumeration in ScalaReflection79 msPassed
SPARK-33390: Make Literal support char array95 msPassed
SPARK-33469: Add current_timezone function29 msPassed
SPARK-34002: Fix broken Option input/output in UDF0.13 secPassed
SPARK-34605: implicit encoder for java.time.Duration57 msPassed
SPARK-34615: implicit encoder for java.time.Period68 msPassed
SPARK-35652: joinWith on two table generated from same one performing a cartesian join, which should be inner join78 msPassed
SPARK-35664: implicit encoder for java.time.LocalDateTime24 msPassed
SPARK-36210: withColumns preserve insertion ordering67 msPassed
SPARK-8288: class with only a companion object constructor44 msPassed
SparkSession.active should be the same instance after dataset operations3 msPassed
as case class - reordered fields by name41 msPassed
as case class - tail28 msPassed
as case class - take37 msPassed
as case class / collect41 msPassed
as map of case class - reorder fields by name52 msPassed
as seq of case class - reorder fields by name50 msPassed
as tuple36 msPassed
change encoder with compatible schema45 msPassed
checkAnswer should compare map correctly70 msPassed
coalesce, repartition0.15 secPassed
cogroup0.11 secPassed
cogroup with complex data0.12 secPassed
cogroup's left and right side has field with same name0.1 secPassed
collect, first, and take should use encoders for serialization44 msPassed
createTempView13 msPassed
dataset.rdd with generic case class0.11 secPassed
dropDuplicates0.31 secPassed
dropDuplicates: columns with same column name0.2 secPassed
emptyDataset26 msPassed
filter45 msPassed
filter and then select0.12 secPassed
foreach42 msPassed
foreachPartition32 msPassed
give nice error message when the real number of fields doesn't match encoder schema15 msPassed
groupBy function, flatMap65 msPassed
groupBy function, keys98 msPassed
groupBy function, map0.12 secPassed
groupBy function, mapValues, flatMap0.2 secPassed
groupBy function, reduce0.1 secPassed
groupBy single field class, count99 msPassed
groupBy.as0.14 secPassed
grouping key and grouped value has field with same name0.13 secPassed
identity map for primitive arrays0.2 secPassed
implicit encoder for LocalDate and Instant0.11 secPassed
isStreaming returns false for static Dataset12 msPassed
isStreaming returns true after static and streaming Dataset join7 msPassed
isStreaming returns true for streaming Dataset1 msPassed
joinWith class with primitive, toDF0.11 secPassed
joinWith join types8 msPassed
joinWith tuple with primitive, expression75 msPassed
joinWith, flat schema82 msPassed
map0.1 secPassed
map and group by with class data0.16 secPassed
map with type change with less attributes63 msPassed
map with type change with the exact matched number of attributes72 msPassed
mapped dataset should resolve duplicated attributes for self join0.25 secPassed
multi-level joinWith0.12 secPassed
range0.17 secPassed
reduce31 msPassed
row nullability mismatch46 msPassed
runtime null check for RowEncoder43 msPassed
runtime nullability check0.11 secPassed
sample fraction should be on interval [0, 1] without replacement3 msPassed
sample fraction should not be negative with replacement32 msPassed
sample with replacement39 msPassed
sample without replacement30 msPassed
select26 msPassed
select 213 msPassed
select 2, primitive and class45 msPassed
select 2, primitive and class, fields reordered45 msPassed
select 2, primitive and tuple38 msPassed
self join61 msPassed
support inner class in Dataset57 msPassed
tail should not accept minus value4 msPassed
tail with different numbers0.22 secPassed
toDS27 msPassed
toDS should compare map with byte array keys correctly0.12 secPassed
toDS with RDD47 msPassed
toString12 msPassed
typed aggregation: expr0.12 secPassed
typed aggregation: expr, expr0.12 secPassed
typed aggregation: expr, expr, expr0.13 secPassed
typed aggregation: expr, expr, expr, expr0.12 secPassed
typed aggregation: expr, expr, expr, expr, expr0.22 secPassed
typed aggregation: expr, expr, expr, expr, expr, expr0.2 secPassed
typed aggregation: expr, expr, expr, expr, expr, expr, expr0.21 secPassed
typed aggregation: expr, expr, expr, expr, expr, expr, expr, expr0.15 secPassed
verify mismatching field names fail with a good error16 msPassed