Test Result : CSVv1Suite

0 failures
121 tests
Took 43 sec.

All Tests

Test nameDurationStatus
00.46 secPassed
0]0.4 secPassed
DDL test parsing decimal type0.1 secPassed
DDL test with empty file74 msPassed
DDL test with schema74 msPassed
DDL test with tab separated file0.16 secPassed
Do not reuse last good value for bad input field0.1 secPassed
Empty file produces empty dataframe with empty schema0.22 secPassed
Empty string dataset produces empty dataframe and keep user-defined schema75 msPassed
Enabling/disabling ignoreCorruptFiles0.15 secPassed
Roundtrip in reading and writing timestamps0.34 secPassed
Roundtrip in reading and writing timestamps in microsecond precision0.24 secPassed
SPARK-13543 Write the output as uncompressed via option()0.32 secPassed
SPARK-15585 turn off quotations0.1 secPassed
SPARK-17916: An empty string should not be coerced to null when nullValue is passed0.77 secPassed
SPARK-18579: ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options - write0.68 secPassed
SPARK-18699 put malformed records in a `columnNameOfCorruptRecord` field0.54 secPassed
SPARK-19018: Save csv with custom charset0.54 secPassed
SPARK-19018: error handling for unsupported charsets79 msPassed
SPARK-19610: Parse normal multi-line CSV files0.27 secPassed
SPARK-20978: Fill the malformed column when the number of tokens is less than schema76 msPassed
SPARK-21263: Invalid float and double are handled correctly in different modes0.24 secPassed
SPARK-21610: Corrupt records are not handled properly when creating a dataframe from a file0.26 secPassed
SPARK-23786: CSV header must not be checked if it doesn't exist0.19 secPassed
SPARK-23786: Checking column names against schema in the multiline mode0.29 secPassed
SPARK-23786: Checking column names against schema in the per-line mode0.25 secPassed
SPARK-23786: check header on parsing of dataset of strings28 msPassed
SPARK-23786: enforce inferred schema0.32 secPassed
SPARK-23786: warning should be printed if CSV header doesn't conform to schema0.17 secPassed
SPARK-23846: usage of samplingRatio while parsing a dataset of strings0.17 secPassed
SPARK-24244: Select a subset of all columns0.26 secPassed
SPARK-24329: skip lines with comments, and one or multiple whitespaces92 msPassed
SPARK-24540: test with multiple (crazy) character delimiter0.19 secPassed
SPARK-24540: test with multiple character delimiter (comma space)0.16 secPassed
SPARK-24645 skip parsing when columnPruning enabled and partitions scanned only0.36 secPassed
SPARK-24676 project required data from parsed data when columnPruning disabled0.77 secPassed
SPARK-25134: check header on parsing of dataset with projection and column pruning0.71 secPassed
SPARK-25241: An empty string should not be coerced to null when emptyValue is passed0.42 secPassed
SPARK-25387: bad input should not cause NPE0.19 secPassed
SPARK-26208: write and read empty data to csv file with headers0.59 secPassed
SPARK-27512: Decimal type inference should not handle ',' for backward compatibility83 msPassed
SPARK-27873: disabling enforceSchema should not fail columnNameOfCorruptRecord0.56 secPassed
SPARK-28431: prevent CSV datasource throw TextParsingException with large size message64 msPassed
SPARK-29101 test count with DROPMALFORMED mode0.29 secPassed
SPARK-30530: apply filters to malformed rows0.2 secPassed
SPARK-30810: parses and convert a CSV Dataset having different column from 'value'0.15 secPassed
SPARK-30960: parse date/timestamp string with legacy format90 msPassed
SPARK-31261: bad csv input with `columnNameCorruptRecord` should not cause NPE0.14 secPassed
SPARK-32614: don't treat rows starting with null char as comment0.25 secPassed
SPARK-32810: CSV data source should be able to read files with escaped glob metacharacter in the paths0.25 secPassed
SPARK-34768: counting a long record with ignoreTrailingWhiteSpace set to true0.19 secPassed
Schema inference correctly identifies the datatype when data is sparse79 msPassed
Support line separator - default value \r, \r\n and \n0.18 secPassed
Support line separator in CP1251 #60.99 secPassed
Support line separator in ISO-8859-1 #20.98 secPassed
Support line separator in US-ASCII #100.71 secPassed
Support line separator in UTF-16BE #10.97 secPassed
Support line separator in UTF-16LE #81 secPassed
Support line separator in UTF-32BE #50.72 secPassed
Support line separator in UTF-32BE #90.64 secPassed
Support line separator in UTF-32LE #30.69 secPassed
Support line separator in UTF-8 #00.7 secPassed
Support line separator in UTF-8 #40.98 secPassed
Support line separator in utf-32le #111.1 secPassed
Write dates correctly in ISO8601 format by default0.21 secPassed
Write dates correctly with dateFormat option0.18 secPassed
Write timestamps correctly in ISO8601 format by default0.27 secPassed
Write timestamps correctly with timestampFormat option0.28 secPassed
Write timestamps correctly with timestampFormat option and timeZone option0.51 secPassed
bad encoding name19 msPassed
caseSensitive is false0.18 secPassed
columnNameOfCorruptRecord83 msPassed
commented lines in CSV data0.22 secPassed
count() for malformed input0.33 secPassed
crlf line separators in multiline mode0.25 secPassed
empty fields with user defined empty values84 msPassed
encoding in multiLine mode3.2 secPassed
exception mode for parsing date/timestamp string0.2 secPassed
field names of inferred schema shouldn't compare to the first row0.11 secPassed
filters push down3.8 secPassed
filters push down - malformed input in PERMISSIVE mode0.93 secPassed
ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options - read0.37 secPassed
inferring schema with commented lines in CSV data0.14 secPassed
inferring timestamp types via custom date format0.16 secPassed
lineSep restrictions11 msPassed
load date types via custom date format64 msPassed
load duplicated field names consistently with null or empty strings - case insensitive0.15 secPassed
load duplicated field names consistently with null or empty strings - case sensitive0.2 secPassed
load null when the schema is larger than parsed tokens0.15 secPassed
nullable fields with user defined null value of "null"0.12 secPassed
nulls, NaNs and Infinity values can be parsed47 msPassed
old csv data source name works0.13 secPassed
parse timestamp in microsecond precision0.21 secPassed
parse unescaped quotes with maxCharsPerColumn0.16 secPassed
return correct results when data columns overlap with partition columns0.37 secPassed
save csv0.41 secPassed
save csv with compression codec option0.5 secPassed
save csv with empty fields with user defined empty values0.19 secPassed
save csv with quote0.35 secPassed
save csv with quote escaping disabled0.17 secPassed
save csv with quote escaping enabled0.2 secPassed
save csv with quote escaping, using charToEscapeQuoteEscaping option0.27 secPassed
save csv with quoteAll enabled0.18 secPassed
setting comment to null disables comment support0.12 secPassed
simple csv test0.23 secPassed
simple csv test with calling another function to load0.19 secPassed
simple csv test with string dataset0.61 secPassed
simple csv test with type inference0.24 secPassed
test aliases sep and encoding for delimiter and charset0.17 secPassed
test different encoding0.18 secPassed
test for DROPMALFORMED parsing mode0.22 secPassed
test for FAILFAST parsing mode0.24 secPassed
test for blank column names on read and select columns0.2 secPassed
test for tokens more than the fields in the schema0.15 secPassed
test inferring booleans0.11 secPassed
test inferring decimals0.1 secPassed
test with alternative delimiter and quote0.17 secPassed
test with empty file and known schema44 msPassed
test with null quote character0.21 secPassed
test with tab delimiter and double quote0.15 secPassed
using the backward slash as the delimiter0.38 secPassed