WDescription%
Build stability: 1 out of the last 5 builds failed.80
Build History
x

Changes

#2577 (Sep 24, 2021, 1:47:46 PM)

  1. [SPARK-36721][SQL] Simplify boolean equalities if one side is literal — viirya / githubweb
  2. [SPARK-35174][K8S] Avoid opening watch when waitAppCompletion is false — dongjoon / githubweb

#2576 (Sep 24, 2021, 5:47:37 AM)

  1. [SPARK-33832][SQL] Force skew join code simplification and improvement — wenchen / githubweb
  2. [SPARK-36825][SQL] Read/write dataframes with ANSI intervals from/to — max.gekk / githubweb
  3. [SPARK-36792][SQL] InSet should handle NaN — wenchen / githubweb
  4. [SPARK-36656][SQL][TEST] CollapseProject should not collapse correlated — wenchen / githubweb
  5. [SPARK-36827][CORE] Improve the perf and memory usage of cleaning up — gengliang / githubweb

#2575 (Sep 23, 2021, 9:47:25 PM)

  1. [SPARK-36642][SQL] Add df.withMetadata pyspark API — weichen.xu / githubweb
  2. Revert "[SPARK-35672][CORE][YARN] Pass user classpath entries to — gurwls223 / githubweb
  3. [SPARK-36835][BUILD] Enable createDependencyReducedPom for Maven shaded — gengliang / githubweb

#2574 (Sep 23, 2021, 2:48:55 PM)

  1. [SPARK-36760][SQL][FOLLOWUP] Add interface SupportsPushDownV2Filters — wenchen / githubweb
  2. [SPARK-36760][DOCS][FOLLOWUP] Fix wrong JavaDoc style — sarutak / githubweb

#2573 (Sep 23, 2021, 7:25:06 AM)

  1. [SPARK-36782][CORE][FOLLOW-UP] Only handle shuffle block in separate — gengliang / githubweb

#2572 (Sep 23, 2021, 12:00:35 AM)

  1. [SPARK-36708][PYTHON] Support numpy.typing for annotating ArrayType in — gurwls223 / githubweb
  2. [SPARK-36824][R] Add sec and csc as R functions — gurwls223 / githubweb
  3. [SPARK-36791][DOCS] Fix spelling mistakes in running-on-yarn.md file — gurwls223 / githubweb
  4. [SPARK-36747][SQL] Do not collapse Project with Aggregate when — wenchen / githubweb
  5. [SPARK-36782][CORE] Avoid blocking dispatcher-BlockManagerMaster during — gengliang / githubweb
  6. [SPARK-36506][PYTHON] Improve test coverage for series.py and — gurwls223 / githubweb
  7. [SPARK-36405][SQL][TESTS] Check that SQLSTATEs are valid — gurwls223 / githubweb
  8. [MINOR][SQL][DOCS] Correct the 'options' description on — huaxin_gao / githubweb
  9. [SPARK-36795][SQL] Explain Formatted has Duplicate Node IDs — gurwls223 / githubweb

#2571 (Sep 22, 2021, 4:00:44 PM)

  1. [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and — wenchen / githubweb
  2. [SPARK-36818][PYTHON] Fix filtering a Series by a boolean Series — ueshin / githubweb

#2570 (Sep 22, 2021, 8:00:01 AM)

  1. [SPARK-36760][SQL] Add interface SupportsPushDownV2Filters — wenchen / githubweb
  2. [SPARK-36822][SQL] BroadcastNestedLoopJoinExec should use all condition — wenchen / githubweb
  3. [SPARK-36803][SQL] Fix ArrayType conversion when reading Parquet files — wenchen / githubweb

#2569 (Sep 22, 2021, 12:19:39 AM)

  1. [SPARK-36820][SQL] Disable tests related to LZ4 for Hadoop 2.7 profile — viirya / githubweb

#2568 (Sep 21, 2021, 2:14:49 PM)

  1. [SPARK-36771][PYTHON] Fix `pop` of Categorical Series — ueshin / githubweb

#2567 (Sep 21, 2021, 11:54:52 AM)

  1. [SPARK-36670][FOLLOWUP][TEST] Remove brotli-codec dependency — dongjoon / githubweb
  2. [SPARK-36615][CORE] Register shutdown hook earlier when start SC — mridulatgmail.com / githubweb

#2566 (Sep 21, 2021, 10:24:21 AM)

  1. [SPARK-36769][PYTHON] Improve `filter` of single-indexed DataFrame — ueshin / githubweb

#2565 (Sep 21, 2021, 8:25:13 AM)

  1. [SPARK-36814][SQL] Make class ColumnarBatch extendable — d_tsai / githubweb

#2564 (Sep 21, 2021, 12:26:19 AM)

  1. [SPARK-36807][SQL] Merge ANSI interval types to a tightest common type — max.gekk / githubweb

#2563 (Sep 20, 2021, 5:59:17 PM)

  1. [SPARK-36785][PYTHON] Fix DataFrame.isin when DataFrame has NaN value — ueshin / githubweb

#2562 (Sep 20, 2021, 3:01:26 PM)

  1. [SPARK-36618][PYTHON] Support dropping rows of a single-indexed — ueshin / githubweb
  2. [SPARK-36746][PYTHON] Refactor `_select_rows_by_iterable` in — ueshin / githubweb

#2561 (Sep 20, 2021, 11:21:48 AM)

  1. [SPARK-36806][K8S][R] Use R 4.0.4 in K8s R image — dongjoon / githubweb

#2560 (Sep 20, 2021, 10:40:00 AM)

  1. [SPARK-36808][BUILD] Upgrade Kafka to 2.8.1 — dongjoon / githubweb

#2559 (Sep 20, 2021, 9:18:15 AM)

  1. [SPARK-36805][BUILD][K8S] Upgrade kubernetes-client to 5.7.3 — dongjoon / githubweb

#2558 (Sep 20, 2021, 7:00:44 AM)

  1. [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC — sarutak / githubweb

#2557 (Sep 20, 2021, 2:30:39 AM)

  1. [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and — wenchen / githubweb
  2. [SPARK-36101][CORE] Grouping exception in core/api — wenchen / githubweb

#2556 (Sep 20, 2021, 1:15:04 AM)

  1. [SPARK-34112][BUILD] Upgrade ORC to 1.7.0 — dongjoon / githubweb

#2555 (Sep 19, 2021, 7:00:05 PM)

  1. [SPARK-36107][SQL] Refactor first set of 20 query execution errors to — gurwls223 / githubweb
  2. [SPARK-36710][PYTHON] Support new typing syntax in function apply APIs — gurwls223 / githubweb

#2554 (Sep 18, 2021, 12:57:39 AM)

  1. [SPARK-36772] FinalizeShuffleMerge fails with an exception due to — gengliang / githubweb

#2553 (Sep 17, 2021, 5:55:20 PM)

  1. [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values — ueshin / githubweb

#2552 (Sep 17, 2021, 11:56:25 AM)

  1. [SPARK-36673][SQL][FOLLOWUP] Remove duplicate test in — viirya / githubweb

#2551 (Sep 17, 2021, 9:17:47 AM)

  1. [SPARK-36780][BUILD] Make `dev/mima` runs on Java 17 — dongjoon / githubweb

#2550 (Sep 17, 2021, 8:00:00 AM)

  1. [SPARK-36764][SS][TEST] Fix race-condition on "ensure continuous stream — wenchen / githubweb
  2. [SPARK-36718][SQL] Only collapse projects if we don't duplicate — wenchen / githubweb
  3. [SPARK-36673][SQL] Fix incorrect schema of nested types of union — wenchen / githubweb
  4. [SPARK-36767][SQL] ArrayMin/ArrayMax/SortArray/ArraySort add comment and — wenchen / githubweb
  5. [SPARK-36663][SQL] Support number-only column names in ORC data sources — wenchen / githubweb

#2549 (Sep 17, 2021, 6:24:00 AM)

  1. [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and — wenchen / githubweb

#2548 (Sep 17, 2021, 4:55:19 AM)

  1. [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe) — max.gekk / githubweb

#2547 (Sep 17, 2021, 1:22:29 AM)

  1. [SPARK-36789][SQL] Use the correct constant type as the null value — gurwls223 / githubweb

#2546 (Sep 16, 2021, 11:55:21 PM)

  1. [SPARK-32709][SQL] Support writing Hive bucketed table (Parquet/ORC — wenchen / githubweb

#2545 (Sep 16, 2021, 9:29:06 PM)

  1. [SPARK-36788][SQL] Change log level of AQE for non-supported plans from — gurwls223 / githubweb

#2544 (Sep 16, 2021, 7:52:01 PM)

  1. [SPARK-36773][SQL][TEST] Fixed unit test to check the compression for — gurwls223 / githubweb
  2. [SPARK-36783][SQL] ScanOperation should not push Filter through — wenchen / githubweb

#2543 (Sep 16, 2021, 5:54:27 PM)

  1. [SPARK-36779][PYTHON] Fix when list of data type tuples has len = 1 — gurwls223 / githubweb

#2542 (Sep 16, 2021, 2:50:05 PM)

  1. [SPARK-36774][CORE][TESTS] Move SparkSubmitTestUtils to core module and — joshrosen / githubweb

#2541 (Sep 16, 2021, 8:52:26 AM)

  1. [SPARK-36735][SQL][FOLLOWUP] Fix indentation of — dongjoon / githubweb

#2540 (Sep 16, 2021, 5:45:00 AM)

  1. [SPARK-36587][SQL][FOLLOWUP] Remove unused CreateNamespaceStatement — gengliang / githubweb
  2. [SPARK-36759][BUILD][FOLLOWUP] Update version in scala-2.12 profile and — dongjoon / githubweb

#2539 (Sep 16, 2021, 4:25:34 AM)

  1. [SPARK-36777][INFRA] Move Java 17 on GitHub Actions from EA to LTS — yumwang / githubweb

#2538 (Sep 16, 2021, 2:56:45 AM)

  1. [SPARK-36433][WEBUI] Fix log message in WebUI — gengliang / githubweb

#2537 (Sep 16, 2021, 1:32:24 AM)

  1. [SPARK-36775][DOCS] Add documentation for ANSI store assignment rules — wenchen / githubweb

#2536 (Sep 16, 2021, 12:05:29 AM)

  1. [SPARK-36732][SQL][BUILD] Upgrade ORC to 1.6.11 — dongjoon / githubweb

#2535 (Sep 15, 2021, 10:49:28 PM)

  1. [SPARK-36745][SQL] ExtractEquiJoinKeys should return the original — wenchen / githubweb

#2534 (Sep 15, 2021, 2:14:19 PM)

  1. [SPARK-36759][BUILD] Upgrade Scala to 2.12.15 — dongjoon / githubweb
  2. [SPARK-36735][SQL] Adjust overhead of cached relation for DPP — viirya / githubweb

#2533 (Sep 15, 2021, 12:53:09 PM)

  1. [SPARK-36726] Upgrade Parquet to 1.12.1 — d_tsai / githubweb

#2532 (Sep 15, 2021, 11:10:59 AM)

  1. [SPARK-36722][PYTHON] Fix Series.update with another in same frame — ueshin / githubweb

#2531 (Sep 15, 2021, 8:38:07 AM)

  1. [SPARK-36755][SQL] ArraysOverlap should handle duplicated Double.NaN and — wenchen / githubweb

#2530 (Sep 15, 2021, 7:07:22 AM)

  1. [SPARK-36702][SQL][FOLLOWUP] ArrayUnion handle duplicated Double.NaN and — wenchen / githubweb

#2529 (Sep 15, 2021, 12:47:50 AM)

  1. [SPARK-36751][SQL][PYTHON][R] Add bit/octet_length APIs to Scala, Python — sarutak / githubweb

#2528 (Sep 14, 2021, 9:10:37 PM)

  1. [SPARK-36660][SQL][FOLLOW-UP] Add cot to pyspark.sql.rst — gurwls223 / githubweb

#2527 (Sep 14, 2021, 7:22:19 PM)

  1. [SPARK-36709][PYTHON] Support new syntax for specifying index type and — gurwls223 / githubweb
  2. [SPARK-36733][SQL] Fix a perf issue in SchemaPruning when a struct has — gurwls223 / githubweb

#2526 (Sep 14, 2021, 6:04:40 PM)

  1. [SPARK-34943][BUILD] Upgrade flake8 to 3.8.0 or above in Jenkins — gurwls223 / githubweb

#2525 (Sep 14, 2021, 4:46:12 PM)

  1. [SPARK-36712][BUILD][FOLLOWUP] Improve the regex to avoid breaking — dongjoon / githubweb

#2524 (Sep 14, 2021, 5:46:53 AM)

  1. [SPARK-36737][BUILD][CORE][SQL][SS] Upgrade Apache commons-io to 2.11.0 — kabhwan.opensource / githubweb

#2523 (Sep 14, 2021, 3:49:23 AM)

  1. [SPARK-36702][SQL] ArrayUnion handle duplicated Double.NaN and Float.Nan — wenchen / githubweb

#2522 (Sep 13, 2021, 9:45:26 PM)

  1. [SPARK-36705][FOLLOW-UP] Fix unnecessary logWarning when — mridulatgmail.com / githubweb

#2521 (Sep 13, 2021, 7:42:35 PM)

  1. [SPARK-36748][PYTHON] Introduce the 'compute.isin_limit' option — gurwls223 / githubweb

#2520 (Sep 13, 2021, 5:46:22 PM)

  1. [SPARK-36739][DOCS][PYTHON] Add apache license headers to makefiles — gurwls223 / githubweb
  2. [SPARK-36715][SQL] InferFiltersFromGenerate should not infer filter for — gurwls223 / githubweb

#2519 (Sep 13, 2021, 3:58:41 PM)

  1. [SPARK-36653][PYTHON] Implement Series.__xor__ and Series.__rxor__ — ueshin / githubweb

#2518 (Sep 13, 2021, 2:45:14 PM)

  1. [SPARK-36705][SHUFFLE] Disable push based shuffle when IO encryption is — mridulatgmail.com / githubweb

#2517 (Sep 13, 2021, 10:16:37 AM)

  1. [SPARK-36712][BUILD] Make scala-parallel-collections in 2.13 POM a — srowen / githubweb

#2516 (Sep 13, 2021, 8:58:59 AM)

  1. [SPARK-36736][SQL] Support ILIKE (ALL | ANY | SOME) - case insensitive — wenchen / githubweb

#2515 (Sep 13, 2021, 7:27:10 AM)

  1. [SPARK-36724][SQL] Support timestamp_ntz as a type of time column for — gengliang / githubweb

#2514 (Sep 13, 2021, 5:52:26 AM)

  1. [SPARK-36738][SQL][DOC] Fixed the wrong documentation on Cot API — gurwls223 / githubweb

#2513 (Sep 13, 2021, 2:44:43 AM)

  1. [SPARK-33832][SQL] Support optimize skewed join even if introduce extra — wenchen / githubweb

#2512 (Sep 12, 2021, 10:45:06 AM)

  1. [SPARK-36729][BUILD] Upgrade Netty from 4.1.63 to 4.1.68 — dongjoon / githubweb

#2511 (Sep 12, 2021, 8:00:35 AM)

  1. [SPARK-36636][CORE][TEST] LocalSparkCluster change to use tmp workdir in — srowen / githubweb

#2510 (Sep 11, 2021, 5:14:25 PM)

  1. [SPARK-36719][CORE] Supporting Netty Logging at the network layer — dongjoon / githubweb

#2509 (Sep 11, 2021, 4:00:22 PM)

  1. [SPARK-36725][SQL][TESTS] Ensure HiveThriftServer2Suites to stop Thrift — dongjoon / githubweb
  2. [SPARK-35822][UI] Spark UI-Executor tab is empty in IE11 — dongjoon / githubweb

#2508 (Sep 11, 2021, 2:41:56 PM)

  1. [SPARK-36685][ML][MLLIB] Fix wrong assert messages — dongjoon / githubweb

#2507 (Sep 11, 2021, 12:04:01 PM)

  1. [SPARK-36704][CORE] Expand exception handling to more Java 9 cases where — srowen / githubweb

#2506 (Sep 11, 2021, 10:37:29 AM)

  1. [SPARK-36556][SQL] Add DSV2 filters — viirya / githubweb