WDescription%
Build stability: All recent builds failed.0
Build History
x

Changes

#875 (Dec 8, 2021, 6:57:53 AM)

  1. [SPARK-37540][SQL] Detect more unsupported time travel (commit: 66b256e) — wenchen / githubweb
  2. [SPARK-37360][SQL] Support TimestampNTZ in JSON data source (commit: 4f36978) — max.gekk / githubweb
  3. [SPARK-37004][PYTHON] Upgrade to Py4J 0.10.9.3 (commit: 72669b5) — gurwls223 / githubweb
  4. [SPARK-37552][SQL] Add the `convert_timezone()` function (commit: 0b959b5) — max.gekk / githubweb
  5. [SPARK-37546][SQL] V2 ReplaceTableAsSelect command should qualify (commit: bde47c8) — wenchen / githubweb
  6. [SPARK-37506][CORE][SQL][DSTREAM][GRAPHX][ML][MLLIB][SS][EXAMPLES] (commit: 116255d) — srowen / githubweb
  7. [SPARK-37557][SQL] Replace object hash with sort aggregate if child is (commit: 41a940f) — wenchen / githubweb
  8. [SPARK-37555][SQL] spark-sql should pass last unclosed comment to (commit: d50d464) — wenchen / githubweb
  9. [SPARK-37469][WEBUI] unified shuffle read block time to shuffle read (commit: cd4476f) — sarutak / githubweb
  10. [SPARK-37478][SQL][TESTS] Unify v1 and v2 DROP NAMESPACE tests (commit: f6e2e65) — wenchen / githubweb
  11. [SPARK-37556][SQL] Deser void class fail with Java serialization (commit: fb40c0e) — srowen / githubweb
  12. [SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and (commit: fdc276b) — sunchao / githubweb
  13. [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for (commit: 26f4953) — gurwls223 / githubweb
  14. [SPARK-37392][SQL] Fix the performance bug when inferring constraints (commit: 1fac7a9) — wenchen / githubweb
  15. [SPARK-37533][SQL][FOLLOWUP] try_element_at should throw an error on 0 (commit: cf19cf5) — gurwls223 / githubweb
  16. [SPARK-37445][INFRA][FOLLOWUP] Use hadoop3.2 profile instead of hadoop3 (commit: 8f14f82) — gurwls223 / githubweb

#874 (Dec 5, 2021, 9:50:23 PM)

  1. [SPARK-37495][PYTHON] Skip identical index checking of Series.compare (commit: b2a4e8f) — gurwls223 / githubweb
  2. [SPARK-37508][SQL][DOCS][FOLLOW-UP] Update expression desc of (commit: b5fc6da) — gurwls223 / githubweb
  3. [SPARK-37510][PYTHON] Support basic operations of timedelta Series/Index (commit: 1f3eb73) — gurwls223 / githubweb
  4. [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command (commit: c411d26) — huaxin_gao / githubweb
  5. [SPARK-37543][DOCS] Document Java 17 support (commit: 030de1d) — dongjoon / githubweb
  6. [SPARK-37533][SQL] New SQL function: try_element_at (commit: f705e52) — gengliang / githubweb
  7. [SPARK-37529][K8S][TESTS] Support K8s integration tests for Java 17 (commit: 32922ee) — dongjoon / githubweb
  8. [SPARK-37548][INFRA][R][TESTS] Add Java17 SparkR daily test coverage (commit: 0843e0d) — dongjoon / githubweb
  9. [SPARK-37545][SQL] V2 CreateTableAsSelect command should qualify (commit: feba5ac) — huaxin_gao / githubweb
  10. [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to release Docker (commit: 03750c0) — gurwls223 / githubweb
  11. [SPARK-37550][SQL][DOCS] Add an example of parsing jsonStr with complex (commit: eb2eb9e) — gurwls223 / githubweb

#873 (Dec 3, 2021, 1:52:58 PM)

  1. [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 (commit: 38115cb) — wenchen / githubweb
  2. [SPARK-37326][SQL][FOLLOWUP] Fix the test for Java 11 (commit: 40b239c) — dongjoon / githubweb
  3. [SPARK-37496][SQL] Migrate ReplaceTableAsSelectStatement to v2 command (commit: f97de30) — huaxin_gao / githubweb
  4. [SPARK-37514][PYTHON] Remove workarounds due to older pandas (commit: ffe3fc9) — gurwls223 / githubweb
  5. [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` (commit: b9b5562) — wenchen / githubweb
  6. [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add (commit: 0b42cd4) — mridulatgmail.com / githubweb
  7. [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ (commit: f7dabd8) — wenchen / githubweb
  8. [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when (commit: b7a5543) — gurwls223 / githubweb
  9. [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from (commit: 893feb9) — gurwls223 / githubweb
  10. [SPARK-37442][SQL] InMemoryRelation statistics bug causing broadcast (commit: c37b726) — wenchen / githubweb
  11. [SPARK-37450][SQL] Prune unnecessary fields from Generate (commit: c758b44) — viirya / githubweb
  12. [SPARK-37522][PYTHON][TESTS] Fix (commit: eec9fec) — dongjoon / githubweb
  13. [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session (commit: 8952fbc) — gurwls223 / githubweb
  14. [SPARK-37520][SQL] Add the `startswith()` and `endswith()` string (commit: 2479796) — gurwls223 / githubweb
  15. [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from (commit: 15d1122) — gurwls223 / githubweb
  16. [SPARK-37524][SQL] We should drop all tables after testing dynamic (commit: 2433c94) — gurwls223 / githubweb
  17. [SPARK-37526][INFRA][PYTHON][TESTS] Add Java17 PySpark daily test (commit: f99e2e6) — gurwls223 / githubweb
  18. [SPARK-37531][INFRA][PYTHON][TESTS] Use PyArrow 6.0.0 in Python 3.9 (commit: eba4f5c) — dongjoon / githubweb
  19. [SPARK-37534][BUILD] Bump dev.ludovic.netlib to 2.2.1 (commit: ae9aeba) — dongjoon / githubweb
  20. [SPARK-37530][CORE] Spark reads many paths very slow though (commit: e0d41e8) — yao / githubweb
  21. [SPARK-35162][TESTS][FOLLOWUP] Test try_arithmetic.sql under ANSI mode (commit: b1b05fb) — gengliang / githubweb
  22. [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command (commit: 688fa23) — wenchen / githubweb
  23. [SPARK-37286][SQL] Move compileAggregates from JDBCRDD to JdbcDialect (commit: 16f6295) — wenchen / githubweb
  24. [SPARK-37455][SQL] Replace hash with sort aggregate if child is already (commit: 544865d) — wenchen / githubweb
  25. [SPARK-37471][SQL] spark-sql  support `;` in nested bracketed comment (commit: 6e19125) — wenchen / githubweb
  26. [SPARK-37286][DOCS][FOLLOWUP] Fix the wrong parameter name for Javadoc (commit: f570d01) — srowen / githubweb

#872 (Dec 1, 2021, 5:46:32 AM)

  1. [SPARK-37443][PYTHON] Provide a profiler for Python/Pandas UDFs (commit: e91ef19) — gurwls223 / githubweb
  2. [SPARK-37319][K8S][FOLLOWUP] Set JAVA_HOME for Java 17 installed by (commit: a3886ba) — dongjoon / githubweb
  3. [SPARK-37447][SQL] Cache LogicalPlan.isStreaming() result in a lazy val (commit: 5d09828) — wenchen / githubweb
  4. [SPARK-37452][SQL] Char and Varchar break backward compatibility between (commit: 0c3c4e2) — yao / githubweb
  5. [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of (commit: 251e6fd) — wenchen / githubweb
  6. [SPARK-33875][SQL][FOLLOWUP] Handle the char/varchar column for (commit: 0f631b1) — wenchen / githubweb
  7. [SPARK-36346][SQL][FOLLOWUP] Rename `withAllOrcReaders` to (commit: a6ca481) — dongjoon / githubweb
  8. [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for (commit: 7484c1b) — max.gekk / githubweb
  9. [SPARK-37454][SQL][FOLLOWUP] Time travel timestamp expression should (commit: 1966416) — gurwls223 / githubweb
  10. [SPARK-37485][CORE][SQL] Replace `map` with expressions which produce no (commit: 7689102) — gurwls223 / githubweb
  11. [SPARK-37484][CORE][SQL] Replace `get` and `getOrElse` with `getOrElse` (commit: e36fae4) — gurwls223 / githubweb
  12. [SPARK-37482][PYTHON] Skip check monotonic increasing for Series.asof (commit: c38c617) — gurwls223 / githubweb
  13. [SPARK-35867][SQL] Enable vectorized read for (commit: fe1bb55) — sunchao / githubweb
  14. [SPARK-36850][SQL] Migrate CreateTableStatement to v2 command framework (commit: 98b0c80) — wenchen / githubweb
  15. [SPARK-37492][SQL] Optimize Orc test code with withAllNativeOrcReaders (commit: 49b5dd1) — dongjoon / githubweb
  16. [SPARK-37465][PYTHON] Bump minimum pandas version to 1.0.5 (commit: 3657703) — gurwls223 / githubweb
  17. [SPARK-37489][PYTHON] Skip hasnans check in numops if eager_check (commit: e031d00) — gurwls223 / githubweb
  18. [SPARK-37291][PYSPARK][FOLLOWUP] PySpark create SparkSession should pass (commit: 1a43112) — gurwls223 / githubweb
  19. [SPARK-36396][PYTHON] Implement DataFrame.cov (commit: e3256b8) — gurwls223 / githubweb
  20. [MINOR][DOC] Update doc for `ResourceProfileManager.isSupported` (commit: ac7c52d) — gurwls223 / githubweb
  21. [SPARK-37505][MESOS][TESTS] Add a log4j.properties for `mesos` module UT (commit: fdb33dd) — dongjoon / githubweb
  22. [SPARK-37509][CORE] Improve Fallback Storage upload speed by avoiding S3 (commit: ca25534) — dongjoon / githubweb
  23. [SPARK-37497][K8S] Promote (commit: 2b04496) — dongjoon / githubweb
  24. [SPARK-37490][SQL] Show extra hint if analyzer fails due to ANSI type (commit: d61c2f4) — gengliang / githubweb
  25. [SPARK-37376][SQL] Introduce a new DataSource V2 interface (commit: e7fa289) — dongjoon / githubweb
  26. [SPARK-37480][K8S][DOC] Sync Kubernetes configuration to latest in (commit: f7be024) — dongjoon / githubweb
  27. [SPARK-37326][SQL] Support TimestampNTZ in CSV data source (commit: ce1f97f) — max.gekk / githubweb
  28. [SPARK-37458][SS] Remove unnecessary SerializeFromObject from the plan (commit: 3d9c588) — dongjoon / githubweb
  29. [SPARK-37513][SQL][DOC] date +/- interval with only day-time fields (commit: ec47c3c) — wenchen / githubweb
  30. [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments (commit: eaa1358) — wenchen / githubweb
  31. [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark (commit: 654cd97) — gurwls223 / githubweb
  32. [SPARK-37508][SQL] Add CONTAINS() string function (commit: 710120a) — max.gekk / githubweb
  33. [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION (commit: 5924961) — wenchen / githubweb

#871 (Nov 28, 2021, 9:24:05 PM)

  1. [SPARK-37461][YARN] YARN-CLIENT mode client.appId is always null (commit: db9a982) — srowen / githubweb

#870 (Nov 27, 2021, 2:29:56 PM)

  1. [SPARK-32079][PYTHON] Remove namedtuple hack by replacing built-in (commit: d192d96) — gurwls223 / githubweb
  2. Revert "[SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to (commit: 444cfe6) — gurwls223 / githubweb
  3. [SPARK-37436][PYTHON] Uses Python's standard string formatter for SQL (commit: 69e1151) — gurwls223 / githubweb
  4. [SPARK-37457][PYTHON] Update cloudpickle to v2.0.0 (commit: 95fc4c5) — gurwls223 / githubweb
  5. [SPARK-34735][SQL][UI] Add modified configs for SQL execution in UI (commit: 7b50cf0) — gengliang / githubweb
  6. [SPARK-37437][BUILD] Remove unused hive profile and related CI test (commit: f399d0d) — srowen / githubweb

#869 (Nov 25, 2021, 12:11:07 PM)

  1. [SPARK-37013][CORE][SQL][FOLLOWUP] Use the new error framework to throw (commit: 537b102) — wenchen / githubweb
  2. [SPARK-37380][PYTHON] Miscellaneous Python lint infra cleanup (commit: c1029dc) — gurwls223 / githubweb
  3. [SPARK-37389][SQL] Check unclosed bracketed comments (commit: ff249c3) — wenchen / githubweb
  4. [MINOR][DOCS] Fix scaladoc for skewed partitions optimization (commit: d57f1bb) — wenchen / githubweb
  5. [SPARK-37399][SPARK-37403][PYSPARK][ML] Merge {ml, mllib}/common.pyi (commit: 3565c3a) — mszymkiewicz / githubweb
  6. [MINOR][DOCS] Update scaladoc of KnownSizeEstimation (commit: 6c73cee) — srowen / githubweb
  7. [SPARK-37444][SQL] ALTER NAMESPACE ... SET LOCATION should handle empty (commit: 24561ca) — wenchen / githubweb
  8. [MINOR][SQL] Fix the error message typo in QueryExecutionErrors.scala (commit: 01ddbf6) — gurwls223 / githubweb
  9. [SPARK-37453][INFRA][SQL][TESTS] Split TPC-DS build in GitHub Actions (commit: 27eb687) — gurwls223 / githubweb
  10. [SPARK-37446][SQL] Use reflection for getWithoutRegisterFns to allow (commit: 04671bd) — gurwls223 / githubweb
  11. [SPARK-37459][BUILD] Upgrade commons-cli to 1.5.0 (commit: 338d10f) — gurwls223 / githubweb
  12. [SPARK-37456][SQL] CREATE NAMESPACE should qualify location for v2 (commit: 945514c) — wenchen / githubweb
  13. [SPARK-34332][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET LOCATION (commit: f175362) — wenchen / githubweb
  14. [SPARK-36861][SQL] Use `yyyy-MM-dd` as the date pattern in partition (commit: 2c69f14) — wenchen / githubweb
  15. [SPARK-37454][SQL] Support expressions in time travel timestamp (commit: 76191b9) — wenchen / githubweb
  16. [SPARK-37357][SQL] Add small partition factor for rebalance partitions (commit: 307ecf0) — wenchen / githubweb
  17. [SPARK-37311][SQL] Migrate ALTER NAMESPACE ... SET LOCATION to use V2 (commit: b79de91) — wenchen / githubweb
  18. [SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to hadoop-3 and (commit: a98f9f2) — wenchen / githubweb

#868 (Nov 23, 2021, 5:06:50 AM)

  1. [SPARK-37104][PYTHON] Make RDD and DStream covariant (commit: ef4f254) — mszymkiewicz / githubweb
  2. [SPARK-37209][YARN][TESTS] Fix `YarnShuffleIntegrationSuite` releated (commit: a7b3fc7) — srowen / githubweb
  3. Revert "[SPARK-36231][PYTHON] Support arithmetic operations of (commit: 406455d) — gurwls223 / githubweb
  4. [SPARK-37354][K8S][TESTS] Make the Java version installed on the (commit: a85c51f) — sarutak / githubweb
  5. [SPARK-37388][SQL] Fix NPE in WidthBucket in WholeStageCodegenExec (commit: 77f3974) — wenchen / githubweb
  6. [MINOR][R][DOCS] Fix misplaced brackets in SparkR:::mapValues doc (commit: 550122b) — mszymkiewicz / githubweb
  7. [SPARK-36357][SQL] Support pushdown Timestamp without time zone for orc (commit: 3f45b7f) — wenchen / githubweb
  8. [SPARK-37192][SQL] Migrate SHOW TBLPROPERTIES to use V2 command by (commit: ef4a009) — wenchen / githubweb
  9. [SPARK-37337][PYTHON] Improve the API of Spark DataFrame to (commit: bc7d55f) — gurwls223 / githubweb
  10. [SPARK-30537][PYTHON] Fix toPandas  wrong dtypes when applied on empty (commit: 48365df) — gurwls223 / githubweb
  11. [SPARK-37438][SQL] ANSI mode: Use store assignment rules for resolving (commit: 5d3a657) — gengliang / githubweb
  12. [SPARK-36231][PYTHON] Support arithmetic operations of decimal(nan) (commit: 3235edb) — gurwls223 / githubweb

#867 (Nov 20, 2021, 11:50:29 PM)

  1. [SPARK-37224][SS][FOLLOWUP] Clarify the guide doc and fix the method doc (commit: b14fc2d) — kabhwan.opensource / githubweb
  2. [SPARK-37374][PYTHON] Fix StatCounter to use mergeStats when merging (commit: 15f25cb) — gurwls223 / githubweb
  3. [SPARK-37371][SQL] UnionExec should support columnar if all children (commit: 0398b5b) — viirya / githubweb
  4. [SPARK-37370][SQL] Add SQL configs to control newly added join code-gen (commit: 43b05e7) — wenchen / githubweb
  5. [SPARK-35672][FOLLOWUP][TESTS] Add an exclusion rule to (commit: 145436c) — dongjoon / githubweb
  6. [SPARK-37038][SQL][TESTS][FOLLOWUP] Fix flaky test by loosening the (commit: 3a197f0) — gurwls223 / githubweb
  7. [SPARK-37384][CORE][TESTS] Increase timeout for job termination in (commit: d5006ec) — gurwls223 / githubweb
  8. [SPARK-37386][SQL] Simplify OptimizeSkewedJoin to not run the cost (commit: 227715e) — wenchen / githubweb
  9. [SPARK-35672][FOLLOWUP][TESTS] Add more exclusion rules to (commit: 4f20898) — sarutak / githubweb
  10. [SPARK-37385][SQL][TESTS] Add tests for TimestampNTZ and TimestampLTZ (commit: 5815ddd) — wenchen / githubweb
  11. [SPARK-37224][SS][FOLLOWUP] Add benchmark on basic state store (commit: 9e408f6) — viirya / githubweb
  12. [SPARK-36997][PYTHON][TESTS] Run mypy tests against ml, sql, streaming (commit: 53f9334) — mszymkiewicz / githubweb
  13. [SPARK-37379][SQL] Add tree pattern pruning to CTESubstitution rule (commit: 3b4eb1f) — joshrosen / githubweb
  14. [SPARK-37282][TESTS][FOLLOWUP] Extract `Utils.isMacOnAppleSilicon` for (commit: c6c72a4) — dongjoon / githubweb
  15. [SPARK-37390][PYTHON][DOCS] Add default value to getattr(app, (commit: b9e9167) — mszymkiewicz / githubweb

#866 (Nov 18, 2021, 5:51:42 PM)

  1. [SPARK-37346][DOC] Add migration guide link for structured streaming (commit: 1b84a6b) — gurwls223 / githubweb
  2. [SPARK-37345][CORE] Add `java.security.jgss/sun.security.krb5` to (commit: 02b0545) — yumwang / githubweb
  3. [SPARK-36231][PYTHON] Support arithmetic operations of decimal(nan) (commit: 4529dba) — gurwls223 / githubweb
  4. [SPARK-37341][SQL] Avoid unnecessary buffer and copy in full outer sort (commit: 6e97a28) — wenchen / githubweb
  5. [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark (commit: 38b23a0) — gurwls223 / githubweb
  6. [SPARK-37270][SQL] Fix push foldable into CaseWhen branches if elseValue (commit: b10b88f) — wenchen / githubweb
  7. [SPARK-37702][SQL][FOLLOWUP] Store referred temp functions for (commit: b6c472e) — wenchen / githubweb
  8. [SPARK-37352][PYTHON] Silence the index_col advice in to_spark() for (commit: 719e2f5) — gurwls223 / githubweb
  9. [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests (commit: 06586f6) — wenchen / githubweb
  10. [SPARK-37316][SQL] Add code-gen for existence sort merge join (commit: dfca899) — wenchen / githubweb
  11. [SPARK-37181][PYTHON] pyspark.pandas.read_csv() should support latin-1 (commit: 785ca85) — gurwls223 / githubweb
  12. [SPARK-36924][SQL] CAST between ANSI intervals and IntegralType (commit: 9553ed7) — wenchen / githubweb
  13. [SPARK-37279][PYTHON][SQL] Support DayTimeIntervalType in (commit: e2e1e42) — gurwls223 / githubweb
  14. [SPARK-37230][DOCS][PYTHON] Document DataFrame.mapInArrow in PySpark (commit: 6450f6b) — gurwls223 / githubweb
  15. [SPARK-36646][SQL] Push down group by partition column for aggregate (commit: b9a0c56) — viirya / githubweb
  16. [SPARK-36346][SQL] Support TimestampNTZ type in Orc file source (commit: 6f6a066) — gengliang / githubweb
  17. [SPARK-37308][SQL][TESTS] Partially revert SPARK-37214's test due to (commit: 9a7632e) — gurwls223 / githubweb
  18. [SPARK-37281][PYTHON] Support DayTimeIntervalType in Py4J (commit: 2cd3b1e) — gurwls223 / githubweb
  19. [SPARK-37368][SQL][TESTS] Explicit GC for TPC-DS query runs (commit: 99d2d57) — gurwls223 / githubweb
  20. [SPARK-37224][SS] Optimize write path on RocksDB state store provider (commit: 1c26113) — kabhwan.opensource / githubweb
  21. [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and (commit: 88e53e5) — gurwls223 / githubweb
  22. [SPARK-37155][PYTHON] Inline type hints for (commit: 3d0663c) — mszymkiewicz / githubweb
  23. [SPARK-37356][CORE] Add fine grained locking to the BlockInfoManager (commit: 9d19c27) — herman / githubweb
  24. [SPARK-37219][SQL][FOLLOWUP] Make AS OF syntax more flexible (commit: f361ad8) — huaxin_gao / githubweb
  25. [MINOR][R][DOCS] Fix minor issues in SparkR docs examples (commit: 207dd4c) — gurwls223 / githubweb
  26. [SPARK-37336][ML][PYTHON] Migrate _java2py from SQLContext to (commit: fa3db73) — gurwls223 / githubweb

#865 (Nov 16, 2021, 12:37:11 PM)

  1. [SPARK-37317][MLLIB][TESTS] Reduce weights in GaussianMixtureSuite (commit: a1f2ae0) — dongjoon / githubweb
  2. [SPARK-37320][K8S][TESTS] Delete py_container_checks.zip after the test (commit: d8cee85) — dongjoon / githubweb
  3. [SPARK-37322][TESTS] `run_scala_tests` should respect test module order (commit: c2221a8) — dongjoon / githubweb
  4. [SPARK-37289][SQL] Remove `partitionSchemaOption` function (commit: 950422f) — dongjoon / githubweb
  5. [SPARK-37228][SQL][PYTHON] Implement DataFrame.mapInArrow in Python (commit: 775e05f) — gurwls223 / githubweb
  6. [SPARK-36533][SS][FOLLOWUP] Support Trigger.AvailableNow in PySpark (commit: edbc7cf) — kabhwan.opensource / githubweb
  7. [SPARK-37319][K8S] Support K8s image building with Java 17 (commit: bb9e1d9) — sarutak / githubweb
  8. [SPARK-36533][SS][FOLLOWUP] Address Trigger.AvailableNow in PySpark in (commit: f43d8b5) — kabhwan.opensource / githubweb
  9. [SPARK-32567][SQL][FOLLOWUP] Fix CompileException when code generate for (commit: 2011ab5) — viirya / githubweb
  10. [SPARK-36223][SQL][TEST] Cover 3 kinds of join in the (commit: 7070eb5) — wenchen / githubweb
  11. [SPARK-37327][PYTHON] Silence the to_pandas() advice log for internal (commit: 27abceb) — gurwls223 / githubweb
  12. [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI (commit: 3da5608) — wenchen / githubweb
  13. [SPARK-35352][SQL] Add code-gen for full outer sort merge join (commit: 2ef60f7) — wenchen / githubweb
  14. [SPARK-37266][SQL] View text can only be SELECT queries (commit: 6391655) — wenchen / githubweb
  15. [SPARK-37339][K8S] Add `spark-version`  label to driver and executor (commit: 32054e1) — dongjoon / githubweb
  16. [SPARK-37335][ML] Flesh out FPGrowth docs (commit: ff2608c) — srowen / githubweb
  17. [SPARK-36876][SQL][TESTS][FOLLOW-UP] Remove unnecessary matching cases (commit: 43ca308) — gurwls223 / githubweb
  18. [SPARK-37332][SQL] Allow ANSI intervals in `ALTER TABLE .. ADD COLUMNS` (commit: 0f20678) — max.gekk / githubweb
  19. [SPARK-37342][BUILD] Upgrade Apache Arrow to 6.0.0 (commit: 9665461) — gurwls223 / githubweb
  20. [SPARK-37219][SQL] Add AS OF syntax support (commit: e99fdf9) — wenchen / githubweb
  21. [SPARK-35672][CORE][YARN] Pass user classpath entries to executors using (commit: 693537f) — piros.attila.zsolt / githubweb

#864 (Nov 14, 2021, 7:35:21 AM)

  1. [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions (commit: 68a0ab5) — wenchen / githubweb
  2. [SPARK-37304][SQL] Allow ANSI intervals in v2 `ALTER TABLE .. REPLACE (commit: 71f4ee3) — max.gekk / githubweb
  3. [SPARK-37302][BUILD] Explicitly downloads guava and jetty-io in (commit: 01ab0be) — dongjoon / githubweb
  4. [SPARK-37292][SQL][FOLLOWUP] Simplify the condition when removing outer (commit: aaf0e5e) — viirya / githubweb
  5. [SPARK-37298][SQL] Use unique exprIds in RewriteAsOfJoin (commit: 8e05c78) — ueshin / githubweb
  6. [SPARK-37312][TESTS] Add `.java-version` to `.gitignore` and (commit: d0eb621) — sarutak / githubweb
  7. [SPARK-37282][TESTS][FOLLOWUP] Mark `YarnShuffleServiceSuite` as (commit: 8b45a08) — sarutak / githubweb
  8. [SPARK-37139][PYTHON][FOLLOWUP] Fix class variable type hints in (commit: fd6079d) — gurwls223 / githubweb
  9. [SPARK-37314][K8S][BUILD] Upgrade kubernetes-client to 5.10.1 (commit: 4d29bec) — dongjoon / githubweb
  10. [SPARK-37307][CORE] Don't obtain JDBC connection for empty partitions (commit: 07134c7) — huaxin_gao / githubweb
  11. [SPARK-37315][ML][TEST] Mitigate ConcurrentModificationException thrown (commit: 6426dcf) — dongjoon / githubweb
  12. [SPARK-37291][PYTHON][SQL] PySpark init SparkSession should copy conf to (commit: 6d6ef76) — dongjoon / githubweb
  13. [SPARK-37318][CORE][TESTS] Make `FallbackStorageSuite` robust in terms (commit: 41f9df9) — dongjoon / githubweb

#863 (Nov 12, 2021, 3:19:12 AM)

  1. Revert "[SPARK-36575][CORE] Should ignore task finished event if its (commit: 16e2604) — yi.wu / githubweb
  2. [SPARK-37022][PYTHON] Use black as a formatter for  PySpark (commit: 2fe9af8) — gurwls223 / githubweb
  3. [SPARK-37022][PYTHON][FOLLOW-UP] Change python/pyproject.toml to (commit: e6865b3) — gurwls223 / githubweb
  4. [SPARK-37261][SQL] Allow adding partitions with ANSI intervals in DSv2 (commit: 2a1267a) — max.gekk / githubweb
  5. [SPARK-37236][PYTHON] Inline type hints for KernelDensity.py, test.py in (commit: 7d9a4fa) — mszymkiewicz / githubweb
  6. [SPARK-37272][TESTS] Add `ExtendedRocksDBTest` and disable RocksDB tests (commit: 9666046) — dongjoon / githubweb
  7. [SPARK-36799][SQL] Pass queryExecution name in CLI (commit: a406e41) — wenchen / githubweb
  8. [SPARK-36182][SQL] Support TimestampNTZ type in Parquet data source (commit: ef5278f) — wenchen / githubweb
  9. [SPARK-36073][SQL] EquivalentExpressions fixes and improvements (commit: f153029) — wenchen / githubweb
  10. [SPARK-37282][TESTS] Add `ExtendedLevelDBTest` and disable LevelDB tests (commit: a116045) — dongjoon / githubweb
  11. [SPARK-37023][CORE] Avoid fetching merge status when shuffleMergeEnabled (commit: f1532a2) — mridulatgmail.com / githubweb
  12. [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan (commit: f9713b6) — wenchen / githubweb
  13. [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize (commit: 6432caf) — wenchen / githubweb
  14. [SPARK-37284][BUILD] Upgrade Jekyll to 4.2.1 (commit: 538eb96) — dongjoon / githubweb
  15. [SPARK-35011][CORE] Fix false active executor in UI that caused by (commit: 5475088) — dongjoon / githubweb
  16. [SPARK-37268][SQL] Remove unused method call in FileScanRDD (commit: 6a54348) — dongjoon / githubweb
  17. [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class (commit: 10c0777) — gurwls223 / githubweb
  18. [SPARK-37022][PYTHON][FOLLOWUP] Remove unnecessary comment in (commit: 976d292) — gurwls223 / githubweb
  19. [SPARK-37293][TESTS] Remove explicit GC options from Scala tests (commit: 5b002c8) — dongjoon / githubweb
  20. [MINOR][DOCS] Add Scala 2.13 to index.md and build-spark.md (commit: d018503) — dongjoon / githubweb
  21. [SPARK-37296][PYTHON] Add missing type hints in python/pyspark/util.py (commit: 6108364) — gurwls223 / githubweb
  22. [SPARK-37292][SQL] Removes outer join if it only has DISTINCT on (commit: 60da257) — dongjoon / githubweb
  23. [MINOR][PYTHON][DOCS] Remove the reference of typeName as DDL format in (commit: 007afbb) — dongjoon / githubweb
  24. [SPARK-36825][FOLLOWUP] Move the test code from `ParquetIOSuite` to (commit: 9191632) — gurwls223 / githubweb
  25. [SPARK-37294][SQL][TESTS] Check inserting of ANSI intervals into a table (commit: a4b8a8d) — max.gekk / githubweb

#862 (Nov 9, 2021, 11:12:16 PM)

  1. [SPARK-37232][BUILD] Upgrade ORC to 1.7.1 (commit: a3cb70a) — dongjoon / githubweb
  2. [SPARK-37120][BUILD] Add Daily GitHub Action jobs for Java11/17 (commit: 442dedb) — gurwls223 / githubweb
  3. [SPARK-37221][SQL] The collect-like API in SparkPlan should support (commit: e2ea690) — viirya / githubweb
  4. [SPARK-35437][SQL] Use expressions to filter Hive partitions at client (commit: 5cb0fb3) — sunchao / githubweb
  5. [SPARK-37199][SQL] Add deterministic field to QueryPlan (commit: fe41d18) — wenchen / githubweb
  6. [SPARK-37214][SQL] Fail query analysis earlier with invalid identifiers (commit: 8ab9d63) — wenchen / githubweb
  7. [SPARK-37231][SQL] Dynamic writes/reads of ANSI interval partitions (commit: 7ef6a2e) — sarutak / githubweb
  8. [SPARK-37211][INFRA] Added descriptions and an image to the guide for (commit: e29c4e1) — sarutak / githubweb
  9. Revert "[SPARK-36038][CORE] Speculation metrics summary at stage level" (commit: 4f16d38) — sarutak / githubweb
  10. [SPARK-36895][SQL][FOLLOWUP] Use property to specify index type (commit: 4011dd6) — wenchen / githubweb
  11. [SPARK-37243][SQL][DOC] Fix the format of the document (commit: 7cd4259) — srowen / githubweb
  12. [MINOR][INFRA] Explicitly specify Java version for lint test on GA (commit: 06bdea0) — srowen / githubweb
  13. Revert "[SPARK-36895][SQL][FOLLOWUP] Use property to specify index type" (commit: 597cee6) — sarutak / githubweb
  14. [SPARK-37225][SQL] Support reading and writing ANSI intervals from/to (commit: 562f43c) — wenchen / githubweb
  15. [SPARK-37241][BUILD] Upgrade Jackson to 2.13.0 (commit: a47d380) — dongjoon / githubweb
  16. [SPARK-37240][SQL] Handle ANSI intervals by (commit: 61e9789) — sarutak / githubweb
  17. [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0 (commit: 895a1fc) — dongjoon / githubweb
  18. [SPARK-36895][SQL][FOLLOWUP] Use property to specify index type (commit: d8a4a8c) — sarutak / githubweb
  19. [SPARK-37196][SQL] HiveDecimal enforcePrecisionScale failed return null (commit: a4f8ffb) — dongjoon / githubweb
  20. [SPARK-37120][BUILD][FOLLOWUP] Use configured Java version in SQL/Hive (commit: e9e7eee) — dongjoon / githubweb
  21. [SPARK-37235][PYTHON] Inline type hints for (commit: bde1bd4) — gurwls223 / githubweb
  22. [SPARK-37252][PYTHON][TESTS] Ignore `test_memory_limit` on non-Linux (commit: 2c7f201) — dongjoon / githubweb
  23. [SPARK-37239][YARN] Avoid call `setReplication` if yarn Client uploading (commit: acd0672) — sunchao / githubweb
  24. [SPARK-37244][PYTHON] Build and run tests on Python 3.10 (commit: 2faa144) — dongjoon / githubweb
  25. [MINOR][DOCS] Fix typos in python user guide and "the the" in the whole (commit: b6ac331) — sarutak / githubweb
  26. Revert "[SPARK-36998][CORE] Handle concurrent eviction of same (commit: 0d7244c) — gurwls223 / githubweb
  27. [SPARK-37244][PYTHON][FOLLOWUP] Adjust `pyspark.rdd` doctest (commit: 47ceae4) — gurwls223 / githubweb
  28. [SPARK-37253][PYTHON] `try_simplify_traceback` should not fail when (commit: 8ae88d0) — gurwls223 / githubweb
  29. [SPARK-37257][PYTHON] Update setup.py for Python 3.10 (commit: 06175c0) — dongjoon / githubweb
  30. [SPARK-37239][YARN][TESTS][FOLLOWUP] Add UT to cover (commit: f6a044c) — dongjoon / githubweb
  31. [SPARK-37120][BUILD][FOLLOWUP] Test master branch and skip mima/unidoc (commit: 4bba110) — gurwls223 / githubweb
  32. [MINOR][CORE] Fix error message when requested executor memory exceeds (commit: abecdfe) — gurwls223 / githubweb
  33. [SPARK-37221][SQL][FOLLOWUP] Add toRowBased to SparkPlan (commit: e1f3f22) — viirya / githubweb
  34. [SPARK-36575][CORE] Should ignore task finished event if its task set is (commit: bc80c84) — yi.wu / githubweb
  35. [SPARK-37264][BUILD] Exclude `hadoop-client-api` transitive dependency (commit: b89f415) — sarutak / githubweb

#861 (Nov 7, 2021, 1:06:54 PM)

  1. [SPARK-37151][CORE] Avoid ExecutorStateChanged sync attempt retry (commit: 4e81cb8) — dongjoon / githubweb
  2. [SPARK-37208][YARN] Support mapping Spark gpu/fpga resource types to (commit: 8e6f636) — dongjoon / githubweb
  3. [SPARK-35496][BUILD] Upgrade Scala to 2.13.7 (commit: eb7adb1) — dongjoon / githubweb
  4. [SPARK-37218][SQL][TEST] Parameterize `spark.sql.shuffle.partitions` in (commit: 128d2c9) — sunchao / githubweb
  5. [SPARK-36998][CORE] Handle concurrent eviction of same application in (commit: 39ad0d7) — dongjoon / githubweb
  6. [SPARK-37220][SQL] Do not split input file for Parquet reader with (commit: d3a1337) — sunchao / githubweb
  7. [SPARK-36665][SQL] Add more Not operator simplifications (commit: 977dd05) — viirya / githubweb
  8. [SPARK-37223][SQL][TESTS] Fix unit test check in JoinHintSuite (commit: ddf27bd) — srowen / githubweb
  9. [SPARK-37207][SQL][PYTHON] Add isEmpty method for the Python DataFrame (commit: 1047708) — srowen / githubweb

#860 (Nov 5, 2021, 10:54:41 AM)

  1. [SPARK-36894][SPARK-37077][PYTHON] Synchronize RDD.toDF annotations with (commit: b874bf5) — sarutak / githubweb
  2. [MINOR][SQL][DOCS] Document JDBC aggregate push down is for DSV2 only (commit: 44151be) — huaxin_gao / githubweb
  3. [SPARK-36566][K8S] Add Spark appname as a label to pods (commit: bb77e7b) — dongjoon / githubweb
  4. [SPARK-37108][R] Expose make_date expression in R (commit: 5f997c7) — sarutak / githubweb
  5. [SPARK-37190][SQL] Improve error messages for Cast under ANSI mode (commit: a4bdca8) — wenchen / githubweb
  6. [SPARK-37206][BUILD] Upgrade Avro to 1.11.0 (commit: 1325481) — dongjoon / githubweb
  7. [SPARK-37038][SQL] DSV2 Sample Push Down (commit: e91d461) — wenchen / githubweb
  8. [SPARK-36989][TESTS][PYTHON][FOLLOW-UP] Move pyproject.toml from python (commit: d7a608d) — gurwls223 / githubweb
  9. [SPARK-37149][SQL][FOLLOWUP] Update error messages for arithmetic (commit: 840ce67) — gurwls223 / githubweb
  10. [SPARK-37157][PYTHON] Inline type hints for python/pyspark/util.py (commit: 8f20398) — gurwls223 / githubweb
  11. [SPARK-37137][PYTHON] Inline type hints for python/pyspark/conf.py (commit: 2b4099f) — gurwls223 / githubweb
  12. [SPARK-37203][SQL] Fix NotSerializableException when observe with (commit: 3f3201a) — wenchen / githubweb
  13. [SPARK-32940][SQL] Collect, first and last should be deterministic (commit: 58e07e0) — wenchen / githubweb
  14. [SPARK-37212][SQL] Improve the implement of aggregate pushdown (commit: d563623) — wenchen / githubweb

#859 (Nov 3, 2021, 7:51:35 AM)

  1. [SPARK-36554][SQL][PYTHON] Expose make_date expression in (commit: cf7fbc1) — sarutak / githubweb
  2. [MINOR][DOCS] Corrected spacing in structured streaming programming (commit: 675071a) — gurwls223 / githubweb
  3. [SPARK-37159][SQL][TESTS] Change HiveExternalCatalogVersionsSuite to be (commit: 320fa07) — sarutak / githubweb
  4. [SPARK-37164][SQL] Add ExpressionBuilder for functions with complex (commit: b4a6eb6) — wenchen / githubweb
  5. [SPARK-37168][SQL] Improve error messages for SQL functions and (commit: 6d42230) — wenchen / githubweb
  6. [SPARK-37156][PYTHON] Inline type hints for (commit: 73e8628) — gurwls223 / githubweb
  7. [SPARK-37176][SQL] Sync JsonInferSchema#infer method's exception handle (commit: ec6a3ae) — max.gekk / githubweb
  8. [SPARK-37066][SQL] Improve error message to show file path when failed (commit: b78167a) — srowen / githubweb
  9. [SPARK-36895][SQL][FOLLOWUP] CREATE INDEX command should rely on the (commit: 293c085) — huaxin_gao / githubweb
  10. [SPARK-36935][SQL] Extend ParquetSchemaConverter to compute Parquet (commit: d246010) — dongjoon / githubweb
  11. [SPARK-32567][SQL] Add code-gen for full outer shuffled hash join (commit: 78cc91c) — wenchen / githubweb
  12. [SPARK-37191][SQL] Allow merging DecimalTypes with different precision (commit: 90c23eb) — wenchen / githubweb
  13. [SPARK-24774][SQL][FOLLOWUP] Remove unused code in (commit: 59c55dd) — max.gekk / githubweb
  14. [SPARK-37179][SQL] ANSI mode: Add a config to allow casting between (commit: 2afa52d) — wenchen / githubweb
  15. [SPARK-37200][SQL] Support drop index for Data Source V2 (commit: 9babf9a) — huaxin_gao / githubweb
  16. [MINOR][PYTHON][DOCS] Fix broken link in legacy Apache Arrow in PySpark (commit: ab7e503) — sarutak / githubweb
  17. [SPARK-36894][SPARK-37077][PYTHON] Synchronize RDD.toDF annotations with (commit: 855da09) — mszymkiewicz / githubweb
  18. Revert "[SPARK-36894][SPARK-37077][PYTHON] Synchronize RDD.toDF (commit: 8687138) — sarutak / githubweb

#858 (Nov 1, 2021, 10:59:44 AM)

  1. [SPARK-37062][SS] Introduce a new data source for providing consistent (commit: 70fde44) — kabhwan.opensource / githubweb
  2. [MINOR][DOCS] Add import for MultivariateGaussian to Docs (commit: 11de0fd) — srowen / githubweb

#857 (Nov 1, 2021, 3:47:31 AM)

  1. [SPARK-37102][BUILD] Removed redundant exclusions in `hadoop-cloud` (commit: 6906328) — srowen / githubweb
  2. [SPARK-37165][SQL] Add REPEATABLE in TABLESAMPLE to specify seed (commit: b0548c6) — huaxin_gao / githubweb
  3. [SPARK-37138][SQL] Support ANSI Interval types in (commit: 08123a3) — max.gekk / githubweb
  4. [SPARK-37147][SS] MetricsReporter producing NullPointerException when (commit: 547996e) — kabhwan.opensource / githubweb
  5. [MINOR][SS] Remove unused config "pauseBackgroundWorkForCommit" from (commit: 00d9ed5) — kabhwan.opensource / githubweb
  6. [SPARK-37129][TESTS] Supplement Java 17 benchmark results created by (commit: 7cec160) — gurwls223 / githubweb
  7. [MINOR][SQL][DOCS] Correct typo in sql migration guide (commit: a4382fe) — gurwls223 / githubweb
  8. [SPARK-37170][PYTHON][DOCS] Pin PySpark version installed in the Binder (commit: 72a9f9c) — gurwls223 / githubweb
  9. [SPARK-37160][SQL] Add a config to optionally disable padding for char (commit: 4df40ea) — wenchen / githubweb
  10. [SPARK-37150][SQL] Migrate DESCRIBE NAMESPACE to use V2 command by (commit: 13c372d) — wenchen / githubweb
  11. [SPARK-37161][SQL] RowToColumnConverter support AnsiIntervalType (commit: d43a678) — max.gekk / githubweb

#856 (Oct 30, 2021, 12:33:58 AM)

  1. [SPARK-37133][SQL] Add a config to optionally enforce ANSI reserved (commit: cfb96eb) — wenchen / githubweb
  2. [SPARK-37135][TEST] Fix `KryoSerializerBenchmark` and (commit: 4288ddc) — gurwls223 / githubweb
  3. [SPARK-36928][SQL] Handle ANSI intervals in ColumnarRow, (commit: fd8d5ad) — max.gekk / githubweb
  4. [SPARK-37136][SQL] Remove code about hive buildin function but not (commit: 7ed7afe) — wenchen / githubweb
  5. [SPARK-37118][PYTHON][ML] Add distanceMeasure param to trainKMeansModel (commit: 09ec7ca) — srowen / githubweb
  6. [MINOR][SS][DOCS] Point to correct examples of Arbitrary Stateful (commit: 5b2bbce) — viirya / githubweb
  7. [SPARK-37141][TESTS] Fix WorkerSuite failure on MacOS (commit: b3b7e64) — dongjoon / githubweb
  8. [SPARK-37143][TESTS] Supplement the missing Java 11 benchmark result (commit: 4a09e74) — dongjoon / githubweb
  9. [SPARK-36627][CORE] Fix java deserialization of proxy classes (commit: 90fe41b) — srowen / githubweb
  10. [SPARK-37020][SQL] DS V2 LIMIT push down (commit: 9821a28) — huaxin_gao / githubweb
  11. [SPARK-34960][SQL] Aggregate push down for ORC (commit: 609e749) — viirya / githubweb
  12. [SPARK-37139][PYTHON] Inline type hints for (commit: f59e1d5) — gurwls223 / githubweb
  13. [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py (commit: 337dbf1) — gurwls223 / githubweb
  14. [SPARK-37144][PYTHON] Inline type hints for python/pyspark/file.py (commit: a74f76c) — gurwls223 / githubweb
  15. [SPARK-37107][PYTHON] Inline type hints for python/pyspark/status.py (commit: 92f18ad) — gurwls223 / githubweb
  16. [SPARK-37134][PYTHON][DOCS] Clarify the options in "Using PySpark Native (commit: f258d30) — gurwls223 / githubweb
  17. [SPARK-37149][SQL] Improve error messages for arithmetic overflow (commit: e582799) — wenchen / githubweb
  18. [SPARK-36975][SQL] Correct the hive client calls‘s metrics in (commit: 2c08fc7) — wenchen / githubweb
  19. [SPARK-37140][PYTHON] Inline type hints for (commit: 8238cdd) — mszymkiewicz / githubweb
  20. [SPARK-37117][SQL] Fix reading encrypted parquet files with external key (commit: 6fd93b3) — huaxin_gao / githubweb

#855 (Oct 27, 2021, 8:15:36 PM)

  1. [SPARK-37103][INFRA] Switch from Maven to SBT to build Spark on AppVeyor (commit: 3fc16fc) — gurwls223 / githubweb
  2. Revert "[SPARK-37103][INFRA] Switch from Maven to SBT to build Spark on (commit: 5c28b6e) — gurwls223 / githubweb
  3. [SPARK-37037][SQL] Improve byte array sort by unify compareTo function (commit: 74d974a) — srowen / githubweb
  4. [SPARK-37091][R] SystemRequirements to include Java < 18 (commit: 3608971) — gurwls223 / githubweb
  5. [SPARK-37103][INFRA] Switch from Maven to SBT to build Spark on AppVeyor (commit: 10080fa) — gurwls223 / githubweb
  6. [SPARK-37047][SQL][FOLLOWUP] lpad/rpad should fail if parameter str and (commit: 5d531fc) — gurwls223 / githubweb
  7. [SPARK-37081][SQL][TESTS] Upgrade the version of RDBMS and corresponding (commit: 28685e3) — gurwls223 / githubweb
  8. [SPARK-37089][SQL] Do not register ParquetFileFormat completion listener (commit: 1fc1d07) — gurwls223 / githubweb
  9. [SPARK-36968][PYTHON] ps.Series.dot raise "matrices are not aligned" if (commit: cf81e9c) — gurwls223 / githubweb
  10. [SPARK-37084][SQL] Set spark.sql.files.openCostInBytes to bytesConf (commit: 76a317a) — gurwls223 / githubweb
  11. [SPARK-37101][CORE] In class ShuffleBlockPusher, use config instead of (commit: adf9b64) — gurwls223 / githubweb
  12. [SPARK-37098][SQL] Alter table properties should invalidate cache (commit: 02d3b3b) — yao / githubweb
  13. [SPARK-35437][SQL] Use expressions to filter Hive partitions at client (commit: f1727a6) — dongjoon / githubweb
  14. [SPARK-37106][YARN] Pass all UTs in `resource-managers/yarn` with Java (commit: 2362a6f) — dongjoon / githubweb
  15. [SPARK-37072][CORE] Pass all UTs in `repl` with Java 17 (commit: 86f080f) — dongjoon / githubweb
  16. [SPARK-37105][TEST] Pass all UTs in `sql/hive` with Java 17 (commit: f44f9b4) — dongjoon / githubweb
  17. [SPARK-36956][MLLIB] model prediction in .mllib avoid conversion to (commit: d5563f3) — huaxin_gao / githubweb
  18. [SPARK-37011][PYTHON][BUILD] update flake8 on jenkins workers (commit: 4e1e33b) — incomplete / githubweb
  19. [SPARK-37112][BUILD] Fix MiMa failure with Scala 2.13 (commit: ce2930c) — gurwls223 / githubweb
  20. [SPARK-37113][BUILD] Upgrade Parquet to 1.12.2 (commit: 87591c9) — d_tsai / githubweb
  21. [SPARK-37087][SQL] Merge three relation resolution rules into one (commit: b9c3781) — wenchen / githubweb
  22. [SPARK-36890][K8S] Use default WebsocketPingInterval for Kubernetes (commit: 457b75e) — dongjoon / githubweb
  23. [SPARK-36989][TESTS][PYTHON] Add type hints data tests (commit: 6d3cfed) — mszymkiewicz / githubweb
  24. [SPARK-36895][SQL] Add Create Index syntax support (commit: 677aba2) — d_tsai / githubweb
  25. Revert "[SPARK-35437][SQL] Use expressions to filter Hive partitions at (commit: fb9d6ae) — gurwls223 / githubweb
  26. [SPARK-37031][SQL][TESTS] Unify v1 and v2 DESCRIBE NAMESPACE tests (commit: d2aeba6) — wenchen / githubweb
  27. [SPARK-36348][PYTHON][FOLLOWUP] Complete test_astype for index (commit: c7d9bd2) — gurwls223 / githubweb
  28. [SPARK-36647][SQL][TESTS] Push down Aggregate (Min/Max/Count) for (commit: 4aec9d7) — viirya / githubweb
  29. [SPARK-37031][SQL][TESTS][FOLLOWUP] Add a missing test to (commit: 7954a91) — wenchen / githubweb
  30. [SPARK-37125][SQL] Support AnsiInterval radix sort (commit: 101dd6b) — wenchen / githubweb
  31. [SPARK-37115][SQL] HiveClientImpl should use shim to wrap all hive (commit: 1099fd3) — wenchen / githubweb
  32. [SPARK-16280][SPARK-37082][SQL] Implements histogram_numeric aggregation (commit: de0d7fb) — wenchen / githubweb
  33. [SPARK-37071][CORE] Make OpenHashMap serialize without reference (commit: 3319361) — srowen / githubweb
  34. [SPARK-37121][HIVE][TEST] Fix Python version detection bug in TestUtils (commit: 30e1261) — gurwls223 / githubweb
  35. [SPARK-37036][PYTHON] Add util function to raise advice warning for (commit: 502a1ec) — gurwls223 / githubweb

#854 (Oct 23, 2021, 7:08:15 PM)

  1. [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet (commit: 724d6a8) — gurwls223 / githubweb
  2. [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is (commit: 39a0c22) — gurwls223 / githubweb
  3. [SPARK-37050][PYTHON] Update Conda installation instructions (commit: 016ab0c) — gurwls223 / githubweb
  4. [SPARK-37086][R][ML][TESTS] Fix the R test of FPGrowthModel for Scala (commit: 8fbd1fb) — gurwls223 / githubweb
  5. [SPARK-37013][SQL] Forbid `%0$` usage explicitly to ensure (commit: ca861eb) — srowen / githubweb
  6. [SPARK-37073][AVRO][TEST] Pass all UTs in `external/avro` with Java 17 (commit: d355952) — gurwls223 / githubweb
  7. [SPARK-37067][SQL] Use ZoneId.of() to handle timezone string in (commit: c3f6132) — wenchen / githubweb
  8. [SPARK-37084][SQL] Set spark.sql.files.openCostInBytes to bytesConf (commit: 3b3c426) — gurwls223 / githubweb
  9. [SPARK-37056][CORE] Remove unused code in HistoryServer'ss unit test (commit: 8f6af64) — srowen / githubweb

#853 (Oct 21, 2021, 3:47:37 PM)

  1. [SPARK-37041][SQL] Backport HIVE-15025: Secure-Socket-Layer (SSL) (commit: 40f1494) — yumwang / githubweb
  2. [SPARK-37059][PYTHON][TESTS] Ensure the sort order of the output in the (commit: 81aa514) — sarutak / githubweb
  3. [SPARK-37002][PYTHON] Introduce the 'compute.eager_check' option (commit: b1aaefb) — gurwls223 / githubweb
  4. [SPARK-37044][PYTHON] Add Row to __all__ in pyspark.sql.types (commit: 48b3510) — gurwls223 / githubweb
  5. [SPARK-36348][TEST] Complete test_astype for index (commit: b07dd1a) — gurwls223 / githubweb
  6. [SPARK-37049][K8S] executorIdleTimeout should check `creationTimestamp` (commit: 041cd5d) — dongjoon / githubweb
  7. [SPARK-37064][SQL] Fix outer join return the wrong max rows if other (commit: 618072c) — wenchen / githubweb
  8. [SPARK-37046][SQL] Alter view does not preserve column case (commit: ec78522) — wenchen / githubweb
  9. [SPARK-36898][SQL] Make the shuffle hash join factor configurable (commit: bf178e1) — wenchen / githubweb
  10. [SPARK-37058][REPL][TESTS] Add spark-shell command line unit test (commit: deda62d) — wenchen / githubweb
  11. [SPARK-37048][PYTHON] Clean up inlining type hints under SQL module (commit: 64eabb6) — ueshin / githubweb
  12. [SPARK-37025][BUILD] Update RoaringBitmap version to 0.9.22 (commit: eda3fd0) — srowen / githubweb
  13. [SPARK-37061][SQL] Fix CustomMetrics when using Inner Classes (commit: 2ce551e) — dongjoon / githubweb
  14. [SPARK-37033][PYTHON] Inline type hints for (commit: 857d9f9) — gurwls223 / githubweb
  15. [SPARK-36952][PYTHON] Inline type hints for (commit: 482eeca) — gurwls223 / githubweb
  16. [SPARK-37079][PYTHON][SQL] Fix DataFrameWriterV2.partitionedBy to send (commit: 33deeb3) — gurwls223 / githubweb
  17. [SPARK-37078][CORE] Support old 3-parameter Sink constructors (commit: 427816d) — dongjoon / githubweb
  18. [SPARK-37080][INFRA] Add benchmark tool guide in pull request template (commit: 6f0d109) — gurwls223 / githubweb
  19. [SPARK-37076][SQL] Implement StructType.toString explicitly for Scala (commit: c3c58b8) — gurwls223 / githubweb
  20. [SPARK-37075][SQL] Move UDAF expression building from sql/catalyst to (commit: 32aa114) — wenchen / githubweb
  21. [SPARK-33277][PYSPARK][SQL] Writer thread must not access input after (commit: dfca1d1) — wenchen / githubweb
  22. [SPARK-37047][SQL] Add lpad and rpad functions for binary strings (commit: 01bdf84) — wenchen / githubweb
  23. [SPARK-37070][TEST] Pass all UTs in `mllib-local` and `mllib` with Java (commit: 4148fb5) — dongjoon / githubweb
  24. [SPARK-36654][PYTHON] Drop type ignores from numpy imports (commit: dc60791) — mszymkiewicz / githubweb

#852 (Oct 19, 2021, 11:46:37 AM)

  1. [SPARK-37026][ML][BUILD] Ensure the element type of (commit: 0782024) — gurwls223 / githubweb
  2. [SPARK-36151][INFRA] MiMa updates after 3.2.0 release: bump (commit: 47111af) — gurwls223 / githubweb
  3. [SPARK-37032][SQL] Fix broken SQL syntax link in SQL Reference page (commit: e7815b1) — wenchen / githubweb
  4. [SPARK-36978][SQL] InferConstraints rule should create IsNotNull (commit: 0bba90b) — wenchen / githubweb
  5. [SPARK-36965][PYTHON] Extend python test runner by logging out the temp (commit: c29bb02) — piros.attila.zsolt / githubweb
  6. [SPARK-35925][SQL] Support DayTimeIntervalType in width-bucket function (commit: 21fa3ce) — max.gekk / githubweb
  7. [SPARK-36886][PYTHON] Inline type hints for (commit: 25fc495) — ueshin / githubweb
  8. [SPARK-36933][CORE] Clean up TaskMemoryManager.acquireExecutionMemory() (commit: 1ef6c13) — joshrosen / githubweb
  9. [SPARK-36945][PYTHON] Inline type hints for python/pyspark/sql/udf.py (commit: c2ba498) — ueshin / githubweb
  10. [SPARK-36834][SHUFFLE] Add support for namespacing log lines emitted by (commit: 4072a22) — mridulatgmail.com / githubweb
  11. [SPARK-36871][SQL][FOLLOWUP] Move error checking from create cmd to (commit: ebca523) — wenchen / githubweb
  12. [SPARK-37052][CORE] Spark should only pass --verbose argument to main (commit: a6d3a2c) — wenchen / githubweb
  13. [SPARK-37017][SQL] Reduce the scope of synchronized to prevent potential (commit: 875963a) — wenchen / githubweb
  14. [SPARK-37057][INFRA] Fix wrong DocSearch facet filter in release-tag.sh (commit: db89320) — gengliang / githubweb
  15. [SPARK-36796][BUILD][CORE][SQL] Pass all `sql/core` and dependent (commit: 3849340) — srowen / githubweb

#851 (Oct 17, 2021, 7:41:15 AM)

  1. [SPARK-35926][SQL] Add support YearMonthIntervalType for width_bucket (commit: 9d061e3) — max.gekk / githubweb
  2. [SPARK-36991][PYTHON] Inline type hints for (commit: e3b4d1e) — ueshin / githubweb
  3. [SPARK-36910][PYTHON] Inline type hints for python/pyspark/sql/types.py (commit: 722ac1b) — ueshin / githubweb
  4. [SPARK-36276][BUILD][FOLLOWUP] Match the version of SBT's checkstyle (commit: ef3eb90) — gurwls223 / githubweb
  5. [SPARK-36230][SPARK-36232][PYTHON] Add regression for hasnan of (commit: 67b547a) — gurwls223 / githubweb
  6. [SPARK-36915][INFRA] Pin actions to a full length commit SHA (commit: 00b87c9) — srowen / githubweb
  7. [SPARK-36900][SPARK-36464][CORE][TEST] Refactor `: size returns correct (commit: cf43623) — srowen / githubweb
  8. [SPARK-37008][SQL][TEST] Replace `UseCompressedOops` with (commit: ee2647e) — srowen / githubweb
  9. [SPARK-36992][SQL] Improve byte array sort perf by unify getPrefix (commit: f9cc7fb) — srowen / githubweb

#850 (Oct 15, 2021, 4:34:13 AM)

  1. [SPARK-36938][PYTHON] Inline type hints for group.py in (commit: bb83f27) — ueshin / githubweb
  2. [SPARK-37000][PYTHON] Add type hints to python/pyspark/sql/util.py (commit: 2267d7f) — ueshin / githubweb
  3. [SPARK-23626][CORE] Eagerly compute RDD.partitions on entire DAG when (commit: c4e975e) — joshrosen / githubweb
  4. [SPARK-36942][PYTHON] Inline type hints for (commit: e7faa85) — ueshin / githubweb
  5. [SPARK-37010][PYTHON] Remove unnecessary "noqa: F401" comments in (commit: 94db71a) — gurwls223 / githubweb
  6. [SPARK-36337][PYTHON][CORE] Switch pyrolite v4.30 to pickle v1.2 to fix (commit: 7f17127) — gurwls223 / githubweb
  7. [SPARK-36980][SQL] Insert support query with CTE (commit: 9865c09) — wenchen / githubweb

#849 (Oct 14, 2021, 11:05:34 AM)

  1. [SPARK-36438][PYTHON] Support list-like Python objects for Series (commit: 46bcef7) — gurwls223 / githubweb
  2. [SPARK-36972][PYTHON][FOLLOW-UP] Remove since annotation from (commit: 9290924) — gurwls223 / githubweb
  3. [SPARK-36921][SQL] Support ANSI intervals by `DIV` (commit: 1ccc4dc) — max.gekk / githubweb
  4. [SPARK-36871][SQL] Migrate CreateViewStatement to v2 command (commit: f070d18) — wenchen / githubweb
  5. [SPARK-36993][SQL] Fix json_tuple throw NPE if fields exist no foldable (commit: 7aedce4) — max.gekk / githubweb
  6. [SPARK-36949][SQL] Disallow Hive provider tables with ANSI intervals (commit: 1aa3611) — max.gekk / githubweb
  7. [SPARK-36982] Migrate SHOW NAMESPACES to use V2 command by default (commit: 5ac76d9) — max.gekk / githubweb
  8. [SPARK-36546][SQL] Add array support to union by name (commit: 5241d98) — viirya / githubweb
  9. [SPARK-36868][SQL][FOLLOWUP] Move parsing Create Function from catalyst (commit: d9b4cc6) — wenchen / githubweb
  10. [SPARK-35973][SQL] Add command `SHOW CATALOGS` (commit: 1c61d90) — wenchen / githubweb
  11. [SPARK-36922][SQL] The SIGN/SIGNUM functions should support ANSI (commit: 838a9d9) — sarutak / githubweb
  12. [SPARK-36059][K8S] Support `spark.kubernetes.driver.scheduler.name` (commit: 4a722dc) — dongjoon / githubweb
  13. [SPARK-32161][PYTHON] Removing JVM logs from SparkUpgradeException (commit: d9d75f7) — gurwls223 / githubweb
  14. [SPARK-36946][PYTHON] Support time for ps.to_datetime (commit: 1125003) — gurwls223 / githubweb
  15. [SPARK-36632][SQL] DivideYMInterval and DivideDTInterval should throw (commit: de0161a) — wenchen / githubweb
  16. [SPARK-12567][SQL] Add aes_encrypt and aes_decrypt builtin functions (commit: c11c44e) — wenchen / githubweb
  17. [SPARK-37001][SQL] Disable two level of map for final hash aggregation (commit: 3354a21) — wenchen / githubweb
  18. [SPARK-37003][DOC] Merge INSERT related doc into two part: 1. table 2. (commit: 2ac4f71) — wenchen / githubweb
  19. [SPARK-36905] Fix reading hive views without explicit column names (commit: 2cc3aea) — wenchen / githubweb

#848 (Oct 13, 2021, 1:14:09 AM)

  1. [SPARK-36900][TESTS][BUILD] Increase test memory to 6g for Java 11 (commit: 6ed1314) — srowen / githubweb
  2. [SPARK-36963][SQL] Add max_by/min_by to sql.functions (commit: 13b0251) — gurwls223 / githubweb
  3. [SPARK-36943][SQL] Improve readability of missing column error message (commit: d83abfc) — wenchen / githubweb
  4. [SPARK-36645][SQL] Aggregate (Min/Max/Count) push down for Parquet (commit: 128168d) — viirya / githubweb
  5. [SPARK-36849][SQL] Migrate UseStatement to v2 command framework (commit: 73edf31) — wenchen / githubweb
  6. [SPARK-36876][SQL] Support Dynamic Partition pruning for (commit: 32e11ea) — wenchen / githubweb
  7. Revert "[SPARK-36794][SQL] Ignore duplicated join keys when building (commit: 1020c6d) — wenchen / githubweb
  8. [SPARK-35531][SQL] Directly pass hive Table to HiveClient when call (commit: b1f1575) — wenchen / githubweb
  9. [SPARK-36588] Migrate SHOW TABLES to use V2 command by default (commit: dd986e8) — wenchen / githubweb
  10. [SPARK-36540][YARN] YARN-CLIENT mode should check Shutdown message when (commit: 20051eb) — tgraves / githubweb
  11. [SPARK-36885][PYTHON] Inline type hints for pyspark.sql.dataframe (commit: 9995e62) — gurwls223 / githubweb
  12. [SPARK-36977][DOCS][PYTHON] Drop references to Python 3.6 support in (commit: 48ca47e) — gurwls223 / githubweb
  13. [SPARK-36900][BUILD][TESTS][FOLLOWUP] Try 5g, not 6g, for test mem limit (commit: 6e8cd3b) — gurwls223 / githubweb
  14. [SPARK-36979][SQL] Add RewriteLateralSubquery rule into (commit: 36b3bbc) — wenchen / githubweb
  15. [SPARK-36972][PYTHON] Add max_by/min_by API to PySpark (commit: b9a8165) — sarutak / githubweb
  16. [SPARK-36914][SQL] Implement dropIndex and listIndexes in JDBC (MySQL (commit: a453fd5) — wenchen / githubweb
  17. [SPARK-36867][SQL] Fix error message with GROUP BY alias (commit: dc1db95) — wenchen / githubweb
  18. [SPARK-36970][SQL] Manual disabled format `B` of `date_format` function (commit: 1af7072) — max.gekk / githubweb
  19. [SPARK-36951][PYTHON] Inline type hints for python/pyspark/sql/column.py (commit: 3ba57f5) — ueshin / githubweb
  20. [SPARK-36981][BUILD] Upgrade joda-time to 2.10.12 (commit: 3a91b9a) — sarutak / githubweb
  21. [SPARK-36961][PYTHON] Use PEP526 style variable type hints (commit: 973f04e) — gurwls223 / githubweb
  22. [SPARK-36985][PYTHON] Fix future typing errors in pyspark.pandas (commit: 0144818) — gurwls223 / githubweb
  23. Revert "[SPARK-36900][BUILD][TESTS][FOLLOWUP] Try 5g, not 6g, for test (commit: 521a2f6) — gurwls223 / githubweb
  24. Revert "[SPARK-36900][TESTS][BUILD] Increase test memory to 6g for Java (commit: 92caa75) — gurwls223 / githubweb
  25. [SPARK-36794][SQL] Ignore duplicated join keys when building relation (commit: e861b0d) — wenchen / githubweb
  26. [SPARK-36953][PYTHON] Expose SQL state and error class in PySpark (commit: bc7e4f5) — gurwls223 / githubweb
  27. [SPARK-36976][R] Add max_by/min_by API to SparkR (commit: 5982162) — gurwls223 / githubweb
  28. [SPARK-36973][PYTHON] Deduplicate prepare data method for (commit: f678c75) — gurwls223 / githubweb

#847 (Oct 9, 2021, 11:08:18 PM)

  1. [SPARK-36948][SQL][TESTS] Check CREATE TABLE with ANSI intervals using (commit: 72fa176) — max.gekk / githubweb
  2. [SPARK-36931][SQL] Support reading and writing ANSI intervals from/to (commit: f853afd) — max.gekk / githubweb
  3. [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command (commit: 792a8cb) — wenchen / githubweb
  4. [SPARK-36929][SQL] Remove Unused Method (commit: 7f6d0ce) — srowen / githubweb
  5. [SPARK-36717][CORE] Incorrect order of variable initialization may lead (commit: 65f6a7c) — srowen / githubweb
  6. [SPARK-36913][SQL] Implement createIndex and IndexExists in DS V2 JDBC (commit: 07ecbc4) — viirya / githubweb
  7. [SPARK-36944][PYTHON] Remove python/pyspark/sql/__init__.pyi (commit: f108dd9) — mszymkiewicz / githubweb
  8. [SPARK-36897][PYTHON] Use NamedTuple with variable type hints instead of (commit: c5c6f48) — gurwls223 / githubweb
  9. [SPARK-36839][INFRA][FOLLOW-UP] Respect Hadoop version configured in (commit: 4f825aa) — gurwls223 / githubweb
  10. [SPARK-36804][YARN] Support --verbose option in YARN mode (commit: 7468cd7) — srowen / githubweb
  11. [SPARK-36960][SQL] Pushdown filters with ANSI interval values to ORC (commit: ebfc6bb) — max.gekk / githubweb

#846 (Oct 7, 2021, 7:03:51 PM)

  1. [SPARK-36751][PYTHON][DOCS][FOLLOW-UP] Fix unexpected section title for (commit: 2953d4f) — sarutak / githubweb
  2. [SPARK-36937][SQL][TESTS] Change OrcSourceSuite to test both V1 and V2 (commit: 090c9bf) — max.gekk / githubweb
  3. [SPARK-36939][PYTHON][DOCS] Add orphan migration page into list in (commit: 0902b47) — gurwls223 / githubweb
  4. [SPARK-36884][PYTHON] Inline type hints for pyspark.sql.session (commit: d99edac) — gurwls223 / githubweb
  5. [SPARK-36918][SQL] Ignore types when comparing structs for unionByName (commit: 1eb6ea3) — viirya / githubweb
  6. [SPARK-36742][PYTHON] Fix ps.to_datetime with plurals of keys like (commit: 218da86) — gurwls223 / githubweb
  7. [SPARK-36941][SQL][TESTS] Check saving/loading of ANSI intervals to Hive (commit: 4a143f0) — max.gekk / githubweb
  8. [SPARK-36930][PYTHON][FOLLOW-UP] Fix test case for MultiIndex.dtypes (commit: b8e7e0d) — gurwls223 / githubweb
  9. [SPARK-36711][PYTHON][FOLLOW-UP] Skip docs tests having (commit: 148dcd9) — gurwls223 / githubweb
  10. [MINOR][TEST] GzipCodec should be set with Configuration before using (commit: aa393cd) — gurwls223 / githubweb
  11. [SPARK-36713][PYTHON][DOCS] Document new syntax of type hints with index (commit: 2e9b698) — gurwls223 / githubweb
  12. [SPARK-36798][CORE] Wait for listeners to finish before flushing metrics (commit: d758ae3) — mridulatgmail.com / githubweb
  13. [SPARK-36940][PYTHON] Inline type hints for (commit: 255d86f) — ueshin / githubweb
  14. [SPARK-29871][ML] Catch all exceptions for handling invalid images in (commit: 0ecc71b) — gurwls223 / githubweb
  15. [SPARK-36839][INFRA][FOLLOW-UP] Add Hadoop 2 daily job into schedule (commit: 10d5303) — gurwls223 / githubweb

#845 (Oct 6, 2021, 6:02:28 AM)

  1. [MINOR][SQL] Use SQLConf.resolver for (commit: 1676648) — viirya / githubweb
  2. [SPARK-36906][PYTHON] Inline type hints for conf.py and observation.py (commit: 8181260) — ueshin / githubweb
  3. [SPARK-36881][PYTHON] Inline type hints for (commit: b30e214) — gurwls223 / githubweb
  4. [SPARK-36920][SQL] Support ANSI intervals by `ABS()` (commit: 65eb4a2) — gurwls223 / githubweb
  5. [SPARK-36874][SQL] DeduplicateRelations should copy dataset_id tag to (commit: fa1805d) — wenchen / githubweb
  6. [SPARK-36711][PYTHON] Support multi-index in new syntax (commit: d6786e0) — gurwls223 / githubweb
  7. [SPARK-36880][PYTHON] Inline type hints for (commit: 7aee290) — gurwls223 / githubweb
  8. [SPARK-36926][SQL] Decimal average mistakenly overflow (commit: fb919af) — gengliang / githubweb
  9. [SPARK-36841][SQL] Add ansi syntax `set catalog xxx` to change the (commit: 6e8a462) — wenchen / githubweb
  10. [SPARK-36920][SQL][FOLLOWUP] Fix input types of `ABS()`: numeric and (commit: 3ac0382) — max.gekk / githubweb
  11. [SPARK-36705][FOLLOW-UP] Support the case when user's classes need to (commit: e5b01cd) — mridulatgmail.com / githubweb
  12. [SPARK-36711][PYTHON][FOLLOW-UP] Refactor typing logic for multi-index (commit: 6a2452f) — gurwls223 / githubweb
  13. [SPARK-36930][PYTHON] Support ps.MultiIndex.dtypes (commit: 5c6f0b9) — gurwls223 / githubweb
  14. [SPARK-36892][CORE] Disable batch fetch for a shuffle when push based (commit: 31b6f61) — gengliang / githubweb
  15. [SPARK-36927][PYTHON] Inline type hints for python/pyspark/sql/window.py (commit: f6013c8) — gurwls223 / githubweb
  16. [SPARK-36919][SQL] Make BadRecordException fields transient (commit: aed977c) — gurwls223 / githubweb

#844 (Oct 3, 2021, 9:37:49 PM)

  1. [MINOR][DOCS] Typo fix in cloud-integration.md (commit: 25db6b4) — srowen / githubweb
  2. [SPARK-36891][SQL] Refactor SpecificParquetRecordReaderBase and add more (commit: 14d4cee) — dongjoon / githubweb
  3. [SPARK-36907][PYTHON] Fix DataFrameGroupBy.apply without shortcut (commit: 38d3981) — gurwls223 / githubweb

#843 (Oct 1, 2021, 7:43:30 AM)

  1. [SPARK-34980][SQL] Support coalesce partition through union in AQE (commit: 0e23bd7) — wenchen / githubweb
  2. [SPARK-36889][SQL] Respect `spark.sql.parquet.filterPushdown` by v2 (commit: bbd1318) — gurwls223 / githubweb
  3. [SPARK-36550][SQL] Propagation cause when UDF reflection fails (commit: d003db3) — srowen / githubweb
  4. [SPARK-36624][YARN] In yarn client mode, when ApplicationMaster failed (commit: dcada3d) — tgraves / githubweb
  5. [SPARK-36831][SQL] Support reading and writing ANSI intervals from/to (commit: a8734e3) — max.gekk / githubweb
  6. [SPARK-36883][INFRA] Upgrade R version to 4.1.1 in CI images (commit: aa9064a) — dongjoon / githubweb
  7. [SPARK-36888][SQL] add tests cases for sha2 function (commit: 8357572) — gurwls223 / githubweb
  8. [SPARK-36893][BUILD][MESOS] Upgrade mesos into 1.4.3 (commit: b60e576) — dongjoon / githubweb
  9. [SPARK-36896][PYTHON] Return boolean for `dropTempView` and (commit: ad5a535) — gurwls223 / githubweb
  10. [SPARK-36899][R] Support ILIKE API on R (commit: 17e3ca6) — sarutak / githubweb
  11. [SPARK-36865][PYTHON][DOCS] Add PySpark API document of session_window (commit: 5a32e41) — kabhwan.opensource / githubweb
  12. [SPARK-36830][SQL] Support reading and writing ANSI intervals from/to (commit: 7c15580) — max.gekk / githubweb
  13. [SPARK-36870][SQL] Introduce INTERNAL_ERROR error class (commit: 4aeddb8) — gurwls223 / githubweb
  14. [SPARK-36435][PYTHON] Implement MultIndex.equal_levels (commit: 13ddc91) — gurwls223 / githubweb
  15. [SPARK-36038][CORE] Speculation metrics summary at stage level (commit: 73747ec) — sarutak / githubweb

#842 (Sep 29, 2021, 12:39:17 AM)

  1. [SPARK-36838][SQL] Improve InSet generated code performance (commit: 00b9863) — gurwls223 / githubweb
  2. [SPARK-36835][FOLLOWUP][BUILD][TEST-HADOOP2.7] Move (commit: f9efdee) — gengliang / githubweb
  3. [SPARK-36797][SQL] Union should resolve nested columns as top-level (commit: 44070e0) — wenchen / githubweb
  4. [SPARK-32712][SQL] Support writing Hive bucketed table (Hive file (commit: 978a915) — wenchen / githubweb
  5. [SPARK-36829][SQL] Refactor NULL check for collectionOperators (commit: ad96aee) — wenchen / githubweb
  6. [SPARK-36848][SQL] Migrate ShowCurrentNamespaceStatement to v2 command (commit: e4e64c7) — viirya / githubweb
  7. [SPARK-36821][SQL] Make class ColumnarBatch extendable - addendum (commit: d03999a) — d_tsai / githubweb
  8. Revert "[SPARK-32855][SQL] Improve the cost model in pruningHasBenefit (commit: e024bdc) — yumwang / githubweb
  9. [SPARK-36794][SQL] Ignore duplicated join keys when building relation (commit: c3cdb89) — wenchen / githubweb
  10. [SPARK-36856][BUILD] Get correct JAVA_HOME for macOS (commit: 56c21e8) — gengliang / githubweb
  11. [SPARK-36809][SQL] Remove broadcast for InSubqueryExec used in DPP (commit: 4caf71f) — wenchen / githubweb
  12. [SPARK-36863][BUILD] Update dependency manifest files for all released (commit: 8d8b710) — gurwls223 / githubweb
  13. [SPARK-36873][BUILD][TEST-MAVEN] Add provided Guava dependency for (commit: 53f58b6) — gengliang / githubweb
  14. [SPARK-36836][SQL] Fix incorrect result in `sha2` expression (commit: 6c6291b) — gengliang / githubweb
  15. [SPARK-36866][SQL] Pushdown filters with ANSI interval values to parquet (commit: 8c51fd8) — wenchen / githubweb
  16. [SPARK-36848][SQL][FOLLOWUP] Simplify SHOW CURRENT NAMESPACE command (commit: d233977) — dongjoon / githubweb
  17. [SPARK-36846][PYTHON] Inline most of type hint files under (commit: a9b4c27) — gurwls223 / githubweb
  18. [SPARK-36813][SQL][PYTHON] Propose an infrastructure of as-of join and (commit: 05c0fa5) — gurwls223 / githubweb
  19. [MINOR][SS][TEST] Remove unsupportedOperationCheck setting for (commit: bfcc596) — viirya / githubweb
  20. [SPARK-36526][SQL] DSV2 Index Support: Add supportsIndex interface (commit: d2bb359) — wenchen / githubweb
  21. [MINOR][DOCS] Mention other Python dependency tools in documentation (commit: 13c2b71) — gurwls223 / githubweb
  22. [SPARK-36882][PYTHON] Support ILIKE API on Python (commit: ca1c09d) — sarutak / githubweb

#841 (Sep 26, 2021, 5:35:37 PM)

  1. [SPARK-36721][SQL] Simplify boolean equalities if one side is literal (commit: b3ef76c) — viirya / githubweb
  2. [SPARK-35174][K8S] Avoid opening watch when waitAppCompletion is false (commit: 77cd133) — dongjoon / githubweb
  3. [SPARK-36847][PYTHON] Explicitly specify error codes when ignoring type (commit: fc404d6) — gurwls223 / githubweb
  4. [SPARK-36839][INFRA] Add daily build with Hadoop 2 profile in GitHub (commit: d962f83) — gurwls223 / githubweb
  5. [SPARK-36852][SQL][TESTS] Test ANSI interval support by the Parquet (commit: 3577898) — gurwls223 / githubweb
  6. [SPARK-36854][SQL] Handle ANSI intervals by the off-heap column vector (commit: 7d496fb) — gurwls223 / githubweb
  7. [SPARK-36835][FOLLOWUP][BUILD][TEST-HADOOP2.7] Fix maven issue for (commit: 937a74e) — gengliang / githubweb
  8. [SPARK-36851][SQL] Incorrect parsing of negative ANSI typed interval (commit: 0fdca1f) — gengliang / githubweb
  9. [SPARK-36859][BUILD][K8S] Upgrade kubernetes-client to 5.8.0 (commit: 0b1eec1) — dongjoon / githubweb

#840 (Sep 24, 2021, 9:38:34 AM)

  1. [SPARK-36822][SQL] BroadcastNestedLoopJoinExec should use all condition (commit: d90b479) — wenchen / githubweb
  2. [SPARK-36803][SQL] Fix ArrayType conversion when reading Parquet files (commit: ec26d94) — wenchen / githubweb
  3. [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and (commit: a7cbe69) — wenchen / githubweb
  4. [SPARK-36818][PYTHON] Fix filtering a Series by a boolean Series (commit: 6a5ee02) — ueshin / githubweb
  5. [SPARK-36708][PYTHON] Support numpy.typing for annotating ArrayType in (commit: cc2fcb4) — gurwls223 / githubweb
  6. [SPARK-36824][R] Add sec and csc as R functions (commit: 0434857) — gurwls223 / githubweb
  7. [SPARK-36791][DOCS] Fix spelling mistakes in running-on-yarn.md file (commit: 8a1a91b) — gurwls223 / githubweb
  8. [SPARK-36747][SQL] Do not collapse Project with Aggregate when (commit: 4a8dc5f) — wenchen / githubweb
  9. [SPARK-36782][CORE] Avoid blocking dispatcher-BlockManagerMaster during (commit: 4ea54e8) — gengliang / githubweb
  10. [SPARK-36506][PYTHON] Improve test coverage for series.py and (commit: 5268904) — gurwls223 / githubweb
  11. [SPARK-36405][SQL][TESTS] Check that SQLSTATEs are valid (commit: 7cc9667) — gurwls223 / githubweb
  12. [MINOR][SQL][DOCS] Correct the 'options' description on (commit: 0076eba) — huaxin_gao / githubweb
  13. [SPARK-36795][SQL] Explain Formatted has Duplicate Node IDs (commit: 6d7ab7b) — gurwls223 / githubweb
  14. [SPARK-36782][CORE][FOLLOW-UP] Only handle shuffle block in separate (commit: 9d8ac7c) — gengliang / githubweb
  15. [SPARK-36760][SQL][FOLLOWUP] Add interface SupportsPushDownV2Filters (commit: 6e815da) — wenchen / githubweb
  16. [SPARK-36760][DOCS][FOLLOWUP] Fix wrong JavaDoc style (commit: 0b65daa) — sarutak / githubweb
  17. [SPARK-36642][SQL] Add df.withMetadata pyspark API (commit: ef7441b) — weichen.xu / githubweb
  18. Revert "[SPARK-35672][CORE][YARN] Pass user classpath entries to (commit: c2c4a48) — gurwls223 / githubweb
  19. [SPARK-36835][BUILD] Enable createDependencyReducedPom for Maven shaded (commit: ed88e61) — gengliang / githubweb
  20. [SPARK-33832][SQL] Force skew join code simplification and improvement (commit: 1b2bb38) — wenchen / githubweb
  21. [SPARK-36825][SQL] Read/write dataframes with ANSI intervals from/to (commit: c77c0d4) — max.gekk / githubweb
  22. [SPARK-36792][SQL] InSet should handle NaN (commit: 64f4bf4) — wenchen / githubweb
  23. [SPARK-36656][SQL][TEST] CollapseProject should not collapse correlated (commit: 5283301) — wenchen / githubweb
  24. [SPARK-36827][CORE] Improve the perf and memory usage of cleaning up (commit: 7ac0a2c) — gengliang / githubweb

#839 (Sep 22, 2021, 2:07:17 AM)

  1. [SPARK-36107][SQL] Refactor first set of 20 query execution errors to (commit: c2881c5) — gurwls223 / githubweb
  2. [SPARK-36710][PYTHON] Support new typing syntax in function apply APIs (commit: 8d8b4aa) — gurwls223 / githubweb
  3. [SPARK-34112][BUILD] Upgrade ORC to 1.7.0 (commit: a396dd6) — dongjoon / githubweb
  4. [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and (commit: 2fc7f2f) — wenchen / githubweb
  5. [SPARK-36101][CORE] Grouping exception in core/api (commit: 4cc39cf) — wenchen / githubweb
  6. [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC (commit: 30d17b6) — sarutak / githubweb
  7. [SPARK-36805][BUILD][K8S] Upgrade kubernetes-client to 5.7.3 (commit: 3b56039) — dongjoon / githubweb
  8. [SPARK-36808][BUILD] Upgrade Kafka to 2.8.1 (commit: 75e71ef) — dongjoon / githubweb
  9. [SPARK-36806][K8S][R] Use R 4.0.4 in K8s R image (commit: a178752) — dongjoon / githubweb
  10. [SPARK-36618][PYTHON] Support dropping rows of a single-indexed (commit: 4cf86d3) — ueshin / githubweb
  11. [SPARK-36746][PYTHON] Refactor `_select_rows_by_iterable` in (commit: 4b61c62) — ueshin / githubweb
  12. [SPARK-36785][PYTHON] Fix DataFrame.isin when DataFrame has NaN value (commit: cc182fe) — ueshin / githubweb
  13. [SPARK-36807][SQL] Merge ANSI interval types to a tightest common type (commit: d2340f8) — max.gekk / githubweb
  14. [SPARK-36814][SQL] Make class ColumnarBatch extendable (commit: 688b95b) — d_tsai / githubweb
  15. [SPARK-36769][PYTHON] Improve `filter` of single-indexed DataFrame (commit: 33e463c) — ueshin / githubweb
  16. [SPARK-36670][FOLLOWUP][TEST] Remove brotli-codec dependency (commit: ba5708d) — dongjoon / githubweb
  17. [SPARK-36615][CORE] Register shutdown hook earlier when start SC (commit: b7d99e3) — mridulatgmail.com / githubweb
  18. [SPARK-36771][PYTHON] Fix `pop` of Categorical Series (commit: 079a9c5) — ueshin / githubweb
  19. [SPARK-36820][SQL] Disable tests related to LZ4 for Hadoop 2.7 profile (commit: 6eb7559) — viirya / githubweb
  20. [SPARK-36760][SQL] Add interface SupportsPushDownV2Filters (commit: 1d7d972) — wenchen / githubweb

#838 (Sep 18, 2021, 3:24:55 AM)

  1. [SPARK-36745][SQL] ExtractEquiJoinKeys should return the original (commit: afd406e) — wenchen / githubweb
  2. [SPARK-36732][SQL][BUILD] Upgrade ORC to 1.6.11 (commit: c217797) — dongjoon / githubweb
  3. [SPARK-36775][DOCS] Add documentation for ANSI store assignment rules (commit: ff7705a) — wenchen / githubweb
  4. [SPARK-36433][WEBUI] Fix log message in WebUI (commit: 23f4a65) — gengliang / githubweb
  5. [SPARK-36777][INFRA] Move Java 17 on GitHub Actions from EA to LTS (commit: 89a9456) — yumwang / githubweb
  6. [SPARK-36587][SQL][FOLLOWUP] Remove unused CreateNamespaceStatement (commit: fb11c46) — gengliang / githubweb
  7. [SPARK-36759][BUILD][FOLLOWUP] Update version in scala-2.12 profile and (commit: adbea25) — dongjoon / githubweb
  8. [SPARK-36735][SQL][FOLLOWUP] Fix indentation of (commit: f1f2ec3) — dongjoon / githubweb
  9. [SPARK-36774][CORE][TESTS] Move SparkSubmitTestUtils to core module and (commit: 3ae6e67) — joshrosen / githubweb
  10. [SPARK-36779][PYTHON] Fix when list of data type tuples has len = 1 (commit: 8f895e9) — gurwls223 / githubweb
  11. [SPARK-36773][SQL][TEST] Fixed unit test to check the compression for (commit: 3712502) — gurwls223 / githubweb
  12. [SPARK-36783][SQL] ScanOperation should not push Filter through (commit: dfd5237) — wenchen / githubweb
  13. [SPARK-36788][SQL] Change log level of AQE for non-supported plans from (commit: 917d7da) — gurwls223 / githubweb
  14. [SPARK-32709][SQL] Support writing Hive bucketed table (Parquet/ORC (commit: 4a34db9) — wenchen / githubweb
  15. [SPARK-36789][SQL] Use the correct constant type as the null value (commit: 4145498) — gurwls223 / githubweb
  16. [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe) (commit: 1312a87) — max.gekk / githubweb
  17. [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and (commit: e356f6a) — wenchen / githubweb
  18. [SPARK-36764][SS][TEST] Fix race-condition on "ensure continuous stream (commit: 6099edc) — wenchen / githubweb
  19. [SPARK-36718][SQL] Only collapse projects if we don't duplicate (commit: 651904a) — wenchen / githubweb
  20. [SPARK-36673][SQL] Fix incorrect schema of nested types of union (commit: cdd7ae9) — wenchen / githubweb
  21. [SPARK-36767][SQL] ArrayMin/ArrayMax/SortArray/ArraySort add comment and (commit: 69e006d) — wenchen / githubweb
  22. [SPARK-36663][SQL] Support number-only column names in ORC data sources (commit: cd1b7e1) — wenchen / githubweb
  23. [SPARK-36780][BUILD] Make `dev/mima` runs on Java 17 (commit: 5d0889b) — dongjoon / githubweb
  24. [SPARK-36673][SQL][FOLLOWUP] Remove duplicate test in (commit: f9644cc) — viirya / githubweb
  25. [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values (commit: 32b8512) — ueshin / githubweb
  26. [SPARK-36772] FinalizeShuffleMerge fails with an exception due to (commit: cabc36b) — gengliang / githubweb

#837 (Sep 15, 2021, 8:09:06 PM)

  1. [SPARK-36705][SHUFFLE] Disable push based shuffle when IO encryption is (commit: 999473b) — mridulatgmail.com / githubweb
  2. [SPARK-36653][PYTHON] Implement Series.__xor__ and Series.__rxor__ (commit: f8657d1) — ueshin / githubweb
  3. [SPARK-36739][DOCS][PYTHON] Add apache license headers to makefiles (commit: a440025) — gurwls223 / githubweb
  4. [SPARK-36715][SQL] InferFiltersFromGenerate should not infer filter for (commit: 52c5ff2) — gurwls223 / githubweb
  5. [SPARK-36748][PYTHON] Introduce the 'compute.isin_limit' option (commit: 1ed671c) — gurwls223 / githubweb
  6. [SPARK-36705][FOLLOW-UP] Fix unnecessary logWarning when (commit: 2d7dc7c) — mridulatgmail.com / githubweb
  7. [SPARK-36702][SQL] ArrayUnion handle duplicated Double.NaN and Float.Nan (commit: f71f377) — wenchen / githubweb
  8. [SPARK-36737][BUILD][CORE][SQL][SS] Upgrade Apache commons-io to 2.11.0 (commit: 119ddd7) — kabhwan.opensource / githubweb
  9. [SPARK-36712][BUILD][FOLLOWUP] Improve the regex to avoid breaking (commit: d730ef2) — dongjoon / githubweb
  10. [SPARK-34943][BUILD] Upgrade flake8 to 3.8.0 or above in Jenkins (commit: 3e5d3d1) — gurwls223 / githubweb
  11. [SPARK-36709][PYTHON] Support new syntax for specifying index type and (commit: 0aaf86b) — gurwls223 / githubweb
  12. [SPARK-36733][SQL] Fix a perf issue in SchemaPruning when a struct has (commit: e43b9e8) — gurwls223 / githubweb
  13. [SPARK-36660][SQL][FOLLOW-UP] Add cot to pyspark.sql.rst (commit: 5a9d4c1) — gurwls223 / githubweb
  14. [SPARK-36751][SQL][PYTHON][R] Add bit/octet_length APIs to Scala, Python (commit: 0666f5c) — sarutak / githubweb
  15. [SPARK-36702][SQL][FOLLOWUP] ArrayUnion handle duplicated Double.NaN and (commit: 6380859) — wenchen / githubweb
  16. [SPARK-36755][SQL] ArraysOverlap should handle duplicated Double.NaN and (commit: b665782) — wenchen / githubweb
  17. [SPARK-36722][PYTHON] Fix Series.update with another in same frame (commit: c15072c) — ueshin / githubweb
  18. [SPARK-36726] Upgrade Parquet to 1.12.1 (commit: a927b08) — d_tsai / githubweb
  19. [SPARK-36759][BUILD] Upgrade Scala to 2.12.15 (commit: 16f1f71) — dongjoon / githubweb
  20. [SPARK-36735][SQL] Adjust overhead of cached relation for DPP (commit: bbb33af) — viirya / githubweb

#836 (Sep 13, 2021, 1:44:21 PM)

  1. [SPARK-36556][SQL] Add DSV2 filters (commit: 1f679ed) — viirya / githubweb
  2. [SPARK-36704][CORE] Expand exception handling to more Java 9 cases where (commit: e5283f5) — srowen / githubweb
  3. [SPARK-36685][ML][MLLIB] Fix wrong assert messages (commit: 9af0132) — dongjoon / githubweb
  4. [SPARK-36725][SQL][TESTS] Ensure HiveThriftServer2Suites to stop Thrift (commit: c36d708) — dongjoon / githubweb
  5. [SPARK-35822][UI] Spark UI-Executor tab is empty in IE11 (commit: ebca01f) — dongjoon / githubweb
  6. [SPARK-36719][CORE] Supporting Netty Logging at the network layer (commit: ba81b92) — dongjoon / githubweb
  7. [SPARK-36636][CORE][TEST] LocalSparkCluster change to use tmp workdir in (commit: 0e1157d) — srowen / githubweb
  8. [SPARK-36729][BUILD] Upgrade Netty from 4.1.63 to 4.1.68 (commit: e1e1961) — dongjoon / githubweb
  9. [SPARK-33832][SQL] Support optimize skewed join even if introduce extra (commit: 4a6b2b9) — wenchen / githubweb
  10. [SPARK-36738][SQL][DOC] Fixed the wrong documentation on Cot API (commit: 3747cfd) — gurwls223 / githubweb
  11. [SPARK-36724][SQL] Support timestamp_ntz as a type of time column for (commit: e858cd5) — gengliang / githubweb
  12. [SPARK-36736][SQL] Support ILIKE (ALL | ANY | SOME) - case insensitive (commit: bd62ad9) — wenchen / githubweb
  13. [SPARK-36712][BUILD] Make scala-parallel-collections in 2.13 POM a (commit: 1a62e6a) — srowen / githubweb

#835 (Sep 11, 2021, 12:41:06 AM)

  1. [SPARK-36625][SPARK-36661][PYTHON] Support TimestampNTZ in pandas API on (commit: 34f80ef) — gurwls223 / githubweb
  2. [SPARK-36697][PYTHON] Fix dropping all columns of a DataFrame (commit: 33bb7b3) — gurwls223 / githubweb
  3. [SPARK-36692][CORE] Improve Error statement when requesting thread dump (commit: 67421d8) — gurwls223 / githubweb
  4. [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe (commit: 9b633f2) — wenchen / githubweb
  5. [SPARK-36674][SQL] Support ILIKE - case insensitive LIKE (commit: b74a1ba) — wenchen / githubweb
  6. [SPARK-36670][SQL][TEST][FOLLOWUP] Add AvroCodecSuite (commit: c95d3fe) — viirya / githubweb
  7. [SPARK-34479][SQL][DOC][FOLLOWUP] Add zstandard to avro supported codecs (commit: 647ffe6) — viirya / githubweb
  8. [SPARK-36689][PYTHON] Cleanup the deprecated APIs and raise proper (commit: 0227793) — gurwls223 / githubweb
  9. [SPARK-36669][SQL] Add Lz4 wrappers for Hadoop Lz4 codec (commit: 6bcf330) — viirya / githubweb
  10. [SPARK-36334][K8S][FOLLOWUP] Allow equal resource version to update (commit: 28e0a0e) — dongjoon / githubweb
  11. [SPARK-36687][SQL][CORE] Rename error classes with _ERROR suffix (commit: 711577e) — gurwls223 / githubweb
  12. Revert "[SPARK-35011][CORE] Avoid Block Manager registrations when (commit: 7103a16) — dhyun / githubweb

#834 (Sep 8, 2021, 4:40:06 PM)

  1. [SPARK-36675][SQL] Support ScriptTransformation for timestamp_ntz (commit: 0ab0cb1) — max.gekk / githubweb
  2. [SPARK-36667][SS][TEST] Close resources properly in (commit: 093c208) — viirya / githubweb
  3. [SPARK-36153][SQL][DOCS][FOLLOWUP] Fix the description about the (commit: a5fe5d3) — gurwls223 / githubweb
  4. [SPARK-36682][CORE][TEST] Add Hadoop sequence file test for different (commit: 6745d77) — viirya / githubweb
  5. [SPARK-36666][SQL] Fix regression in AQEShuffleReadExec (commit: f78d839) — dhyun / githubweb
  6. [SPARK-36670][SQL][TEST] Add FileSourceCodecSuite (commit: 5a0ae69) — viirya / githubweb
  7. [SPARK-36677][SQL] NestedColumnAliasing should not push down aggregate (commit: 2ed6e7b) — viirya / githubweb
  8. [SPARK-36531][SPARK-36515][PYTHON] Improve test coverage for (commit: 71dbd03) — gurwls223 / githubweb
  9. [SPARK-36642][SQL] Add df.withMetadata: a syntax suger to update the (commit: cb30683) — weichen.xu / githubweb
  10. [SPARK-35803][SQL] Support DataSource V2 CreateTempViewUsing (commit: feba05f) — wenchen / githubweb
  11. [SPARK-36684][SQL][TESTS] Add Jackson test dependencies to `sql/core` (commit: acd9c92) — dhyun / githubweb
  12. [SPARK-36688][R] Add cot as an R function (commit: 5d5c942) — gurwls223 / githubweb
  13. [SPARK-34952][SQL][FOLLOWUP] Change column type to be NamedReference (commit: 23794fb) — wenchen / githubweb
  14. [SPARK-36690][SS] Clean up deprecated api usage after upgrade (commit: 375ca94) — kabhwan.opensource / githubweb

#833 (Sep 6, 2021, 9:37:11 AM)

  1. [SPARK-36643][SQL] Add more information in ERROR log while SparkConf is (commit: 6bd491e) — dongjoon / githubweb
  2. [SPARK-36602][COER][SQL] Clean up redundant asInstanceOf casts (commit: 3584838) — srowen / githubweb
  3. [SPARK-36613][SQL][SS] Use EnumSet as the implementation of (commit: bdb73bb) — srowen / githubweb
  4. [SPARK-36660][SQL] Add cot as Scala and Python functions (commit: db95960) — gurwls223 / githubweb
  5. [SPARK-36626][PYTHON][FOLLOW-UP] Use datetime.tzinfo instead of (commit: c6f3a13) — max.gekk / githubweb

#832 (Sep 3, 2021, 11:23:37 PM)

  1. [SPARK-36574][SQL] pushDownPredicate=false should prevent push down (commit: fcc91cf) — wenchen / githubweb
  2. [SPARK-36614][CORE][UI] Correct executor loss reason caused by (commit: ebe7bb6) — dhyun / githubweb
  3. [SPARK-36611] Remove unused listener in HiveThriftServer2AppStatusStore (commit: aae7310) — yao / githubweb
  4. [SPARK-36619][SS] Fix bugs around prefix-scan for HDFS backed state (commit: 60a72c9) — gengliang / githubweb
  5. [SPARK-36608][SQL] Support TimestampNTZ in Arrow (commit: 4ed2dab) — gurwls223 / githubweb
  6. [SPARK-36399][PYTHON] Implement DataFrame.combine_first (commit: c6a2021) — ueshin / githubweb
  7. [SPARK-36629][BUILD] Upgrade `aircompressor` to 1.21 (commit: ff8cc4b) — dongjoon / githubweb
  8. [SPARK-36533][SS] Trigger.AvailableNow for running streaming queries (commit: e33cdfb) — kabhwan.opensource / githubweb
  9. [SPARK-36607][SQL] Support BooleanType in UnwrapCastInBinaryComparison (commit: 799a011) — wenchen / githubweb
  10. [SPARK-36621][PYTHON][DOCS] Add Apache license headers to Pandas API on (commit: 77fdf5f) — gurwls223 / githubweb
  11. [SPARK-36631][R] Ask users if they want to download and install SparkR (commit: e983ba8) — gurwls223 / githubweb
  12. [SPARK-36626][PYTHON] Support TimestampNTZ in createDataFrame/toPandas (commit: 9c5bcac) — gurwls223 / githubweb
  13. [SPARK-36400][TEST][FOLLOWUP] Add test for redacting sensitive (commit: 94c3062) — sarutak / githubweb
  14. [SPARK-36617][PYTHON] Fix type hints for `approxQuantile` to support (commit: 37f5ab0) — mszymkiewicz / githubweb
  15. [SPARK-36637][SQL] Provide proper error message when use undefined (commit: 568ad6a) — wenchen / githubweb
  16. [SPARK-36657][SQL] Update comment in 'gen-sql-config-docs.py' (commit: b72fa5e) — dongjoon / githubweb
  17. [SPARK-36351][SQL] Refactor filter push down in file source v2 (commit: 38b6fbd) — viirya / githubweb
  18. [SPARK-36650][YARN] ApplicationMaster shutdown hook should catch timeout (commit: 4d9e577) — gurwls223 / githubweb
  19. [SPARK-36652][SQL] AQE dynamic join selection should not apply to (commit: 9054a6a) — dongjoon / githubweb
  20. [SPARK-36644][SQL] Push down boolean column filter (commit: d3e3df1) — d_tsai / githubweb
  21. [SPARK-36659][SQL] Promote spark.sql.execution.topKSortFallbackThreshold (commit: 7f1ad7b) — yao / githubweb
  22. [SPARK-36609][PYTHON] Add `errors` argument for `ps.to_numeric` (commit: 61b3223) — gurwls223 / githubweb
  23. [SPARK-36639][SQL] Fix an issue that sequence builtin function causes (commit: cf3bc65) — sarutak / githubweb
  24. [SPARK-36401][PYTHON] Implement Series.cov (commit: 9b262e7) — ueshin / githubweb
  25. [SPARK-36655][PYTHON] Add `versionadded` for API added in Spark 3.3.0 (commit: 019203c) — ueshin / githubweb

#831 (Aug 30, 2021, 1:16:01 AM)

  1. [SPARK-36327][SQL] Spark sql creates staging dir inside database (commit: fe7bf5f) — dongjoon / githubweb
  2. [SPARK-36509][CORE] Fix the issue that executors are never re-scheduled (commit: ea8c31e) — sarutak / githubweb
  3. [SPARK-36605][BUILD] Upgrade Jackson to 2.12.5 (commit: 4356d66) — viirya / githubweb
  4. [SPARK-36583][BUILD] Upgrade Apache commons-pool2 from 2.6.2 to 2.11.1 (commit: 8ffb59d) — gurwls223 / githubweb
  5. [SPARK-36606][DOCS][TESTS] Enhance the docs and tests of (commit: 8a52ad9) — gurwls223 / githubweb
  6. [MINOR][DOCS] Add Apache license header to GitHub Actions workflow files (commit: 22c492a) — dongjoon / githubweb
  7. [SPARK-36576][SS] Improve range split calculation for Kafka Source (commit: 7d1be37) — kabhwan.opensource / githubweb
  8. [SPARK-36580][CORE][K8S] Use `intersect` and `diff` API on `Set` instead (commit: 9cefde8) — dongjoon / githubweb
  9. [SPARK-36603][CORE] Use WeakReference not SoftReference in LevelDB (commit: 89e907f) — dongjoon / githubweb
  10. [SPARK-36336][SQL][FOLLOWUP][SPARK] Mark exception `private` (commit: df3e5a6) — gurwls223 / githubweb

#830 (Aug 27, 2021, 1:14:08 AM)

  1. [SPARK-34952][SQL][FOLLOWUP] Move aggregates to a separate package (commit: cd23426) — viirya / githubweb
  2. [SPARK-36560][PYTHON][INFRA] Deflake PySpark coverage job (commit: fa53aa0) — gurwls223 / githubweb
  3. [SPARK-35991][SQL][FOLLOWUP] Add back protected modifier of sparkConf to (commit: e83f8a8) — gurwls223 / githubweb
  4. [SPARK-36419][CORE] Optionally move final aggregation in (commit: ee20fbb) — wenchen / githubweb
  5. [SPARK-35535][SQL][FOLLOWUP] Move LocalScan to Catalyst package (commit: 5b4c216) — dongjoon / githubweb
  6. [SPARK-36573][BUILD][TEST] Add a default value to ORACLE_DOCKER_IMAGE (commit: e03afc9) — dongjoon / githubweb
  7. [SPARK-36564][CORE] Fix NullPointerException in (commit: d6c453a) — dongjoon / githubweb
  8. Revert "[SPARK-34415][ML] Randomization in hyperparameter optimization" (commit: de932f5) — dongjoon / githubweb
  9. [SPARK-36336][SQL] Add new exception of base exception used in (commit: 3e32ea1) — gurwls223 / githubweb
  10. [SPARK-36559][SQL][PYTHON] Create plans dedicated to (commit: 93cec49) — gurwls223 / githubweb
  11. [SPARK-35236][SQL][DOCS][FOLLOWUP] Mention ARCHIVE as an acceptable (commit: bd0a495) — gurwls223 / githubweb
  12. [SPARK-36567][SQL] Support foldable special datetime strings by `CAST` (commit: df0ec56) — wenchen / githubweb
  13. [SPARK-36398][SQL] Redact sensitive information in Spark Thrift Server (commit: b2ff016) — sarutak / githubweb
  14. [SPARK-36585][SQL][DOCS] Support setting "since" version in (commit: 18143fb) — gengliang / githubweb
  15. [SPARK-36058][K8S] Add support for statefulset APIs in K8s (commit: ff3f3c4) — hkarau / githubweb
  16. [SPARK-35581][SPARK-36567][SQL][DOCS][FOLLOWUP] Update the SQL migration (commit: c4e739f) — wenchen / githubweb
  17. [SPARK-36590][SQL] Convert special timestamp_ntz values in the session (commit: 159ff9f) — wenchen / githubweb
  18. [SPARK-36568][SQL] Better FileScan statistics estimation (commit: 3bb8cd9) — wenchen / githubweb
  19. [SPARK-36488][SQL] Improve error message with quotedRegexColumnNames (commit: 14622fc) — wenchen / githubweb
  20. [SPARK-36457][DOCS] Review and fix issues in Scala/Java API docs (commit: 1a42aa5) — gengliang / githubweb
  21. [SPARK-36505][PYTHON] Improve test coverage for frame.py (commit: 97e7d6e) — gurwls223 / githubweb
  22. [SPARK-36537][PYTHON] Revisit disabled tests for CategoricalDtype (commit: fe48618) — gurwls223 / githubweb
  23. [SPARK-36541][DOCS][PYTHON] Replace the word Koalas to pandas-on-Spark (commit: aeb3da2) — gurwls223 / githubweb
  24. [SPARK-36594][SQL] ORC vectorized reader should properly check maximal (commit: 400dc7b) — gengliang / githubweb
  25. [SPARK-36587][SQL] Migrate CreateNamespaceStatement to v2 command (commit: 72d6d64) — wenchen / githubweb
  26. [SPARK-35611][SS][FOLLOW-UP] Improve the user guide document (commit: dd3f0fa) — gurwls223 / githubweb
  27. [SPARK-36595][SQL][SS][DOCS] Document window & session_window function (commit: bc32144) — kabhwan.opensource / githubweb
  28. [SPARK-36578][ML] UnivariateFeatureSelector API doc improvement (commit: 15e42b4) — dhyun / githubweb
  29. [SPARK-36597][DOCS] Fix issues in SQL function docs (commit: e650d06) — gengliang / githubweb

#829 (Aug 23, 2021, 4:55:55 AM)

  1. Revert "[SPARK-34309][BUILD][CORE][SQL][K8S] Use Caffeine instead of (commit: 1ccb06c) — gurwls223 / githubweb
  2. [SPARK-36552][SQL] Fix different behavior for writing char/varchar to (commit: f918c12) — gurwls223 / githubweb
  3. [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring (commit: 5740d56) — gurwls223 / githubweb
  4. [MINOR][SS][DOCS] Update doc for streaming deduplication (commit: 5876e04) — viirya / githubweb
  5. [SPARK-36374][FOLLOW-UP] Change config key (commit: 7b2842e) — mridulatgmail.com / githubweb
  6. [SPARK-36557][DOCS] Update the MAVEN_OPTS in Spark build docs (commit: 3da0e95) — gurwls223 / githubweb
  7. [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and (commit: 0b6af46) — gurwls223 / githubweb
  8. [MINOR][DOCS] Mention Hadoop 3 in YARN introduction on (commit: adc485a) — sarutak / githubweb
  9. [SPARK-36418][SPARK-36536][SQL][DOCS][FOLLOWUP] Update the SQL migration (commit: 9f595c4) — max.gekk / githubweb

#828 (Aug 20, 2021, 7:38:50 AM)

  1. [SPARK-36451][BUILD] Ivy skips looking for source and doc pom (commit: a1ecf83) — srowen / githubweb
  2. [SPARK-36532][CORE] Fix deadlock in (commit: 996551f) — wenchen / githubweb
  3. [SPARK-36428][SQL][FOLLOWUP] Simplify the implementation of (commit: 707eefa) — gengliang / githubweb
  4. [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer (commit: 1859d9b) — srowen / githubweb
  5. [SPARK-36388][SPARK-36386][PYTHON][FOLLOWUP] Fix DataFrame (commit: c91ae54) — ueshin / githubweb
  6. [SPARK-36368][PYTHON] Fix CategoricalOps.astype to follow pandas 1.3 (commit: f2e593b) — ueshin / githubweb
  7. [SPARK-36147][SQL] Warn if less files visible after stats write in (commit: 2fc9c0b) — gurwls223 / githubweb
  8. [SPARK-33687][SQL][DOC][FOLLOWUP] Merge the doc pages of ANALYZE TABLE (commit: 07d173a) — wenchen / githubweb
  9. [SPARK-36371][SQL] Support raw string literal (commit: c458edb) — wenchen / githubweb
  10. [SPARK-35991][SQL] Add PlanStability suite for TPCH (commit: 559fe96) — wenchen / githubweb
  11. [SPARK-36512][UI][TESTS] Fix UISeleniumSuite in sql/hive-thriftserver (commit: 013f2b7) — gengliang / githubweb
  12. [SPARK-36536][SQL] Use CAST for datetime in CSV/JSON by default (commit: 1235bd2) — max.gekk / githubweb
  13. [SPARK-36519][SS] Store RocksDB format version in the checkpoint for (commit: ea49198) — viirya / githubweb
  14. [SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the remote (commit: e3902d1) — gengliang / githubweb
  15. [SPARK-36444][SQL] Remove OptimizeSubqueries from batch of (commit: 2310b99) — yumwang / githubweb
  16. Revert "[SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the re… (commit: b36b1c7) — gengliang / githubweb
  17. [SPARK-36428][TESTS][FOLLOWUP] Revert mistake change to (commit: 462aa7c) — gengliang / githubweb
  18. [SPARK-35312][SS][FOLLOW-UP] More documents and checking logic for the (commit: a0b2401) — kabhwan.opensource / githubweb
  19. [SPARK-36547][BUILD] Downgrade scala-maven-plugin to 4.3.0 (commit: f0775d2) — gengliang / githubweb
  20. [SPARK-36551][BUILD] Add sphinx-plotly-directive in Spark release (commit: 42eebb8) — gengliang / githubweb
  21. [SPARK-36448][SQL] Exceptions in NoSuchItemException.scala have to be (commit: 5c0762b) — wenchen / githubweb
  22. Updates AuthEngine to pass the correct SecretKeySpec format (commit: c441c7e) — srowen / githubweb
  23. [SPARK-35083][CORE][FOLLLOWUP] Improve docs and migration guide (commit: 90cbf9c) — yao / githubweb

#827 (Aug 18, 2021, 12:46:27 AM)

  1. [SPARK-36465][SS] Dynamic gap duration in session window (commit: 8b8d91c) — kabhwan.opensource / githubweb
  2. [SPARK-36491][SQL] Make from_json/to_json to handle timestamp_ntz type (commit: 9b9db5a) — max.gekk / githubweb
  3. [SPARK-36498][SQL] Reorder inner fields of the input query in byName V2 (commit: f4b31c6) — wenchen / githubweb
  4. [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user (commit: 2270ecf) — mridulatgmail.com / githubweb
  5. [SPARK-36418][SQL] Use CAST in parsing of dates/timestamps with default (commit: f620996) — wenchen / githubweb
  6. [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker (commit: 8ee464c) — dongjoon / githubweb
  7. [SPARK-36469][PYTHON] Implement Index.map (commit: 4dcd746) — ueshin / githubweb
  8. [SPARK-35548][CORE][SHUFFLE] Handling new attempt has started error (commit: 05cd5f9) — mridulatgmail.com / githubweb
  9. [SPARK-36041][SS][DOCS] Introduce the RocksDBStateStoreProvider in the (commit: 3d57e00) — viirya / githubweb
  10. [SPARK-36521][SQL] Disallow comparison between Interval and String (commit: 26d6b95) — max.gekk / githubweb
  11. [SPARK-36052][K8S][FOLLOWUP] Update config version to 3.2.0 (commit: ea13c5a) — gurwls223 / githubweb
  12. [SPARK-36524][SQL] Common class for ANSI interval types (commit: 82a3150) — max.gekk / githubweb
  13. Revert "[SPARK-35028][SQL] ANSI mode: disallow group by aliases" (commit: 8bfb4f1) — gengliang / githubweb
  14. [SPARK-36387][PYTHON] Fix Series.astype from datetime to nullable string (commit: c0441bb) — ueshin / githubweb
  15. [SPARK-36370][PYTHON] _builtin_table directly imported from pandas (commit: 964dfe2) — ueshin / githubweb
  16. [SPARK-36535][SQL] Refine the sql reference doc (commit: 4b015e8) — dhyun / githubweb
  17. [SPARK-36370][PYTHON][FOLLOWUP] Use LooseVersion instead of (commit: 7fb8ea3) — gurwls223 / githubweb
  18. [SPARK-36400][SPARK-36398][SQL][WEBUI] Make ThriftServer recognize (commit: b914ff7) — sarutak / githubweb
  19. [SPARK-34309][BUILD][FOLLOWUP] Upgrade Caffeine to 2.9.2 (commit: 281b00a) — sarutak / githubweb

#826 (Aug 15, 2021, 12:31:07 PM)

  1. [SPARK-36507][DOCS] Remove/Replace missing links to AMP Camp materials (commit: 41436b2) — max.gekk / githubweb
  2. [SPARK-36495][SQL] Use type match to simplify methods in (commit: 1da1e33) — gurwls223 / githubweb
  3. [SPARK-36500][CORE] Fix temp_shuffle file leaking when a task is (commit: ec5f3a1) — gurwls223 / githubweb
  4. [SPARK-32920][CORE][FOLLOW-UP] Fix string interpolator in the log (commit: a47ceaf) — gurwls223 / githubweb
  5. [SPARK-36487][CORE] Modify exit executor log logic (commit: 46f56e6) — srowen / githubweb
  6. [SPARK-36503][SQL] Add RowToColumnConverter for BinaryType (commit: 959cf50) — dongjoon / githubweb
  7. [SPARK-36475][DOC] Add doc about (commit: 8c90ca8) — dongjoon / githubweb
  8. [SPARK-36508][SQL] ANSI type coercion: disallow binary operations (commit: ecdea91) — gengliang / githubweb
  9. [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name (commit: 3f8ec0d) — dongjoon / githubweb
  10. [SPARK-35320][SQL] Align error message for unsupported key types in (commit: a9ab41a) — gurwls223 / githubweb
  11. [MINOR][DOCS] More correct results for GitHub Actions build link at (commit: e369499) — dongjoon / githubweb

#825 (Aug 13, 2021, 2:34:39 AM)

  1. [SPARK-36483][CORE][TESTS] Fix intermittent test failures at Netty (commit: b8e2186) — mridulatgmail.com / githubweb
  2. [SPARK-36501][ML] Fix random col names in LSHModel.approxSimilarityJoin (commit: 886dbe0) — gurwls223 / githubweb
  3. [SPARK-36497][SQL] Support Interval add/subtract NULL (commit: d4466d5) — wenchen / githubweb
  4. [SPARK-36502][SQL] Remove jaxb-api from `sql/catalyst` module (commit: e8e5785) — gurwls223 / githubweb
  5. [SPARK-36447][SQL] Avoid inlining non-deterministic With-CTEs (commit: 29b1e39) — wenchen / githubweb
  6. [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept (commit: 7d82336) — wenchen / githubweb
  7. [SPARK-36499][SQL][TESTS] Test Interval multiply / divide null (commit: eb6be7f) — max.gekk / githubweb
  8. [SPARK-36490][SQL] Make from_csv/to_csv to handle timestamp_ntz type (commit: 7fd3454) — max.gekk / githubweb

#824 (Aug 12, 2021, 2:22:57 PM)

  1. [SPARK-36456][CORE][SQL][SS] Clean up compilation warnings related to (commit: f7c85b8) — dongjoon / githubweb
  2. [SPARK-36468][SQL][DOCS] Update docs about ANSI interval literals (commit: bbf988b) — max.gekk / githubweb
  3. [SPARK-36474][PYTHON][DOCS] Mention 'pandas API on Spark' in Spark (commit: ccead31) — gurwls223 / githubweb
  4. [SPARK-36482][BUILD] Bump orc to 1.6.10 (commit: aff1b55) — dongjoon / githubweb
  5. Update Spark key negotiation protocol (commit: 3b0dd14) — srowen / githubweb
  6. [SPARK-36481][ML] Expose LogisticRegression.setInitialModel, like KMeans (commit: 71fe094) — d_tsai / githubweb
  7. [HOTFIX] Fix java style (commit: c250bbc) — viirya / githubweb
  8. [SPARK-32986][SQL] Add bucketed scan info in query plan of data source (commit: 79515e4) — dongjoon / githubweb
  9. [SPARK-36480][SS] SessionWindowStateStoreSaveExec should not filter (commit: fac4e5e) — viirya / githubweb
  10. [SPARK-36479][SQL][TEST] Improve datetime test coverage in SQL files (commit: 00a4364) — wenchen / githubweb
  11. [SPARK-36489][SQL] Aggregate functions over no grouping keys, on tables (commit: 2b66575) — wenchen / githubweb
  12. [SPARK-36097][CORE] Grouping exception in core/scheduler (commit: 9b96b70) — wenchen / githubweb
  13. [SPARK-35881][SQL][FOLLOWUP] Remove the AQE post stage creation (commit: 124d011) — wenchen / githubweb
  14. [SPARK-36445][SQL][FOLLOWUP] ANSI type coercion: revisit promoting (commit: 48e333a) — gengliang / githubweb

#823 (Aug 10, 2021, 9:17:14 PM)

  1. [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common (commit: 3f09093) — mridulatgmail.com / githubweb
  2. [SPARK-36463][SS] Prohibit update mode in streaming aggregation with (commit: ed60aaa) — kabhwan.opensource / githubweb
  3. [SPARK-36052][K8S] Introducing a limit for pending PODs (commit: 1dced49) — dongjoon / githubweb
  4. [SPARK-36445][SQL] ANSI type coercion rule for date time operations (commit: 3029e62) — gengliang / githubweb

#822 (Aug 10, 2021, 1:08:23 PM)

  1. [SPARK-36455][SS] Provide an example of complex session window via (commit: 004b87d) — kabhwan.opensource / githubweb
  2. [SPARK-20384][SQL] Support value class in nested schema for Dataset (commit: 33c6d11) — srowen / githubweb
  3. [SPARK-36454][SQL] Not push down partition filter to ORCScan for DSv2 (commit: b04330c) — dongjoon / githubweb
  4. [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and (commit: b8508f4) — gurwls223 / githubweb
  5. [SPARK-36332][SHUFFLE] Cleanup RemoteBlockPushResolver log messages (commit: ab89710) — yi.wu / githubweb
  6. [SPARK-36377][DOCS] Re-document "Options read in YARN client/cluster (commit: c040593) — gurwls223 / githubweb
  7. [SPARK-36460][SHUFFLE] Pull out NoOpMergedShuffleFileManager inner class (commit: df0de83) — gengliang / githubweb
  8. [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check (commit: e1a5d94) — wenchen / githubweb
  9. [SPARK-36466][SQL] Table in unloaded catalog referenced by view should (commit: 7f56b73) — wenchen / githubweb
  10. [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different (commit: 89d8a4e) — max.gekk / githubweb
  11. [SPARK-36429][SQL] JacksonParser should throw exception when data type (commit: 186815b) — wenchen / githubweb
  12. [SPARK-36464][CORE] Fix Underlying Size Variable Initialization in (commit: c888bad) — dhyun / githubweb

#821 (Aug 9, 2021, 3:29:39 AM)

  1. [SPARK-36425][PYSPARK][ML] Support CrossValidatorModel get standard (commit: f9f6c0d) — gurwls223 / githubweb
  2. [SPARK-36432][BUILD] Upgrade Jetty version to 9.4.43 (commit: 5a22f9c) — gurwls223 / githubweb
  3. [SPARK-36369][PYTHON] Fix Index.union to follow pandas 1.3 (commit: a9f371c) — gurwls223 / githubweb
  4. [SPARK-36450][SQL] Remove unused UnresolvedV2Relation (commit: b3d7ebb) — wenchen / githubweb
  5. [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec (commit: 8714eef) — wenchen / githubweb
  6. [SPARK-36352][SQL] Spark should check result plan's output schema name (commit: e051a54) — wenchen / githubweb
  7. [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer (commit: bb6f65a) — wenchen / githubweb
  8. [SPARK-36271][SQL] Unify V1 insert check field name before prepare (commit: f3e079b) — wenchen / githubweb
  9. [SPARK-36430][SQL] Adaptively calculate the target size when coalescing (commit: 9a539d5) — wenchen / githubweb
  10. [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace (commit: 900908b) — gurwls223 / githubweb

#820 (Aug 6, 2021, 6:24:20 PM)

  1. [SPARK-36068][BUILD][TEST] No tests in hadoop-cloud run unless (commit: 0f5c3a4) — gurwls223 / githubweb
  2. [SPARK-36384][CORE][DOC] Add doc for shuffle checksum (commit: 3b92c72) — gurwls223 / githubweb
  3. [SPARK-36173][CORE] Support getting CPU number in TaskContext (commit: f6e6d11) — mridulatgmail.com / githubweb
  4. [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we (commit: b377ea2) — yi.wu / githubweb
  5. [SPARK-36393][BUILD] Try to raise memory for GHA (commit: 7d13ac1) — viirya / githubweb
  6. [SPARK-36353][SQL] RemoveNoopOperators should keep output schema (commit: 02810ee) — wenchen / githubweb
  7. [SPARK-36409][SQL][TESTS] Splitting test cases from datetime.sql (commit: 095f9ff) — gengliang / githubweb
  8. [SPARK-36414][SQL] Disable timeout for BroadcastQueryStageExec in AQE (commit: 0c94e47) — wenchen / githubweb
  9. [SPARK-36441][INFRA] Fix GA failure related to downloading lintr (commit: e13bd58) — gurwls223 / githubweb
  10. [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus (commit: 856c9a5) — gurwls223 / githubweb
  11. [SPARK-36421][SQL][DOCS] Use ConfigEntry.key to fix docs and set command (commit: c7fa3c9) — gurwls223 / githubweb
  12. [SPARK-36393][BUILD][FOLLOW-UP] Try to raise memory for GHA (commit: cd070f1) — viirya / githubweb
  13. [SPARK-36420][GRAPHX] Use `isEmpty` to improve performance in Pregel‘s (commit: 8230a2a) — gurwls223 / githubweb
  14. [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide (commit: 8a35243) — gurwls223 / githubweb
  15. [SPARK-36429][SQL] JacksonParser should throw exception when data type (commit: eb12727) — wenchen / githubweb
  16. [SPARK-36429][SQL][FOLLOWUP] Update a golden file to comply with the (commit: 63c7d18) — wenchen / githubweb
  17. [SPARK-35221][SQL] Add the check of supported join hints (commit: c97fb68) — wenchen / githubweb
  18. [SPARK-36098][CORE] Grouping exception in core/storage (commit: 7bb53b8) — wenchen / githubweb
  19. [SPARK-36339][SQL] References to grouping that not part of aggregation (commit: 888f8f0) — wenchen / githubweb
  20. Revert "[SPARK-36429][SQL] JacksonParser should throw exception when (commit: e17612d) — sarutak / githubweb
  21. [SPARK-595][DOCS] Add local-cluster mode option in Documentation (commit: 41b011e) — tgraves / githubweb
  22. [SPARK-36423][SHUFFLE] Randomize order of blocks in a push request to (commit: 6e72951) — mridulatgmail.com / githubweb
  23. [SPARK-36359][SQL] Coalesce drop all expressions after the first non (commit: 4624e59) — yumwang / githubweb

#819 (Aug 4, 2021, 12:08:40 PM)

  1. [SPARK-35918][AVRO] Unify schema mismatch handling for read/write and (commit: be06e41) — gengliang / githubweb
  2. [SPARK-36206][CORE] Support shuffle data corruption diagnosis via (commit: a98d919) — mridulatgmail.com / githubweb
  3. [SPARK-36224][SQL] Use Void as the type name of NullType (commit: 2f70077) — wenchen / githubweb
  4. [SPARK-36382][WEBUI] Remove noisy footer from the summary table for (commit: 366f7fe) — gengliang / githubweb
  5. [SPARK-36086][SQL] CollapseProject project replace alias should use (commit: f317395) — wenchen / githubweb
  6. [SPARK-35430][K8S] Switch on "PVs with local storage" integration test (commit: 7b90fd2) — incomplete / githubweb
  7. [SPARK-36379][SQL] Null at root level of a JSON array should not fail w/ (commit: 0bbcbc6) — dongjoon / githubweb
  8. [SPARK-36137][SQL] HiveShim should fallback to getAllPartitionsOf even (commit: 7a27f8a) — viirya / githubweb
  9. [SPARK-36373][SQL] DecimalPrecision only add necessary cast (commit: c20af53) — yumwang / githubweb
  10. [SPARK-36331][CORE] Add standard SQLSTATEs to error guidelines (commit: 63517eb) — gurwls223 / githubweb
  11. [SPARK-36345][SPARK-36367][INFRA][PYTHON] Disable tests failed by the (commit: 8cb9cf3) — gurwls223 / githubweb
  12. [SPARK-36389][CORE][SHUFFLE] Revert the change that accepts negative (commit: 2712343) — dongjoon / githubweb
  13. [SPARK-36383][CORE] Avoid NullPointerException during executor shutdown (commit: 0b0f4dd) — dongjoon / githubweb
  14. [SPARK-36192][PYTHON] Better error messages for DataTypeOps against (commit: 8ca11fe) — gurwls223 / githubweb
  15. [SPARK-36380][SQL] Simplify the logical plan names for ALTER TABLE ... (commit: 7cb9c1c) — max.gekk / githubweb
  16. [SPARK-36175][SQL][FOLLOWUP] Improve the comments for (commit: 1deb386) — gengliang / githubweb
  17. [SPARK-36315][SQL] Only skip AQEShuffleReadRule in the final stage if it (commit: dd80457) — wenchen / githubweb
  18. [SPARK-35815][SQL][FOLLOWUP] Add test considering the case (commit: 92cdb17) — max.gekk / githubweb
  19. [SPARK-36349][SQL] Disallow ANSI intervals in file-based datasources (commit: 67cbc93) — max.gekk / githubweb
  20. [SPARK-36280][SQL] Remove redundant aliases after (commit: 4a6afb4) — dongjoon / githubweb
  21. [SPARK-36381][SQL] Add case sensitive and case insensitive compare for (commit: 87d49cb) — gurwls223 / githubweb
  22. [MINOR][DOC] Remove obsolete `contributing-to-spark.md` (commit: c31b653) — gurwls223 / githubweb
  23. [SPARK-36404][SQL] Support ORC nested column vectorized reader for data (commit: de62b5a) — dongjoon / githubweb
  24. [SPARK-35811][PYTHON][FOLLOWUP] Deprecate DataFrame.to_spark_io (commit: 3d72c20) — gurwls223 / githubweb
  25. [SPARK-32923][FOLLOW-UP] Clean up older shuffleMergeId shuffle files (commit: d816949) — mridulatgmail.com / githubweb
  26. [SPARK-36354][CORE] EventLogFileReader should skip rolling event log (commit: 28a2a22) — kabhwan.opensource / githubweb
  27. [SPARK-34309][BUILD][CORE][SQL][K8S] Use Caffeine instead of Guava Cache (commit: 01cf6f4) — hkarau / githubweb

#818 (Aug 2, 2021, 5:02:41 AM)

  1. [SPARK-36365][PYTHON] Remove old workarounds related to null ordering (commit: 90d31df) — gurwls223 / githubweb
  2. [SPARK-35976][PYTHON] Adjust astype method for ExtensionDtype in pandas (commit: f04e991) — gurwls223 / githubweb
  3. [SPARK-36319][SQL][PYTHON] Make Observation return Map instead of Row (commit: a65eb36) — gurwls223 / githubweb
  4. [SPARK-36362][CORE][SQL][TESTS] Omnibus Java code static analyzer (commit: 72615bc) — dongjoon / githubweb
  5. [SPARK-36092][INFRA][BUILD][PYTHON] Migrate to GitHub Actions with (commit: c0d1860) — gurwls223 / githubweb
  6. [SPARK-36362][CORE][SQL][FOLLOWUP] Fix java linter errors (commit: 22c4922) — gurwls223 / githubweb
  7. [SPARK-32919][FOLLOW-UP] Filter out driver in the merger locations and (commit: 2a18f82) — mridulatgmail.com / githubweb
  8. [SPARK-32923][CORE][SHUFFLE] Handle indeterminate stage retries for (commit: c039d99) — mridulatgmail.com / githubweb
  9. [SPARK-36372][SQL] v2 ALTER TABLE ADD COLUMNS should check duplicates (commit: 3b713e7) — wenchen / githubweb
  10. [SPARK-36237][UI][SQL] Attach and start handler after application (commit: 951efb8) — gengliang / githubweb

#817 (Jul 30, 2021, 9:38:04 PM)

  1. [SPARK-36190][PYTHON] Improve the rest of DataTypeOps tests by avoiding (commit: 9c5cb99) — ueshin / githubweb
  2. [SPARK-36286][SQL] Block some invalid datetime string (commit: ed0e351) — wenchen / githubweb
  3. [SPARK-36272][SQL][TEST] Change shuffled hash join metrics test to check (commit: 6a8dd32) — gurwls223 / githubweb
  4. [SPARK-36323][SQL] Support ANSI interval literals for TimeWindow (commit: db18866) — max.gekk / githubweb
  5. [SPARK-36334][K8S] Add a new conf to allow K8s API server-side caching (commit: 86c4227) — dhyun / githubweb
  6. [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function (commit: a07df1a) — gurwls223 / githubweb
  7. [SPARK-36175][SQL] Support TimestampNTZ in Avro data source (commit: 69c4543) — gengliang / githubweb
  8. [SPARK-36326][SQL] Use computeIfAbsent to simplify the process of put a (commit: f8535a6) — srowen / githubweb
  9. [SPARK-36347][SS] Upgrade the RocksDB version to 6.20.3 (commit: 4cd5fa9) — dhyun / githubweb
  10. [SPARK-36333][PYTHON] Reuse isnull where the null check is needed (commit: 07ed82b) — ueshin / githubweb
  11. [SPARK-36341][SQL] Aggregated Metrics by Executor link should wrap <a> (commit: 4d11b0d) — srowen / githubweb
  12. [SPARK-36344][CORE][SHUFFLE] Fix some typos in ShuffleBlockPusher class (commit: 900b38d) — gurwls223 / githubweb
  13. [SPARK-36136][SQL][TESTS] Refactor PruneFileSourcePartitionsSuite etc to (commit: 0ece865) — viirya / githubweb
  14. [SPARK-35806][PYTHON][FOLLOW-UP] Mapping the mode argument to pandas in (commit: 94cb2bb) — gurwls223 / githubweb
  15. [SPARK-36254][INFRA][PYTHON] Install mlflow in Github Actions CI (commit: abce61f) — dongjoon / githubweb
  16. [SPARK-34952][SQL][FOLLOWUP] Simplify JDBC aggregate pushdown (commit: 387a251) — viirya / githubweb
  17. [SPARK-36254][PYTHON][FOLLOW-UP] Skip mlflow related tests in pandas on (commit: dd2ca0a) — gurwls223 / githubweb
  18. [SPARK-36338][PYTHON][SQL] Move distributed-sequence implementation to (commit: c6140d4) — gurwls223 / githubweb
  19. [SPARK-36358][K8S] Upgrade Kubernetes Client Version to 5.6.0 (commit: 801017f) — dongjoon / githubweb
  20. [SPARK-36350][PYTHON] Move some logic related to F.nanvl to DataTypeOps (commit: 895e3f5) — ueshin / githubweb
  21. [SPARK-35881][SQL] Add support for columnar execution of final query (commit: 0f53840) — tgraves / githubweb
  22. [SPARK-36345][INFRA] Update PySpark GitHubAction docker image to (commit: 0e65ed5) — gurwls223 / githubweb
  23. [SPARK-36338][PYTHON][FOLLOW-UP] Keep the original default value as (commit: 74a6b9d) — gurwls223 / githubweb
  24. Revert "[SPARK-36345][INFRA] Update PySpark GitHubAction docker image to (commit: 95a5c17) — dhyun / githubweb

#816 (Jul 28, 2021, 1:34:16 PM)

  1. [SPARK-36136][SQL][TESTS] Refactor PruneFileSourcePartitionsSuite etc to (commit: 634f96d) — viirya / githubweb
  2. [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push (commit: c4aa54e) — mridulatgmail.com / githubweb
  3. [SPARK-36260][PYTHON] Add set_categories to CategoricalAccessor and (commit: 55971b7) — ueshin / githubweb
  4. [SPARK-36142][PYTHON] Follow Pandas when pow between fractional series (commit: d52c2de) — gurwls223 / githubweb
  5. [SPARK-36267][PYTHON] Clean up CategoricalAccessor and CategoricalIndex (commit: c40d9d4) — gurwls223 / githubweb
  6. [SPARK-36288][DOCS][PYTHON] Update API usage on pyspark pandas documents (commit: 9a47483) — gurwls223 / githubweb
  7. [SPARK-36247][SQL] Check string length for char/varchar and apply type (commit: 068f8d4) — wenchen / githubweb
  8. [SPARK-36211][PYTHON] Correct typing of `udf` return value (commit: ede1bc6) — mszymkiewicz / githubweb
  9. [SPARK-36285][INFRA][TESTS] Skip MiMa in PySpark/SparkR/Docker GHA job (commit: 674202e) — gurwls223 / githubweb
  10. [SPARK-36241][SQL] Support creating tables with null column (commit: 8e7e14d) — wenchen / githubweb
  11. [SPARK-34619][SQL][DOCS] Describe ANSI interval types at the `Data (commit: f483796) — sarutak / githubweb
  12. Revert "[SPARK-36136][SQL][TESTS] Refactor (commit: 22ac98d) — gurwls223 / githubweb
  13. [SPARK-34249][DOCS] Add documentation for ANSI implicit cast rules (commit: df98d5b) — wenchen / githubweb
  14. [SPARK-36263][SQL][PYTHON] Add Dataframe.observation to PySpark (commit: f90eb6a) — wenchen / githubweb
  15. [SPARK-36310][PYTHON] Fix IndexOpsMixin.hasnans to use isnull().any() (commit: bcc595c) — gurwls223 / githubweb
  16. [SPARK-36314][SS] Update Sessionization examples to use native support (commit: 1fafa8e) — viirya / githubweb
  17. [SPARK-36318][SQL][DOCS] Update docs about mapping of ANSI interval (commit: 1614d00) — sarutak / githubweb
  18. [SPARK-34952][SQL][FOLLOW-UP] DSv2 aggregate push down follow-up (commit: c8dd97d) — wenchen / githubweb
  19. [SPARK-36275][SQL] ResolveAggregateFunctions should works with nested (commit: 23a6ffa) — wenchen / githubweb
  20. [SPARK-35639][SQL] Add metrics about coalesced partitions to (commit: 41a16eb) — wenchen / githubweb
  21. [SPARK-36312][SQL] ParquetWriterSupport.setSchema should check inner (commit: 59e0c25) — wenchen / githubweb
  22. [SPARK-34399][DOCS][FOLLOWUP] Add docs for the new metrics of task/job (commit: c9a7ff3) — wenchen / githubweb
  23. [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands (commit: 809b88a) — wenchen / githubweb
  24. [SPARK-33865][SPARK-36202][SQL] When HiveDDL, we need check avro schema (commit: 86f4457) — wenchen / githubweb
  25. [SPARK-36312][SQL][FOLLOWUP] Add back (commit: f086c17) — wenchen / githubweb
  26. [SPARK-35320][SQL] Improve error message for unsupported key types in (commit: f12793d) — wenchen / githubweb
  27. [SPARK-36270][BUILD][FOLLOWUP] Fix typo in the sbt memory setting (commit: aff1826) — gurwls223 / githubweb
  28. [SPARK-36320][PYTHON] Fix Series/Index.copy() to drop extra columns (commit: 3c76a92) — gurwls223 / githubweb
  29. [SPARK-36095][CORE] Grouping exception in core/rdd (commit: af6d04b) — wenchen / githubweb
  30. [SPARK-36229][SQL] conv() inconsistently handles invalid strings with (commit: e1c50ff) — wenchen / githubweb
  31. [SPARK-36143][PYTHON] Adjust `astype` of fractional Series with missing (commit: 0121309) — ueshin / githubweb
  32. [SPARK-36236][SS] Additional metrics for RocksDB based state store (commit: eb4d1c0) — viirya / githubweb

#815 (Jul 26, 2021, 8:21:32 AM)

  1. [SPARK-36279][INFRA][PYTHON] Fix lint-python to work with Python 3.9 (commit: 663cbdf) — gurwls223 / githubweb
  2. [SPARK-36225][PYTHON][DOCS] Use DataFrame in python docstrings (commit: ae1c20e) — gurwls223 / githubweb
  3. [SPARK-36255][SHUFFLE][CORE] Stop pushing and retrying on FileNotFound (commit: 09e1c61) — yi.wu / githubweb
  4. [SPARK-35259][SHUFFLE] Update ExternalBlockHandler Timer variables to (commit: 70a1586) — yi.wu / githubweb
  5. [SPARK-32920][FOLLOW-UP][CORE] Shutdown shuffleMergeFinalizeScheduler (commit: 21450b3) — dongjoon / githubweb
  6. [SPARK-34952][SQL] DSv2 Aggregate push down APIs (commit: c561ee6) — wenchen / githubweb
  7. [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of (commit: 094ae37) — wenchen / githubweb
  8. [SPARK-36269][SQL] Fix only set data columns to Hive column names config (commit: e5616e3) — wenchen / githubweb
  9. [SPARK-34402][SQL] Group exception about data format schema (commit: a63802f) — wenchen / githubweb
  10. [SPARK-32920][FOLLOW-UP] Fix shuffleMergeFinalized directly calling (commit: ba1a7ce) — mridulatgmail.com / githubweb
  11. [SPARK-36217][SQL] Rename CustomShuffleReader and (commit: 6e3d404) — wenchen / githubweb

#814 (Jul 24, 2021, 12:10:49 AM)

  1. [SPARK-36253][PYTHON][DOCS] Add versionadded to the top of (commit: f3e2957) — gurwls223 / githubweb
  2. [SPARK-36214][PYTHON] Add add_categories to CategoricalAccessor and (commit: dcc0aaa) — ueshin / githubweb
  3. [SPARK-36246][CORE][TEST] GHA WorkerDecommissionExtended flake (commit: 89a8319) — gurwls223 / githubweb
  4. [SPARK-36249][PYTHON] Add remove_categories to CategoricalAccessor and (commit: a3c7ae1) — gurwls223 / githubweb
  5. [SPARK-35809][PYTHON] Add `index_col` argument for ps.sql (commit: 6578f0b) — gurwls223 / githubweb
  6. [SPARK-35810][PYTHON][FOLLWUP] Deprecate ps.broadcast API (commit: d1a037a) — gurwls223 / githubweb
  7. [SPARK-34806][SQL] Add Observation helper for Dataset.observe (commit: 4e9c1b8) — wenchen / githubweb
  8. [SPARK-36243][SQL][PYTHON][DOCS] Fixing pyspark tableExists issue with (commit: 2c35604) — gurwls223 / githubweb
  9. [SPARK-36156][SQL] SCRIPT TRANSFORM ROW FORMAT DELIMITED should respect (commit: bb09bd2) — wenchen / githubweb
  10. [SPARK-35088][SQL][FOLLOWUP] Add test case for TimestampNTZ sequence (commit: 900b72a) — gengliang / githubweb
  11. [SPARK-36239][PYTHON][DOCS] Remove some APIs from documentation (commit: 86471ad) — gurwls223 / githubweb
  12. [SPARK-36256][BUILD] Upgrade lz4-java to 1.8.0 (commit: 13aefd6) — gengliang / githubweb
  13. [SPARK-36257][SQL] Updated the version of TimestampNTZ related changes (commit: ae9f612) — gengliang / githubweb
  14. [SPARK-36209][PYTHON][DOCS] Fix link to pyspark Dataframe documentation (commit: 3a1db2d) — srowen / githubweb
  15. [SPARK-35815][SQL] Allow delayThreshold for watermark to be represented (commit: 07fa38e) — max.gekk / githubweb
  16. [SPARK-35310][MLLIB] Update to breeze 1.2 (commit: 518f00f) — srowen / githubweb
  17. [SPARK-35848][MLLIB] Optimize some treeAggregates in MLlib by delaying (commit: b69c268) — srowen / githubweb
  18. [SPARK-36262][BUILD] Upgrade ZSTD-JNI to 1.5.0-4 (commit: a1a1974) — dongjoon / githubweb
  19. [SPARK-36265][PYTHON] Use __getitem__ instead of getItem to suppress (commit: a76a087) — gurwls223 / githubweb
  20. [SPARK-36189][PYTHON] Improve bool, string, numeric DataTypeOps tests by (commit: 75fd1f5) — gurwls223 / githubweb
  21. [SPARK-36248][PYTHON] Add rename_categories to CategoricalAccessor and (commit: 8b3d84b) — gurwls223 / githubweb
  22. [SPARK-36268][PYTHON] Set the lowerbound of mypy version to 0.910 (commit: d6bc8cd) — gurwls223 / githubweb
  23. [SPARK-36261][PYTHON] Add remove_unused_categories to (commit: 2fe12a7) — gurwls223 / githubweb
  24. [SPARK-36270][BUILD] Change memory settings for enabling GA (commit: fd36ed4) — gurwls223 / githubweb
  25. [SPARK-36258][PYTHON] Exposing functionExists in pyspark sql catalog (commit: 382fe44) — gurwls223 / githubweb
  26. [SPARK-36226][PYTHON][DOCS] Improve python docstring links to other (commit: 701756a) — gurwls223 / githubweb
  27. [SPARK-34399][SQL] Add commit duration to SQL tab's graph node (commit: 3ff8c9f) — wenchen / githubweb
  28. [SPARK-36242][CORE] Ensure spill file closed before set `success = true` (commit: f61d599) — yi.wu / githubweb
  29. [SPARK-35561][SQL] Remove leading zeros from empty static number type (commit: fc29c91) — srowen / githubweb
  30. [SPARK-36273][SHUFFLE] Fix identical values comparison (commit: 530c8ad) — srowen / githubweb
  31. [SPARK-36276][BUILD][TESTS] Update maven-checkstyle-plugin to 3.1.2 and (commit: 32f3e21) — dongjoon / githubweb
  32. [SPARK-36270][BUILD][FOLLOWUP] Reduce metaspace size for pyspark (commit: c2de111) — dongjoon / githubweb
  33. [SPARK-35956][K8S] Support auto assigning labels to decommissioning pods (commit: bee2799) — hkarau / githubweb
  34. [MINOR][INFRA] Add enabled_merge_buttons to .asf.yaml explicitly (commit: bad7a92) — dongjoon / githubweb
  35. [SPARK-36264][PYTHON] Add reorder_categories to CategoricalAccessor and (commit: e12bc4d) — ueshin / githubweb
  36. [SPARK-36274][PYTHON] Fix equality comparison of unordered Categoricals (commit: 85adc2f) — ueshin / githubweb

#813 (Jul 21, 2021, 8:00:28 PM)

  1. [SPARK-36127][PYTHON] Support comparison between a Categorical and a (commit: 8dd4335) — ueshin / githubweb
  2. [SPARK-36167][PYTHON][FOLLOWUP] Fix test failures with older versions of (commit: c459c70) — gurwls223 / githubweb
  3. [SPARK-36176][PYTHON] Expose tableExists in pyspark.sql.catalog (commit: d7d961f) — gurwls223 / githubweb
  4. [SPARK-36179][SQL] Support TimestampNTZType in SparkGetColumnsOperation (commit: 0c76fb9) — gurwls223 / githubweb
  5. [SPARK-36216][PYTHON][TESTS] Increase timeout for (commit: d6b974f) — gurwls223 / githubweb
  6. [SPARK-35546][SHUFFLE] Enable push-based shuffle when multiple app (commit: c77acf0) — mridulatgmail.com / githubweb
  7. [SPARK-34051][DOCS][FOLLOWUP] Document about unicode literals (commit: ba1294e) — wenchen / githubweb
  8. [SPARK-36183][SQL] Push down limit 1 through Aggregate if it is group (commit: af978c8) — yumwang / githubweb
  9. [SPARK-36221][SQL] Make sure CustomShuffleReaderExec has at least one (commit: b70c258) — wenchen / githubweb
  10. [SPARK-31907][DOCS][SQL] Adding location of SQL API documentation (commit: e9b18b0) — srowen / githubweb
  11. [SPARK-36201][SQL][FOLLOWUP] Schema check should check inner field too (commit: 2518857) — wenchen / githubweb
  12. [SPARK-36207][PYTHON] Expose databaseExists in pyspark.sql.catalog (commit: 463fcb3) — gurwls223 / githubweb
  13. [SPARK-36204][INFRA][BUILD] Deduplicate Scala 2.13 daily build (commit: 801b369) — gurwls223 / githubweb
  14. [SPARK-36046][SQL][FOLLOWUP] Implement prettyName for MakeTimestampNTZ (commit: 033a573) — gengliang / githubweb
  15. [SPARK-36079][SQL] Null-based filter estimate should always be in the (commit: ddc61e6) — wenchen / githubweb
  16. [SPARK-36210][SQL] Preserve column insertion order in (commit: bf680bf) — viirya / githubweb
  17. [SPARK-36222][SQL] Step by days in the Sequence expression for dates (commit: c0d84e6) — max.gekk / githubweb
  18. [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor (commit: 376fadc) — ueshin / githubweb
  19. [SPARK-36172][SS] Document session window into Structured Streaming (commit: 0eb31a0) — kabhwan.opensource / githubweb
  20. [SPARK-35027][CORE] Close the inputStream in FileAppender when writin… (commit: 1a8c675) — srowen / githubweb
  21. [SPARK-35658][DOCS] Document Parquet encryption feature in Spark SQL (commit: 7ceefca) — srowen / githubweb
  22. [SPARK-36153][SQL][DOCS] Update transform doc to match the current code (commit: 305d563) — srowen / githubweb
  23. [SPARK-36030][SQL] Support DS v2 metrics at writing path (commit: 2653201) — viirya / githubweb
  24. [SPARK-36030][SQL][FOLLOW-UP] Avoid procedure syntax deprecated in Scala (commit: 99006e5) — gurwls223 / githubweb
  25. [SPARK-36030][SQL][FOLLOW-UP] Remove duplicated test suite (commit: df798ed) — viirya / githubweb
  26. [SPARK-36132][SS][SQL] Support initial state for batch mode of (commit: efcce23) — tathagata.das1565 / githubweb
  27. [SPARK-36020][SQL][FOLLOWUP] RemoveRedundantProjects should retain the (commit: 94aece4) — wenchen / githubweb
  28. [SPARK-36208][SQL] SparkScriptTransformation should support ANSI (commit: f56c7b7) — max.gekk / githubweb
  29. [SPARK-36228][SQL] Skip splitting a skewed partition when some map (commit: 9c8a3d3) — wenchen / githubweb
  30. [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` (commit: 685c3fd) — wenchen / githubweb
  31. [SPARK-36213][SQL] Normalize PartitionSpec for Describe Table Command (commit: 4cd6cfc) — yao / githubweb
  32. [SPARK-36188][PYTHON] Add categories setter to CategoricalAccessor and (commit: d506815) — ueshin / githubweb
  33. [SPARK-32797][SPARK-32391][SPARK-33242][SPARK-32666][ANSIBLE] updating a (commit: ad528a0) — incomplete / githubweb
  34. [SPARK-35912][SQL] Fix nullability of `spark.read.json/spark.read.csv` (commit: 09bebc8) — gurwls223 / githubweb
  35. [SPARK-36244][BUILD] Upgrade zstd-jni to 1.5.0-3 to avoid a bug about (commit: dcb7db5) — dongjoon / githubweb
  36. [SPARK-36063][SQL] Optimize OneRowRelation subqueries (commit: de8e4be) — wenchen / githubweb

#812 (Jul 19, 2021, 12:59:20 PM)

  1. [SPARK-36122][CORE] Passing on needClientAuth to Jetty SSLContextFactory (commit: bfdde96) — srowen / githubweb
  2. [SPARK-36195][BUILD] Set MaxMetaspaceSize JVM option to 2g (commit: d7df7a8) — dongjoon / githubweb
  3. [SPARK-36090][SQL] Support TimestampNTZType in expression Sequence (commit: 42275bb) — max.gekk / githubweb
  4. [MINOR][SQL] Fix typo for config hint in SQLConf.scala (commit: 92d4563) — srowen / githubweb
  5. [SPARK-36040][DOCS][K8S] Add reference to kubernetes-client's version (commit: eea69c1) — dongjoon / githubweb
  6. [SPARK-36014][K8S] Use uuid as app id in kubernetes client mode (commit: fe94bf0) — dongjoon / githubweb
  7. [SPARK-35460][K8S] verify the content (commit: a9e2156) — dongjoon / githubweb
  8. [SPARK-36075][K8S] Support for specifiying executor/driver node selector (commit: f85855c) — dongjoon / githubweb
  9. [SPARK-36198][TESTS] Skip UNIDOC generation in PySpark GHA job (commit: c336f73) — dongjoon / githubweb
  10. [SPARK-35810][PYTHON] Deprecate ps.broadcast API (commit: 67e6120) — gurwls223 / githubweb
  11. [SPARK-36199][BUILD] Bump scalatest-maven-plugin to 2.0.2 (commit: df8bae0) — dongjoon / githubweb
  12. [SPARK-36193][CORE] Recover SparkSubmit.runMain not to stop SparkContext (commit: fd3e9ce) — dongjoon / githubweb
  13. [SPARK-36184][SQL] Use ValidateRequirements instead of (commit: 8396a70) — wenchen / githubweb
  14. [SPARK-36197][SQL] Use PartitionDesc instead of TableDesc for reading (commit: ef80356) — yao / githubweb
  15. [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's (commit: 313f3c5) — wenchen / githubweb
  16. [SPARK-36163][SQL] Propagate correct JDBC properties in JDBC connector (commit: 4036ad9) — gurwls223 / githubweb
  17. [SPARK-36166][TESTS][FOLLOW-UP] Add Scala version change logic into (commit: 8ee199e) — gurwls223 / githubweb
  18. [SPARK-34806][SQL] Add Observation helper for Dataset.observe (commit: cc940ff) — wenchen / githubweb
  19. Revert "[SPARK-34806][SQL] Add Observation helper for Dataset.observe" (commit: 506b333) — gurwls223 / githubweb
  20. [SPARK-36205][INFRA] Use set-env instead of set-output in GitHub Actions (commit: c92790a) — gurwls223 / githubweb
  21. [SPARK-36178][PYTHON] List pyspark.sql.catalog APIs in documentation (commit: fe4db74) — gurwls223 / githubweb
  22. [SPARK-36181][PYTHON] Update pyspark sql readwriter documentation (commit: 2ef8ced) — gurwls223 / githubweb
  23. [SPARK-35806][PYTHON] Mapping the `mode` argument to pandas in (commit: 2f42afc) — gurwls223 / githubweb
  24. [SPARK-36091][SQL] Support TimestampNTZ type in expression TimeWindow (commit: 7aa0179) — gengliang / githubweb
  25. [SPARK-36166][TESTS][FOLLOWUP] Add BLOCK_SCALA_VERSION to (commit: c7ccc60) — gurwls223 / githubweb

#811 (Jul 17, 2021, 5:47:38 AM)

  1. [SPARK-36131][SQL][TEST] Refactor ParquetColumnIndexSuite (commit: 7a7b086) — dongjoon / githubweb
  2. [SPARK-36129][BUILD] Upgrade commons-compress to 1.21 to deal with CVEs (commit: fd06cc2) — dongjoon / githubweb
  3. [SPARK-36037][SQL] Support ANSI SQL LOCALTIMESTAMP datetime value (commit: b4f7758) — wenchen / githubweb
  4. [SPARK-35639][SQL] Make hasCoalescedPartition return true if something (commit: 4033b2a) — wenchen / githubweb
  5. [SPARK-36130][SQL] UnwrapCastInBinaryComparison should skip In (commit: 103d16e) — wenchen / githubweb
  6. [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator (commit: 12a576f) — kabhwan.opensource / githubweb
  7. [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range (commit: b866457) — wenchen / githubweb
  8. [SPARK-36123][SQL] Parquet vectorized reader doesn't skip null values (commit: e980c7a) — wenchen / githubweb
  9. [SPARK-35639][SQL][FOLLOWUP] Make hasCoalescedPartition return true if (commit: 3819641) — wenchen / githubweb
  10. [SPARK-36069][SQL] Add field info to `from_json`'s exception in the (commit: 1e86345) — max.gekk / githubweb
  11. [SPARK-36125][PYTHON] Implement non-equality comparison operators (commit: 0cb120f) — ueshin / githubweb
  12. [SPARK-36106][SQL][CORE] Label error classes for subset of (commit: e92b8ea) — gurwls223 / githubweb
  13. [SPARK-36144][INFRA][TESTS] Use Python 3.9 in `run-pip-tests` conda (commit: 5202944) — gurwls223 / githubweb
  14. [SPARK-36037][SQL][FOLLOWUP] Fix flaky test for datetime function (commit: 0973397) — gengliang / githubweb
  15. [SPARK-36139][INFRA][TESTS] Remove Python 3.6 from `pyspark` GitHub (commit: 416a7fd) — dongjoon / githubweb
  16. [SPARK-36150][INFRA][TESTS] Disable MiMa for Scala 2.13 artifacts (commit: 5acfecb) — dongjoon / githubweb
  17. [SPARK-36037][TESTS][FOLLOWUP] Avoid wrong test results on daylight (commit: 564d3de) — max.gekk / githubweb
  18. [SPARK-36149][PYTHON] Clarify documentation for dayofweek and weekofyear (commit: b5ee6d0) — max.gekk / githubweb
  19. [SPARK-36148][SQL] Fix input data types check for regexp_replace (commit: 4dfd266) — max.gekk / githubweb
  20. [SPARK-33898][SQL][FOLLOWUP] Fix the behavior of `SHOW CREATE TABLE` to (commit: f95ca31) — gurwls223 / githubweb
  21. [SPARK-29519][SQL][FOLLOWUP] Keep output is deterministic for show (commit: e05441c) — wenchen / githubweb
  22. [SPARK-36154][DOCS] Documenting week and quarter as valid formats in (commit: 802f632) — max.gekk / githubweb
  23. [SPARK-36159][BUILD] Replace 'python' to 'python3' in (commit: 6bd385f) — dongjoon / githubweb
  24. [SPARK-36146][PYTHON][INFRA][TESTS] Upgrade Python version from 3.6 to (commit: a71dd6a) — dongjoon / githubweb
  25. [SPARK-32792][SQL][FOLLOWUP] Fix Parquet filter pushdown NOT IN (commit: 0062c03) — max.gekk / githubweb
  26. [SPARK-36158][PYTHON][DOCS] Improving pyspark sql/functions (commit: 2db7ed7) — max.gekk / githubweb
  27. [SPARK-36157][SQL][SS] TimeWindow expression: apply filter before (commit: 1ceb753) — viirya / githubweb
  28. [SPARK-36135][SQL] Support TimestampNTZ type in file partitioning (commit: 96c2919) — gengliang / githubweb
  29. [SPARK-36165][INFRA] Fix SQL doc generation in GitHub Action (commit: d69f981) — dongjoon / githubweb
  30. [SPARK-36164][INFRA] run-test.py should not fail when APACHE_SPARK_REF (commit: c8a3c22) — dongjoon / githubweb
  31. [SPARK-36034][SQL] Rebase datetime in pushed down filters to parquet (commit: b09b7f7) — max.gekk / githubweb
  32. [SPARK-36164][INFRA][FOLLOWUP] Add empty string check back (commit: 5f41a27) — dongjoon / githubweb
  33. [SPARK-36167][PYTHON] Revisit more InternalField managements (commit: c22f7a4) — ueshin / githubweb
  34. [SPARK-36166][TESTS] Support Scala 2.13 test in `dev/run-tests.py` (commit: f66153d) — dongjoon / githubweb
  35. [SPARK-36169][SQL] Make 'spark.sql.sources.disabledJdbcConnProviderList' (commit: fba61ad) — gurwls223 / githubweb
  36. [SPARK-36171][BUILD] Upgrade GenJavadoc to 0.18 (commit: ad744fb) — dongjoon / githubweb
  37. [SPARK-35985][SQL] push partitionFilters for empty readDataSchema (commit: f06aa4a) — wenchen / githubweb
  38. [SPARK-35710][SQL] Support DPP + AQE when there is no reused broadcast (commit: c1b3f86) — wenchen / githubweb
  39. [SPARK-34893][SS] Support session window natively (commit: f2bf8b0) — kabhwan.opensource / githubweb
  40. [SPARK-36160][PYTHON][DOCS] Clarifying documentation for pyspark (commit: 2d8d7b4) — gurwls223 / githubweb
  41. [SPARK-36152][INFRA][TESTS] Add Scala 2.13 daily build and test GitHub (commit: 3218e4e) — dongjoon / githubweb
  42. [SPARK-36128][SQL] Apply spark.sql.hive.metastorePartitionPruning for (commit: 37dc3f9) — viirya / githubweb
  43. [SPARK-35276][CORE] Calculate checksum for shuffle data and write as (commit: 4783fb7) — mridulatgmail.com / githubweb
  44. [SPARK-32922][SHUFFLE][CORE][FOLLOWUP] Fixes few issues when the (commit: 6d2cbad) — mridulatgmail.com / githubweb
  45. [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite (commit: 8009f0d) — dongjoon / githubweb
  46. [SPARK-36170][SQL] Change quoted interval literal (interval constructor) (commit: 71ea25d) — max.gekk / githubweb

#810 (Jul 13, 2021, 10:36:47 PM)

  1. [SPARK-36036][CORE] Fix cleanup of DownloadFile resources (commit: cfcd094) — srowen / githubweb
  2. [SPARK-36083][SQL] make_timestamp: return different result based on the (commit: 17ddcc9) — max.gekk / githubweb
  3. [SPARK-36064][PYTHON] Manage InternalField more in DataTypeOps (commit: 95e6c6e) — gurwls223 / githubweb
  4. [SPARK-35813][SQL][DOCS] Add new adaptive config into (commit: 0e9786c) — wenchen / githubweb
  5. [SPARK-36003][PYTHON] Implement unary operator `invert` of integral (commit: badb039) — gurwls223 / githubweb
  6. [SPARK-36044][SQL] Suport TimestampNTZ in functions (commit: 8738682) — max.gekk / githubweb
  7. [SPARK-36072][SQL] TO_TIMESTAMP: return different results based on the (commit: 32720dd) — max.gekk / githubweb
  8. [SPARK-33679][SQL][DOCS][FOLLOWUP] Enable spark.sql.adaptive.enabled by (commit: 286c231) — gurwls223 / githubweb
  9. [SPARK-36089][SQL][DOCS] Update the SQL migration guide about encoding (commit: e788a3f) — gurwls223 / githubweb
  10. [SPARK-36056][SQL] Combine readBatch and readIntegers in (commit: 5edbbd1) — wenchen / githubweb
  11. [SPARK-35861][SS] Introduce "prefix match scan" feature on state store (commit: 094300f) — viirya / githubweb
  12. [SPARK-33603][SQL] Grouping exception messages in execution/command (commit: d03f716) — gengliang / githubweb
  13. [SPARK-36046][SQL] Support new functions make_timestamp_ntz and (commit: 92bf83e) — max.gekk / githubweb
  14. [SPARK-36103][PYTHON] Manage InternalField in DataTypeOps.invert (commit: e2021da) — gurwls223 / githubweb
  15. [SPARK-35829][SQL][FOLLOWUP] Use subExprCode to avoid duplicate call of (commit: 8ab1933) — viirya / githubweb
  16. [SPARK-36104][PYTHON] Manage InternalField in DataTypeOps.neg/abs (commit: 5afc27f) — gurwls223 / githubweb
  17. Revert "[SPARK-35253][SPARK-35398][SQL][BUILD] Bump up the janino (commit: ae6199a) — gurwls223 / githubweb
  18. [SPARK-36104][PYTHON][FOLLOWUP] Remove unused import "typing.cast" (commit: 47fd317) — gurwls223 / githubweb
  19. [SPARK-36110][BUILD] Upgrade SBT to 1.5.5 (commit: c46342e) — gurwls223 / githubweb
  20. [SPARK-36109][SS][TEST] Check data after adding data to topic in (commit: 201566c) — dongjoon / githubweb
  21. [SPARK-36048][TEST][CORE] Fix HealthTrackerSuite.allExecutorAndHostIds (commit: f8a80c4) — yi.wu / githubweb
  22. [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries (commit: 4f760f2) — wenchen / githubweb
  23. [SPARK-36119][SQL] Add new SQL function to_timestamp_ltz (commit: 01ddaf3) — gengliang / githubweb
  24. [SPARK-35749][SPARK-35773][SQL] Parse unit list interval literals as (commit: 8e92ef8) — wenchen / githubweb
  25. [SPARK-35334][K8S] Make Spark more resilient to intermittent K8s (commit: 03e48c8) — piros.attila.zsolt / githubweb
  26. [SPARK-35735][SQL][FOLLOWUP] Remove unused method (commit: 1ba3982) — max.gekk / githubweb
  27. [SPARK-36081][SPARK-36066][SQL] Update the document about the behavior (commit: 57a4f31) — wenchen / githubweb
  28. [SPARK-36074][SQL] Add error class for StructType.findNestedField (commit: 4a62e1e) — wenchen / githubweb
  29. [SPARK-36033][SQL][TEST] Validate partitioning requirements in TPCDS (commit: 583173b) — wenchen / githubweb
  30. [SPARK-36120][SQL] Support TimestampNTZ type in cache table (commit: 0674327) — max.gekk / githubweb
  31. [SPARK-34891][SS] Introduce state store manager for session window in (commit: 0fe2d80) — viirya / githubweb
  32. [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle (commit: fbf53de) — mridulatgmail.com / githubweb

#808 (Jul 11, 2021, 5:20:23 AM)

  1. [SPARK-35999][SQL] Make from_csv/to_csv to handle day-time intervals (commit: def8bc5) — wenchen / githubweb
  2. [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse (commit: 26d1bb1) — max.gekk / githubweb
  3. [SPARK-36004][INFRA] Update MiMa and audit API changes (commit: d8e91eb) — srowen / githubweb
  4. [SPARK-36025][SQL][TESTS] Reduce the run time of DateExpressionsSuite (commit: d5d1222) — gengliang / githubweb
  5. [SPARK-36009][GRAPHX] Add missing GraphX classes to registerKryoClasses (commit: 2fff060) — srowen / githubweb
  6. [SPARK-36020][SQL] Check logical link in remove redundant projects (commit: 6b3ab82) — wenchen / githubweb
  7. [SPARK-35984][SQL][TEST] Config to force applying shuffled hash join (commit: 7566db6) — wenchen / githubweb
  8. [SPARK-36026][BUILD][K8S] Upgrade kubernetes-client to 5.5.0 (commit: bad6f89) — gurwls223 / githubweb
  9. [SPARK-36028][SQL] Allow Project to host outer references in scalar (commit: ca348e5) — wenchen / githubweb
  10. [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions (commit: 16c195c) — gurwls223 / githubweb
  11. [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number (commit: ddc5cb9) — gurwls223 / githubweb
  12. [SPARK-35929][PYTHON] Support to infer nested dict as a struct when (commit: 2537fe8) — gurwls223 / githubweb
  13. [SPARK-32577][SQL][TEST] Fix the config value for shuffled hash join in (commit: f3c1159) — gurwls223 / githubweb
  14. [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover (commit: 3953754) — max.gekk / githubweb
  15. [SPARK-36017][SQL] Support TimestampNTZType in expression (commit: cc4463e) — max.gekk / githubweb
  16. [SPARK-35907][CORE] Instead of File#mkdirs, Files#createDirectories is (commit: 55373b1) — srowen / githubweb
  17. [SPARK-36016][SQL] Support TimestampNTZType in expression (commit: be382a6) — max.gekk / githubweb
  18. [SPARK-36015][SQL] Support TimestampNTZType in the Window spec (commit: 62ff2ad) — max.gekk / githubweb
  19. [SPARK-36021][SQL] Parse interval literals should support more than 2 (commit: ea3333a) — max.gekk / githubweb
  20. [SPARK-35615][PYTHON] Make unary and comparison operators (commit: 6e4e04f) — ueshin / githubweb
  21. [SPARK-32577][SQL][TEST][FOLLOWUP] Fix the config value of shuffled hash (commit: 23943e5) — gurwls223 / githubweb
  22. [SPARK-36022][SQL] Respect interval fields in extract (commit: 39002cb) — max.gekk / githubweb
  23. [SPARK-36021][SQL][FOLLOWUP] DT/YM func use field byte to keep (commit: 89aa16b) — max.gekk / githubweb
  24. [SPARK-36043][SQL][TESTS] Add end-to-end tests with default timestamp (commit: 57342df) — gengliang / githubweb
  25. [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider (commit: 0621e78) — kabhwan.opensource / githubweb
  26. [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java (commit: 71c086e) — wenchen / githubweb
  27. [SPARK-35874][SQL] AQE Shuffle should wait for its subqueries to finish (commit: 2df67a1) — wenchen / githubweb
  28. [SPARK-36012][SQL] Add null flag in SHOW CREATE TABLE (commit: e071721) — wenchen / githubweb
  29. [SPARK-36055][SQL] Assign pretty SQL string to TimestampNTZ literals (commit: ee945e9) — max.gekk / githubweb
  30. [SPARK-35340][PYTHON] Standardize TypeError messages for unsupported (commit: 819c482) — ueshin / githubweb
  31. [SPARK-36054][SQL] Support group by TimestampNTZ type column (commit: 382b66e) — max.gekk / githubweb
  32. [SPARK-36049][SQL] Remove IntervalUnit (commit: fef7e17) — max.gekk / githubweb
  33. [SPARK-36051][DOCS] Remove the automatic build guides of documentation (commit: a1ce649) — gurwls223 / githubweb
  34. [SPARK-36062][PYTHON] Try to capture faulthanlder when a Python worker (commit: 115b8a1) — gurwls223 / githubweb
  35. [SPARK-36001][PYTHON] Assume result's index to be disordered in tests (commit: af81ad0) — gurwls223 / githubweb
  36. [SPARK-36002][PYTHON] Consolidate tests for data-type-based operations (commit: fdc50f4) — gurwls223 / githubweb
  37. [SPARK-36032][SQL] Use inputPlan instead of currentPhysicalPlan to (commit: 484b50c) — viirya / githubweb
  38. [SPARK-36067][BUILD][TEST][YARN] YarnClusterSuite fails due to (commit: 9aa65a6) — gurwls223 / githubweb
  39. [SPARK-36035][PYTHON] Adjust `test_astype`, `test_neg`  for old pandas (commit: 698c4ec) — gurwls223 / githubweb
  40. [SPARK-36068][BUILD][TEST] No tests in hadoop-cloud run unless (commit: c3c5af8) — gurwls223 / githubweb
  41. Revert "[SPARK-36068][BUILD][TEST] No tests in hadoop-cloud run unless (commit: 951e84f) — gurwls223 / githubweb
  42. [SPARK-36018][CORE][SQL] Some Improvement for Spark Core (commit: a46dc9b) — srowen / githubweb
  43. [SPARK-36070][CORE] Log time cost info for writing rows out and (commit: f5a6332) — yao / githubweb
  44. [SPARK-36047][CORE] Replace the handwriting compare methods with static (commit: 83b3b75) — srowen / githubweb

#805 (Jul 6, 2021, 2:03:36 AM)

  1. [SPARK-35940][SQL] Refactor EquivalentExpressions to make it more (commit: e6ce220) — viirya / githubweb
  2. [SPARK-35986][PYSPARK] Fix type hint for RDD.histogram's buckets (commit: 495d234) — gurwls223 / githubweb
  3. [SPARK-35980][CORE] ThreadAudit logs whether thread is daemon (commit: e4273f7) — gurwls223 / githubweb
  4. [SPARK-36007][INFRA] Failed to run benchmark in GA (commit: 11fcbc7) — gurwls223 / githubweb
  5. [SPARK-35987][SQL] The ANSI flags of Sum and Avg should be kept after (commit: 51103cd) — wenchen / githubweb
  6. [SPARK-35982][SQL] Allow from_json/to_json for map types where value (commit: 6474226) — max.gekk / githubweb
  7. [SPARK-36010][BUILD] Upgrade sbt-antlr4 from 0.8.2 to 0.8.3 (commit: 554d5fe) — sarutak / githubweb
  8. [SPARK-36013][BUILD] Upgrade Dropwizard Metrics to 4.2.2 (commit: 7f70350) — gurwls223 / githubweb
  9. [SPARK-35794][SQL] Allow custom plugin for AQE cost evaluator (commit: 044dddf) — wenchen / githubweb
  10. [SPARK-35989][SQL] Only remove redundant shuffle if shuffle origin is (commit: 7fe4c4a) — wenchen / githubweb
  11. [SPARK-33996][BUILD][FOLLOW-UP] Match SBT's plugin checkstyle version to (commit: 2fe6c94) — gurwls223 / githubweb
  12. [SPARK-35998][SQL] Make from_csv/to_csv to handle year-month intervals (commit: f4237af) — max.gekk / githubweb
  13. [SPARK-35664][SQL][FOLLOWUP] Fix incorrect comment for TimestampNTZType (commit: c605ba2) — gengliang / githubweb
  14. [SPARK-35979][SQL] Return different timestamp literals based on the (commit: 2fffec7) — gengliang / githubweb
  15. [SPARK-35977][SQL] Support non-reserved keyword TIMESTAMP_NTZ (commit: 5f44acf) — max.gekk / githubweb
  16. [SPARK-34302][SQL][FOLLOWUP] More code cleanup (commit: 8b46e26) — wenchen / githubweb
  17. [SPARK-35788][SS] Metrics support for RocksDB instance (commit: 9544277) — kabhwan.opensource / githubweb
  18. [SPARK-35978][SQL] Support non-reserved keyword TIMESTAMP_LTZ (commit: b0b9643) — gengliang / githubweb
  19. [SPARK-36011][SQL] Disallow altering permanent views based on temporary (commit: e0c6b2e) — wenchen / githubweb
  20. [SPARK-35972][SQL] When replace ExtractValue in NestedColumnAliasing we (commit: 87282f0) — viirya / githubweb
  21. [SPARK-35983][SQL] Allow from_json/to_json for map types where value (commit: c8ff613) — max.gekk / githubweb

#804 (Jul 3, 2021, 8:04:11 AM)

  1. [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType (commit: f249277) — wenchen / githubweb
  2. [SPARK-35618][SQL] Resolve star expressions in subqueries using outer (commit: f281736) — wenchen / githubweb
  3. [SPARK-35685][SQL] Prompt recreating the view when there is an (commit: 0c34b96) — wenchen / githubweb
  4. [SPARK-35965][DOCS] Add doc for ORC nested column vectorized reader (commit: 3c3193c) — gurwls223 / githubweb
  5. [SPARK-35966][SQL] Port HIVE-17952: Fix license headers to avoid (commit: 6699f76) — yao / githubweb
  6. [SPARK-35686][SQL] Not allow using auto-generated alias when creating (commit: 3c68343) — wenchen / githubweb
  7. [SPARK-35971][SQL] Rename the type name of TimestampNTZType as (commit: 3acc4b9) — gengliang / githubweb
  8. [SPARK-35969][K8S] Make the pod prefix more readable and tallied with (commit: 94c1e3c) — dongjoon / githubweb
  9. [SPARK-35756][SQL] unionByName supports struct having same col names but (commit: ca12176) — wenchen / githubweb
  10. [SPARK-35975][SQL] New configuration `spark.sql.timestampType` for the (commit: a643076) — max.gekk / githubweb
  11. [SPARK-35779][SQL] Dynamic filtering for Data Source V2 (commit: fceabe2) — viirya / githubweb
  12. [SPARK-35339][PYTHON] Improve unit tests for data-type-based basic (commit: 95d9494) — ueshin / githubweb
  13. [SPARK-35897][SS] Support user defined initial state with (commit: 47485a3) — gengliang / githubweb
  14. [SPARK-35955][SQL] Check for overflow in Average in ANSI mode (commit: 1fda011) — gengliang / githubweb
  15. [SPARK-35825][INFRA][FOLLOWUP] Increase it in build/mvn script (commit: 79a6e00) — dongjoon / githubweb
  16. [SPARK-35785][SS] Cleanup support for RocksDB instance (commit: ca6acf0) — viirya / githubweb
  17. [SPARK-35968][SQL] Make sure partitions are not too small in AQE (commit: 0c9c8ff) — wenchen / githubweb
  18. [SPARK-35981][PYTHON][TEST] Use check_exact=False to loosen the check (commit: 7769644) — gurwls223 / githubweb
  19. [SPARK-35992][BUILD] Upgrade ORC to 1.6.9 (commit: c55b9fd) — dongjoon / githubweb
  20. [SPARK-35994][INFRA] Publish snapshot from branch-3.2 (commit: dcc4057) — dongjoon / githubweb
  21. [SPARK-35785][SS][FOLLOWUP] Ignore concurrent update and cleanup test (commit: a6e00ee) — dongjoon / githubweb
  22. [SPARK-35990][BUILD] Remove avro-sbt plugin dependency (commit: 6c4616b) — dongjoon / githubweb
  23. [SPARK-35996][BUILD] Setting version to 3.3.0-SNAPSHOT (commit: f9f9568) — dongjoon / githubweb

#803 (Jul 1, 2021, 12:46:49 AM)

  1. [SPARK-35899][SQL] Utility to convert connector expressions to Catalyst (commit: 63cd131) — dongjoon / githubweb
  2. [SPARK-35466][PYTHON] Fix disallow_untyped_defs mypy checks for (commit: a9ebfc5) — ueshin / githubweb
  3. [SPARK-35879][CORE][SHUFFLE] Fix performance regression caused by (commit: 14d4dec) — yao / githubweb
  4. [SPARK-35895][SQL] Support subtracting Intervals from TimestampWithoutTZ (commit: 645fb59) — max.gekk / githubweb
  5. [SPARK-35903][TESTS] Parameterize 'master' in TPCDSQueryBenchmark (commit: f68fbae) — dhyun / githubweb
  6. [SPARK-35905][SQL][TESTS] Fix UT to clean up table/view in SQLQuerySuite (commit: 74637a6) — dhyun / githubweb
  7. [SPARK-35904][SQL] Collapse above RebalancePartitions (commit: def29e5) — dongjoon / githubweb
  8. [SPARK-35893][TESTS] Add unit test case for MySQLDialect.getCatalystType (commit: b11b175) — dongjoon / githubweb
  9. [SPARK-35886][SQL] PromotePrecision should not overwrite genCode (commit: b89cd8d) — viirya / githubweb
  10. [SPARK-35909][DOCS] Fix broken Python Links in (commit: a7369b3) — dongjoon / githubweb
  11. [SPARK-35605][PYTHON] Move to_pandas_on_spark to the Spark DataFrame (commit: 03e6de2) — gurwls223 / githubweb
  12. [SPARK-35901][PYTHON] Refine type hints in pyspark.pandas.window (commit: 8c401be) — gurwls223 / githubweb
  13. [SPARK-35880][SS] Track the duplicates dropped count in dedupe operator (commit: 0da463e) — kabhwan.opensource / githubweb
  14. [SPARK-35318][SQL][FOLLOWUP] Hide the internal view properties for `show (commit: 378ac78) — wenchen / githubweb
  15. [SPARK-35064][SQL] Group error in spark-catalyst (commit: 1c81ad2) — wenchen / githubweb
  16. [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService (commit: 3255511) — mridulatgmail.com / githubweb
  17. Revert "[SPARK-35904][SQL] Collapse above RebalancePartitions" (commit: 108635a) — yumwang / githubweb
  18. [SPARK-35728][SPARK-35778][SQL][TESTS] Check multiply/divide of day-time (commit: 356aef4) — max.gekk / githubweb
  19. [SPARK-35898][SQL] Fix arrays and maps in RowToColumnConverter (commit: c660650) — herman / githubweb
  20. [SPARK-35910][CORE][SHUFFLE] Update remoteBlockBytes based on merged (commit: 9c157a4) — dongjoon / githubweb
  21. [SPARK-35344][PYTHON] Support creating a Column of numpy literals in (commit: 5f0113e) — ueshin / githubweb
  22. [SPARK-33898][SQL] Support SHOW CREATE TABLE In V2 (commit: 8fbbd2e) — yao / githubweb
  23. [SPARK-35888][SQL] Add dataSize field in CoalescedPartitionSpec (commit: 622fc68) — wenchen / githubweb
  24. [SPARK-34302][SQL] Migrate ALTER TABLE ... CHANGE COLUMN command to use (commit: 620fde4) — wenchen / githubweb
  25. [SPARK-35876][SQL] ArraysZip should retain field names to avoid being (commit: 880bbd6) — gurwls223 / githubweb
  26. [SPARK-35920][BUILD] Upgrade to Chill 0.10.0 (commit: b999e6b) — dongjoon / githubweb
  27. [SPARK-35922][BUILD] Upgrade maven-shade-plugin to 3.2.4 (commit: c45a6f5) — dongjoon / githubweb
  28. [SPARK-35899][SQL][FOLLOWUP] Utility to convert connector expressions to (commit: 8a21d2d) — dongjoon / githubweb
  29. [SPARK-35483][FOLLOWUP][TESTS] Enable docker_integration_tests for (commit: 57896e6) — dongjoon / githubweb
  30. [SPARK-34302][FOLLOWUP][SQL][TESTS] Update jdbc.v2.*IntegrationSuite (commit: 16e5035) — dongjoon / githubweb
  31. [SPARK-35483][FOLLOWUP][TESTS] Update run-tests.py doctest (commit: 0a7a6f7) — dongjoon / githubweb
  32. [SPARK-35916][SQL] Support subtraction among (commit: 7635114) — gengliang / githubweb
  33. [SPARK-35721][PYTHON] Path level discover for python unittests (commit: 5db51ef) — gurwls223 / githubweb
  34. [SPARK-35927][SQL] Remove type collection AllTimestampTypes (commit: 78e6263) — gengliang / githubweb
  35. [SPARK-35923][SQL] Coalesce empty partition with mixed (commit: def7383) — wenchen / githubweb
  36. [SPARK-35928][BUILD] Upgrade ASM to 9.1 (commit: 7e70282) — dongjoon / githubweb
  37. [SPARK-35859][PYTHON] Cleanup type hints in pandas-on-Spark (commit: 2702fb9) — ueshin / githubweb
  38. [SPARK-35906][SQL] Remove order by if the maximum number of rows less (commit: 4a17e7a) — dongjoon / githubweb
  39. [SPARK-35924][BUILD][TESTS] Add Java 17 ea build test to GitHub action (commit: a6088e5) — dongjoon / githubweb
  40. Revert "[SPARK-35721][PYTHON] Path level discover for python unittests" (commit: 1f6e2f5) — ueshin / githubweb
  41. [SPARK-35921][BUILD] ${spark.yarn.isHadoopProvided} in config.properties (commit: 05c6b8a) — d_tsai / githubweb
  42. [SPARK-32922][SHUFFLE][CORE] Adds support for executors to fetch local (commit: 9a5cd15) — mridulatgmail.com / githubweb
  43. [SPARK-35784][SS] Implementation for RocksDB instance (commit: 3257a30) — viirya / githubweb
  44. [SPARK-35873][PYTHON] Cleanup the version logic from the pandas API on (commit: 28a201a) — gurwls223 / githubweb
  45. Revert "[SPARK-34549][BUILD] Upgrade aws kinesis to 1.14.0 and java sdk (commit: 7ad682a) — gurwls223 / githubweb
  46. [SPARK-35943][PYTHON] Introduce Axis type alias (commit: 0a838dc) — gurwls223 / githubweb
  47. [SPARK-35896][SS] Include more granular metrics for stateful operators (commit: 24b67ca) — kabhwan.opensource / githubweb
  48. [SPARK-35829][SQL] Clean up evaluates subexpressions and add more (commit: 064230d) — viirya / githubweb
  49. [SPARK-35946][PYTHON] Respect Py4J server in InheritableThread API (commit: 8d28839) — dongjoon / githubweb
  50. [SPARK-35937][SQL] Extracting date field from timestamp should work in (commit: ad4b679) — gengliang / githubweb
  51. Revert "[SPARK-33995][SQL] Expose make_interval as a Scala function" (commit: 7668226) — max.gekk / githubweb
  52. [SPARK-35935][SQL] Prevent failure of `MSCK REPAIR TABLE` on table (commit: d28ca9c) — max.gekk / githubweb
  53. [SPARK-35947][INFRA] Increase JVM stack size in release-build.sh (commit: 5312008) — gurwls223 / githubweb
  54. [SPARK-35948][INFRA] Simplify release scripts by removing Spark (commit: b218cc9) — gurwls223 / githubweb
  55. [SPARK-33298][CORE][FOLLOWUP] Add Unstable annotation to (commit: 6bbfb45) — gurwls223 / githubweb
  56. [SPARK-34365][AVRO] Add support for positional Catalyst-to-Avro schema (commit: 4dd41b9) — gengliang / githubweb
  57. [SPARK-34920][CORE][SQL] Add error classes with SQLSTATE (commit: e3bd817) — wenchen / githubweb
  58. [SPARK-35951][DOCS] Add since versions for Avro options in Documentation (commit: c6afd6e) — gengliang / githubweb
  59. [SPARK-35932][SQL] Support extracting hour/minute/second from timestamp (commit: e88aa49) — gengliang / githubweb
  60. [SPARK-35735][SQL] Take into account day-time interval fields in cast (commit: 2febd5c) — max.gekk / githubweb
  61. [SPARK-35953][SQL] Support extracting date fields from timestamp without (commit: 733e85f) — gengliang / githubweb
  62. initial commit for skeleton ansible for jenkins worker config (commit: 2c94fbc) — incomplete / githubweb
  63. [SPARK-35725][SQL] Support optimize skewed partitions in (commit: d46c1e3) — wenchen / githubweb
  64. [SPARK-34859][SQL] Handle column index when using vectorized Parquet (commit: a5c8866) — dongjoon / githubweb
  65. [SPARK-35939][DOCS][PYTHON] Deprecate Python 3.6 in Spark documentation (commit: 9e39415) — gurwls223 / githubweb
  66. [SPARK-35938][PYTHON] Add deprecation warning for Python 3.6 (commit: 5ad1261) — gurwls223 / githubweb
  67. [SPARK-35944][PYTHON] Introduce Name and Label type aliases (commit: a98c8ae) — gurwls223 / githubweb
  68. [SPARK-35888][SQL][FOLLOWUP] Return partition specs for all the shuffles (commit: cd6a463) — wenchen / githubweb
  69. [SPARK-35065][SQL] Group exception messages in spark/sql (core) (commit: 5d74ace) — wenchen / githubweb
  70. [SPARK-35714][FOLLOW-UP][CORE] Use a shared stopping flag for (commit: 868a594) — yi.wu / githubweb
  71. [SPARK-35950][WEBUI] Failed to toggle Exec Loss Reason in the executors (commit: dc85b0b) — gengliang / githubweb
  72. [SPARK-35960][BUILD][TEST] Bump the scalatest version to 3.2.9 (commit: 34286ae) — dongjoon / githubweb
  73. [SPARK-35961][SQL] Only use local shuffle reader when (commit: ba0a479) — wenchen / githubweb
  74. fix Spark version (commit: 6a2f434) — dongjoon / githubweb
  75. Revert "fix Spark version" (commit: 74c4641) — dongjoon / githubweb
  76. [SPARK-35962][DOCS] Deprecate old Java 8 versions prior to 8u201 (commit: 912d2b9) — gurwls223 / githubweb

#802 (Jun 25, 2021, 5:52:57 PM)

  1. [SPARK-35817][SQL] Restore performance of queries against wide Avro (commit: 66d5a00) — gengliang / githubweb
  2. [SPARK-35733][SQL][TESTS] Check all day-time interval types in (commit: 077cf2a) — max.gekk / githubweb
  3. [SPARK-34889][SS] Introduce MergingSessionsIterator merging elements (commit: 4761977) — viirya / githubweb
  4. [SPARK-35729][SQL][TESTS] Check all day-time interval types in aggregate (commit: 2d3fa04) — max.gekk / githubweb
  5. [SPARK-35731][SQL][TESTS] Check all day-time interval types in arrow (commit: ad18722) — max.gekk / githubweb
  6. [SPARK-35851][GRAPHX] Modify the wrong variable used in (commit: 1cf18a2) — srowen / githubweb
  7. [SPARK-35588][PYTHON][DOCS] Merge Binder integration and quickstart (commit: be90897) — gurwls223 / githubweb
  8. [SPARK-35678][ML][FOLLOWUP] softmax support offset and step (commit: a667388) — huaxin_gao / githubweb
  9. [SPARK-34807][SQL] Transpose Window nodes with Project between them (commit: b3a2ceb) — yumwang / githubweb
  10. [SPARK-35869][INFRA] Fix "Cannot run program python" error from (commit: 1cdc56c) — gurwls223 / githubweb
  11. [SPARK-35543][CORE][FOLLOWUP] Fix memory leak in (commit: 0bdece0) — mridulatgmail.com / githubweb
  12. [SPARK-35678][ML][FOLLOWUP] Revert changes in ANN (commit: 37f7042) — gurwls223 / githubweb
  13. [SPARK-35868][CORE] Add fs.s3a.downgrade.syncable.exceptions if not set (commit: af9b47f) — dhyun / githubweb
  14. [SPARK-35852][SQL] Use DateAdd instead of TimeAdd for DateType +/- (commit: 61bd036) — max.gekk / githubweb
  15. [SPARK-35696][PYTHON][DOCS] Refine the code examples in pandas-on-Spark (commit: 712ed87) — gurwls223 / githubweb
  16. [SPARK-35777][SQL][TESTS] Check all year-month interval types in UDF (commit: 490ae8f) — max.gekk / githubweb
  17. [SPARK-35747][CORE] Avoid printing full Exception stack trace, if (commit: 4dabba8) — dhyun / githubweb
  18. [SPARK-35696][PYTHON][DOCS][FOLLOW-UP] Fix underline for title in FAQ to (commit: 92ddef7) — gurwls223 / githubweb
  19. [SPARK-35730][SQL][TESTS] Check all day-time interval types in UDF (commit: 7d0786f) — max.gekk / githubweb
  20. [SPARK-35768][SQL] Take into account year-month interval fields in cast (commit: 5e77ca8) — wenchen / githubweb
  21. [SPARK-35282][SQL][FOLLOWUP] Simplify condition code of shuffled hash (commit: ff9ba89) — wenchen / githubweb
  22. [SPARK-35841][SQL] Casting string to decimal type doesn't work if the… (commit: 5b9c5c1) — wenchen / githubweb
  23. [SPARK-35301][PYTHON][DOCS] Document migration guide from Koalas to (commit: 5a7686a) — gurwls223 / githubweb
  24. [SPARK-35786][SQL] Add a new operator to distingush if AQE can optimize (commit: 1295e88) — wenchen / githubweb
  25. [SPARK-35728][SQL][TESTS] Check multiply/divide of day-time intervals of (commit: 8a1995f) — max.gekk / githubweb
  26. [SPARK-35778][SQL][TESTS] Check multiply/divide of year month interval (commit: 3904c0e) — max.gekk / githubweb
  27. [SPARK-35476][PYTHON] Fix disallow_untyped_defs mypy checks for (commit: cfcfbca) — gurwls223 / githubweb
  28. Revert "[SPARK-35778][SQL][TESTS] Check multiply/divide of year month (commit: 345d3db) — max.gekk / githubweb
  29. Revert "[SPARK-35728][SQL][TESTS] Check multiply/divide of day-time (commit: d40a1a2) — max.gekk / githubweb
  30. [SPARK-35871][SQL] Literal.create(value, dataType) should support fields (commit: de35675) — max.gekk / githubweb
  31. [SPARK-34320][SQL] Migrate ALTER TABLE DROP COLUMNS commands to use (commit: 5b4816c) — wenchen / githubweb
  32. [SPARK-35290][SQL] Append new nested struct fields rather than sort for (commit: 14b1836) — viirya / githubweb
  33. [SPARK-35870][BUILD] Upgrade Jetty to 9.4.42 (commit: 7b78d56) — sarutak / githubweb
  34. [SPARK-35736][SPARK-35774][SQL][FOLLOWUP] Prohibit to specify the same (commit: 156b9b5) — max.gekk / githubweb
  35. [SPARK-35872][INFRA] Automatize some steps to finalize the release (commit: 95ba000) — dhyun / githubweb
  36. [SPARK-33298][CORE] Introduce new API to FileCommitProtocol allow (commit: 2da42ca) — dongjoon / githubweb
  37. [DOCS][MINOR] Update sql-performance-tuning.md (commit: c22f17c) — gurwls223 / githubweb
  38. [SPARK-35885][K8S][R] Use keyserver.ubuntu.com as a keyserver for CRAN (commit: 59ec7a2) — dongjoon / githubweb
  39. [SPARK-34320][SQL][FOLLOWUP] Modify V2JDBCTest to follow the change of (commit: c562c16) — sarutak / githubweb
  40. [SPARK-35887][BUILD] Find and set JAVA_HOME from javac location (commit: c6555f1) — dongjoon / githubweb
  41. [SPARK-35471][PYTHON] Fix disallow_untyped_defs mypy checks for (commit: 6497ac3) — gurwls223 / githubweb
  42. [SPARK-35883][SQL] Migrate ALTER TABLE RENAME COLUMN command to use (commit: f1ad345) — wenchen / githubweb
  43. [SPARK-35884][SQL] EXPLAIN FORMATTED for AQE (commit: c0cfbb1) — viirya / githubweb
  44. [SPARK-35628][SS] RocksDBFileManager - load checkpoint from DFS (commit: f2029e7) — kabhwan.opensource / githubweb
  45. [SPARK-35889][SQL] Support adding TimestampWithoutTZ with Interval types (commit: 9814cf8) — gengliang / githubweb
  46. [SPARK-35878][CORE] Add fs.s3a.endpoint if unset and (commit: 36aaaa1) — dongjoon / githubweb
  47. [SPARK-35672][CORE][YARN] Pass user classpath entries to executors using (commit: 866df69) — tgraves / githubweb
  48. [SPARK-35628][SS][FOLLOW-UP] Fix the consistent break on Scala 2.13 (commit: 0c31137) — dongjoon / githubweb
  49. [SPARK-35863][BUILD] Update Ivy to 2.5.0 (commit: 939ea3d) — dongjoon / githubweb
  50. [SPARK-35894][BUILD] Introduce new style enforce to not import (commit: 67eddf2) — kabhwan.opensource / githubweb

#801 (Jun 23, 2021, 6:40:03 AM)

  1. [SPARK-35811][PYTHON] Deprecate DataFrame.to_spark_io (commit: 653be9d) — gurwls223 / githubweb
  2. [SPARK-35834][PYTHON] Use the same cleanup logic as Py4J in inheritable (commit: 248fda3) — gurwls223 / githubweb
  3. [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and (commit: 682e7f2) — wenchen / githubweb
  4. [SPARK-35545][FOLLOW-UP][TEST][SQL] Add a regression test for the (commit: 974d127) — max.gekk / githubweb
  5. [SPARK-35611][SS] Introduce the strategy on mismatched offset for start (commit: 4a6d90e) — viirya / githubweb
  6. [SPARK-35820][SQL] Support Cast between different field (commit: 1488ea9) — max.gekk / githubweb
  7. [SPARK-35840][SQL] Add `apply()` for a single field to (commit: 37ef7bb) — max.gekk / githubweb
  8. [SPARK-34565][SQL] Collapse Window nodes with Project between them (commit: f80be41) — yamamuro / githubweb
  9. [SPARK-35391] Fix memory leak in ExecutorAllocationListener (commit: 844f10c) — tgraves / githubweb
  10. [SPARK-35775][SQL][TESTS] Check all year-month interval types in (commit: 2c91672) — max.gekk / githubweb
  11. [SPARK-35842][INFRA] Ignore all .idea folders (commit: a100a01) — gengliang / githubweb
  12. [SPARK-35831][YARN][TEST-MAVEN] Handle PathOperationException in (commit: 2b9902d) — gengliang / githubweb
  13. [SPARK-35844][INFRA] Add hadoop-cloud profile to PUBLISH_PROFILES (commit: 0f25cab) — dongjoon / githubweb
  14. [SPARK-35836][SHUFFLE][CORE] Removed the reference to (commit: 1fe6daa) — mridulatgmail.com / githubweb
  15. [SPARK-35614][PYTHON] Make the conversion to pandas data-type-based for (commit: 6ca56b0) — ueshin / githubweb
  16. [SPARK-35839][SQL] New SQL function: to_timestamp_ntz (commit: 2bdd9fe) — gengliang / githubweb
  17. [SPARK-35699][K8S] Improve error message when creating k8s pod failed (commit: 765106c) — dongjoon / githubweb
  18. [SPARK-35700][SQL] Read char/varchar orc table with created and written (commit: 9f73497) — dongjoon / githubweb
  19. [SPARK-35470][PYTHON] Fix disallow_untyped_defs mypy checks for (commit: a8fdb98) — gurwls223 / githubweb
  20. [SPARK-35850][BUILD] Upgrade scala-maven-plugin to 4.5.3 (commit: 89dbf51) — dongjoon / githubweb
  21. [SPARK-35799][SS] Fix the allUpdatesTimeMs metric measuring in (commit: d4d11cf) — kabhwan.opensource / githubweb
  22. [SPARK-35378][SQL][FOLLOWUP] isLocal should consider CommandResult (commit: 43cd6ca) — wenchen / githubweb
  23. [SPARK-35726][SPARK-35769][SQL][FOLLOWUP] Call periodToMonths and (commit: 5a510cf) — max.gekk / githubweb
  24. [SPARK-35838][BUILD][TESTS] Ensure all modules can be maven test (commit: 6c05459) — dongjoon / githubweb
  25. [SPARK-35727][SQL] Return INTERVAL DAY from dates subtraction (commit: bc61b62) — wenchen / githubweb
  26. [SPARK-35854][SQL] Improve the error message of to_timestamp_ntz with (commit: ce53b71) — gengliang / githubweb
  27. [SPARK-35645][PYTHON][DOCS] Merge contents and remove obsolete pages in (commit: 2704658) — dongjoon / githubweb
  28. [SPARK-35849][PYTHON] Make `astype` method data-type-based for (commit: 1c26433) — ueshin / githubweb
  29. [SPARK-35800][SS] Improving GroupState testability by introducing (commit: dfd7b02) — tathagata.das1565 / githubweb
  30. [SPARK-35847][PYTHON] Manage InternalField in DataTypeOps.isnull (commit: c418803) — ueshin / githubweb
  31. [SPARK-35700][SQL][FOLLOWUP] Read schema from ORC files should strip (commit: a2c1a55) — dongjoon / githubweb
  32. [SPARK-35858][SQL] SparkPlan.makeCopy should not set the active session (commit: 7a21e9c) — gurwls223 / githubweb
  33. [SPARK-35473][PYTHON] Fix disallow_untyped_defs mypy checks for (commit: 68b54b7) — gurwls223 / githubweb
  34. [SPARK-35695][SQL][FOLLOWUP] Use AQE helper to simplify the code in (commit: a87ee5d) — gurwls223 / githubweb
  35. [SPARK-35856][SQL][TESTS] Move new interval type test cases from (commit: 960a7e5) — gengliang / githubweb
  36. [SPARK-35734][SQL][FOLLOWUP] IntervalUtils.toDayTimeIntervalString (commit: 4416b4b) — max.gekk / githubweb
  37. [SPARK-35772][SQL][TESTS] Check all year-month interval types in (commit: df55945) — max.gekk / githubweb
  38. [SPARK-35845][SQL] OuterReference resolution should reject ambiguous (commit: 20edfdd) — gengliang / githubweb
  39. [SPARK-35855][SQL] Unify reuse map data structures in non-AQE and AQE (commit: 79e3d0d) — wenchen / githubweb
  40. [SPARK-35776][SQL][TESTS] Check all year-month interval types in arrow (commit: 7c1a9dd) — max.gekk / githubweb
  41. [SPARK-35860][SQL] Support UpCast between different field of (commit: 758b423) — max.gekk / githubweb
  42. [SPARK-35857][SQL] The ANSI flag of Cast should be kept after being (commit: 6f51e37) — gengliang / githubweb
  43. [SPARK-35846][SQL] Introduce ParquetReadState to track various states (commit: b8acbf6) — dongjoon / githubweb
  44. [SPARK-35812][PYTHON] Throw ValueError if version and timestamp are used (commit: 4824c53) — gurwls223 / githubweb
  45. [SPARK-33741][FOLLOW-UP][CORE] Rename the min threshold time speculation (commit: 7f93773) — wenchen / githubweb

#800 (Jun 20, 2021, 4:34:22 PM)

  1. [SPARK-35608][SQL] Support AQE optimizer side transformUpWithPruning (commit: 2c4598d) — gengliang / githubweb
  2. [SPARK-35185][SQL] Improve Distinct statistics estimation (commit: 7be8d8a) — yumwang / githubweb
  3. [SPARK-35342][PYTHON] Introduce DecimalOps and make `isnull` method (commit: f84a720) — ueshin / githubweb
  4. [SPARK-35478][PYTHON] Enable disallow_untyped_defs mypy check for (commit: 3fb044e) — ueshin / githubweb
  5. [SPARK-35478][PYTHON][FOLLOWUP] Fix Jenkins' linter (commit: c879510) — dongjoon / githubweb
  6. [SPARK-35565][SS] Add config for ignoring metadata directory of (commit: 882122d) — kabhwan.opensource / githubweb
  7. [SPARK-35796][TESTS] Fix SparkSubmitSuite failure on MacOS 10.15+ (commit: d015eff) — dongjoon / githubweb
  8. [SPARK-35708][PYTHON][TEST] Add BaseTest for DataTypeOps (commit: b7df75a) — ueshin / githubweb
  9. [SPARK-35593][K8S][TESTS][FOLLOWUP] Increase timeout in (commit: b9d6473) — sarutak / githubweb
  10. [SPARK-35818][BUILD] Upgrade SBT to 1.5.4 (commit: 94f7015) — dongjoon / githubweb
  11. [SPARK-35726][SQL] Truncate java.time.Duration by fields of day-time (commit: 2ebad72) — max.gekk / githubweb
  12. [SPARK-35825][INFRA] Increase the heap and stack size for Maven build (commit: 74d647d) — dongjoon / githubweb
  13. [SPARK-35593][K8S][TESTS][FOLLOWUP] Run (commit: aab37ed) — dongjoon / githubweb
  14. [SPARK-35824][CORE][TESTS] Convert LevelDBSuite.IntKeyType from a nested (commit: a39f1ea) — dongjoon / githubweb
  15. [SPARK-35819][SQL] Support Cast between different field (commit: 86bcd1f) — max.gekk / githubweb
  16. [SPARK-35830][TESTS] Upgrade sbt-mima-plugin to 0.9.2 (commit: 9eaf678) — gurwls223 / githubweb
  17. [SPARK-35472][PYTHON] Fix disallow_untyped_defs mypy checks for (commit: 1589d32) — gurwls223 / githubweb
  18. [SPARK-35303][SPARK-35498][PYTHON][FOLLOW-UP] Copy local properties when (commit: 6d30991) — gurwls223 / githubweb
  19. [SPARK-35771][SQL][FOLLOWUP] IntervalUtils.toYearMonthIntervalString (commit: 4758dc7) — max.gekk / githubweb
  20. [SPARK-35832][CORE][ML][K8S][TESTS] Add LocalRootDirsTest trait (commit: 4f51e00) — dongjoon / githubweb
  21. [SPARK-35827][SQL] Show proper error message when update column types to (commit: af20474) — max.gekk / githubweb
  22. [SPARK-35671][SHUFFLE][CORE] Add support in the ESS to serve merged (commit: 8ce1e34) — mridulatgmail.com / githubweb

#799 (Jun 18, 2021, 5:13:48 AM)

  1. [SPARK-35760][SQL] Fix the max rows check for broadcast exchange (commit: 9709ee5) — yamamuro / githubweb
  2. [SPARK-35691][CORE] addFile/addJar/addDirectory should put CanonicalFile (commit: ac228d4) — sarutak / githubweb
  3. [SPARK-35669][SQL] Quote the pushed column name only when nested column (commit: 11e96dc) — yamamuro / githubweb
  4. [SPARK-35666][ML] gemv skip array shape checking (commit: 2802ac3) — ruifengz / githubweb
  5. [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking (commit: 5c96d64) — ruifengz / githubweb
  6. [SPARK-35203][SQL] Improve Repartition statistics estimation (commit: b08cf6e) — yamamuro / githubweb
  7. [SPARK-35613][CORE][SQL] Cache commonly occurring strings in SQLMetrics, (commit: aaa8a80) — mridulatgmail.com / githubweb
  8. [SPARK-35774][SQL] Parse any year-month interval types in SQL (commit: 4530760) — max.gekk / githubweb
  9. [SPARK-35771][SQL] Format year-month intervals using type fields (commit: 184f65e) — max.gekk / githubweb
  10. [SPARK-35712][SQL] Simplify ResolveAggregateFunctions (commit: a2961dd) — wenchen / githubweb
  11. [SPARK-35556][SQL] Remove close HiveClient's SessionState (commit: 87bf6b0) — yumwang / githubweb
  12. [SPARK-29250][BUILD] Upgrade to Hadoop 3.3.1 (commit: 506ef9a) — dongjoon / githubweb
  13. [SPARK-35763][SS] Remove the StateStoreCustomMetric subclass enumeration (commit: 8e594f0) — kabhwan.opensource / githubweb
  14. [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in (commit: 94bdbec) — gurwls223 / githubweb
  15. [SPARK-35783][SQL] Set the list of read columns in the task (commit: 947c7ea) — dongjoon / githubweb
  16. [SPARK-35791][SQL] Release on-going map properly for NULL-aware ANTI (commit: e0d81d9) — wenchen / githubweb
  17. [SPARK-35757][CORE] Add bitwise AND operation and functionality for (commit: 8aeed08) — wenchen / githubweb
  18. [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON (commit: 0e554d4) — max.gekk / githubweb
  19. [SPARK-35130][SQL] Add make_dt_interval function to construct (commit: 939ae91) — max.gekk / githubweb
  20. [SPARK-35378][SQL][FOLLOWUP] Restore the command execution name for (commit: 0c5a01a) — wenchen / githubweb
  21. [SPARK-35732][SQL] Parse DayTimeIntervalType from JSON (commit: 234163f) — max.gekk / githubweb
  22. [SPARK-35792][SQL] View should not capture configs used in (commit: b86a69f) — wenchen / githubweb
  23. [SPARK-35798][SQL] Fix SparkPlan.sqlContext usage (commit: abf9675) — wenchen / githubweb
  24. [SPARK-35378][SQL][FOLLOWUP] Move CommandResult to (commit: ee2d8ae) — dongjoon / githubweb
  25. [SPARK-34054][CORE] BlockManagerDecommissioner code cleanup (commit: 509c076) — wenchen / githubweb
  26. [SPARK-35789][SQL] Refine lateral join syntax to only allow subqueries (commit: 0d900b6) — wenchen / githubweb
  27. [SPARK-34898][CORE] We should log (commit: 79362c4) — mridulatgmail.com / githubweb
  28. [SPARK-35720][SQL] Support casting of String to timestamp without time (commit: 05e2b76) — gengliang / githubweb
  29. [SPARK-35670][BUILD] Upgrade ZSTD-JNI to 1.5.0-2 (commit: 7fcb127) — dongjoon / githubweb
  30. [SPARK-35095][SS][TESTS] Use ANSI intervals in streaming join tests (commit: 45b7f76) — max.gekk / githubweb
  31. [MINOR] Add GitHub Action build status badge to the README (commit: 4373b67) — dhyun / githubweb
  32. [SPARK-35303][PYTHON] Enable pinned thread mode by default (commit: 41af409) — gurwls223 / githubweb
  33. [SPARK-35678][ML][FOLLOWUP] softmax support offset and step (commit: fdf86fd) — huaxin_gao / githubweb
  34. Revert "[SPARK-35678][ML][FOLLOWUP] softmax support offset and step" (commit: ea90746) — gurwls223 / githubweb
  35. [SPARK-35769][SQL] Truncate java.time.Period by fields of year-month (commit: 071566c) — max.gekk / githubweb
  36. [SPARK-35469][PYTHON] Fix disallow_untyped_defs mypy checks (commit: 2f537a8) — gurwls223 / githubweb

#798 (Jun 15, 2021, 4:14:13 PM)

  1. [SPARK-35719][SQL] Support type conversion between timestamp and (commit: 6272222) — max.gekk / githubweb
  2. [MINOR][K8S] Print the driver pod name instead of Some(name) if absent (commit: 1125afd) — dongjoon / githubweb
  3. [SPARK-35714][CORE] Bug fix for deadlock during the executor shutdown (commit: 69aa7ad) — srowen / githubweb
  4. [SPARK-35736][SQL] Parse any day-time interval types in SQL (commit: 7978fdc) — max.gekk / githubweb
  5. [SPARK-35737][SQL] Parse day-time interval literals to tightest types (commit: 439e94c) — max.gekk / githubweb
  6. [SPARK-35748][SS][SQL] Fix StreamingJoinHelper to be able to handle (commit: 82af318) — max.gekk / githubweb
  7. [SPARK-35736][SPARK-35737][SQL][FOLLOWUP] Move a common logic to (commit: aab0c2b) — max.gekk / githubweb
  8. [SPARK-35616][PYTHON] Make `astype` method data-type-based (commit: 0375661) — ueshin / githubweb
  9. [SPARK-35759][PYTHON] Remove the upperbound for numpy for (commit: ef7545b) — gurwls223 / githubweb
  10. [SPARK-35755][PYTHON][INFRA] Use higher PyArrow versions in GitHub (commit: 2d47fb7) — gurwls223 / githubweb
  11. [SPARK-35750][PYTHON][DOCS] Rename "pandas APIs on Spark" to "pandas API (commit: 95f36e7) — gurwls223 / githubweb
  12. [SPARK-35761][PYTHON] Use type-annotation based pandas_udf or avoid (commit: 2a56cc3) — gurwls223 / githubweb
  13. [SPARK-35678][ML] add a common softmax function (commit: 8c4b535) — ruifengz / githubweb
  14. [SPARK-35683][PYTHON] Fix Index.difference to avoid collect 'other' to (commit: b9aeeb4) — gurwls223 / githubweb
  15. [SPARK-35742][SQL] Expression.semanticEquals should be symmetrical (commit: a50bd8f) — wenchen / githubweb
  16. [SPARK-35764][SQL] Assign pretty names to TimestampWithoutTZType (commit: 195090a) — max.gekk / githubweb
  17. [SPARK-35056][SQL] Group exception messages in execution/streaming (commit: b191d72) — max.gekk / githubweb
  18. [SPARK-35758][DOCS] Update the document about building Spark with Hadoop (commit: d54edf0) — gurwls223 / githubweb
  19. [SPARK-35765][SQL] Distinct aggs are not duplicate sensitive (commit: b74260f) — gurwls223 / githubweb
  20. [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into (commit: c382d40) — gengliang / githubweb
  21. [SPARK-35129][SQL] Construct year-month interval column from integral (commit: 8a02f3a) — max.gekk / githubweb
  22. [SPARK-35767][SQL] Avoid executing child plan twice in CoalesceExec (commit: 1012967) — dongjoon / githubweb
  23. [SPARK-35680][SQL] Add fields to `YearMonthIntervalType` (commit: 61ce8f7) — max.gekk / githubweb
  24. [SPARK-35429][CORE] Remove commons-httpclient from Hadoop-3.2 profile (commit: 864ff67) — dongjoon / githubweb

#797 (Jun 12, 2021, 10:01:52 PM)

  1. [SPARK-35296][SQL] Allow Dataset.observe to work even if (commit: 44b695f) — wenchen / githubweb
  2. [SPARK-32920][SHUFFLE] Finalization of Shuffle push/merge with Push (commit: b5a1503) — mridulatgmail.com / githubweb
  3. [SPARK-35716][SQL] Support casting of timestamp without time zone to (commit: d21ff13) — max.gekk / githubweb
  4. [SPARK-32975][K8S][FOLLOWUP] Avoid None.get exception (commit: b4b78ce) — dhyun / githubweb
  5. [SPARK-35692][K8S] Use AtomicInteger for executor id generating (commit: bc1edba) — dhyun / githubweb
  6. [SPARK-33350][SHUFFLE] Add support to DiskBlockManager to create merge (commit: a97885b) — mridulatgmail.com / githubweb
  7. [SPARK-35593][K8S][CORE] Support shuffle data recovery on the reused (commit: cf07036) — dhyun / githubweb
  8. [SPARK-35709][DOCS] Remove the reference to third party Nomad (commit: 912d60b) — yamamuro / githubweb
  9. [SPARK-34512][BUILD][SQL] Upgrade built-in Hive to 2.3.9 (commit: 463daab) — dhyun / githubweb
  10. [SPARK-35640][SQL] Refactor Parquet vectorized reader to remove (commit: e9ccf4a) — d_tsai / githubweb
  11. [SPARK-35718][SQL] Support casting of Date to timestamp without time (commit: e9af457) — wenchen / githubweb
  12. [SPARK-35439][SQL][FOLLOWUP] ExpressionContainmentOrdering should not (commit: c463472) — yamamuro / githubweb
  13. [SPARK-35694][INFRA][FOLLOWUP] Increase the default JVM stack size of (commit: 62be22e) — gurwls223 / githubweb
  14. [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in (commit: ebe529e) — gurwls223 / githubweb
  15. [SPARK-35652][SQL] joinWith on two table generated from same one (commit: 6e1aa15) — wenchen / githubweb
  16. [SPARK-35706][SQL] Consider making the ':' in STRUCT data type (commit: 57ce64c) — wenchen / githubweb
  17. [SPARK-35695][SQL] Collect observed metrics from cached and adaptive (commit: 692dc66) — wenchen / githubweb
  18. [SPARK-35704][SQL] Add fields to `DayTimeIntervalType` (commit: d53831f) — max.gekk / githubweb
  19. [SPARK-35396][SQL][TESTS][FOLLOWUP] Add a UT to check if a user-defined (commit: e958833) — dhyun / githubweb
  20. [SPARK-35475][PYTHON] Fix disallow_untyped_defs mypy checks (commit: 4d21b94) — ueshin / githubweb
  21. [SPARK-35689][SS] Add log warn when keyWithIndexToValue returns null (commit: 703376e) — kabhwan.opensource / githubweb
  22. [SPARK-35321][SQL] Don't register Hive permanent functions when creating (commit: 9c7250f) — yumwang / githubweb
  23. [SPARK-35738][PYTHON] Support 'y' properly in DataFrame with non-numeric (commit: 76e08a8) — gurwls223 / githubweb
  24. [SPARK-35746][UI] Fix taskid in the stage page task event timeline (commit: 450b415) — sarutak / githubweb
  25. [SPARK-35734][SQL] Format day-time intervals using type fields (commit: 80f7989) — max.gekk / githubweb
  26. [SPARK-35701][SQL] Use copy-on-write semantics for SQLConf registered (commit: 0ba1d38) — viirya / githubweb

#796 (Jun 10, 2021, 9:49:22 AM)

  1. [SPARK-34290][SQL][FOLLOWUP] Cleanup truncate table not supported for (commit: eee0273) — yao / githubweb
  2. [SPARK-35636][PYTHON][DOCS][FOLLOW-UP] Restructure reference API files (commit: 921abc5) — gurwls223 / githubweb
  3. [SPARK-35312][SS] Introduce new Option in Kafka source to specify (commit: 2a33117) — kabhwan.opensource / githubweb
  4. [SPARK-35659][SS] Avoid write null to StateStore (commit: 1226b9b) — viirya / githubweb
  5. [SPARK-35384][SQL][FOLLOWUP] Fix Scala doc for removed method parameters (commit: 66e38f4) — dhyun / githubweb
  6. [SPARK-35602][SS] Update state schema to be able to accept long length (commit: 93a9dc4) — kabhwan.opensource / githubweb
  7. [SPARK-35512][PYTHON] Fix OverflowError(cannot convert float infinity to (commit: e79dd89) — gurwls223 / githubweb
  8. [SPARK-30993][FOLLOWUP][SQL] Refactor LocalDateTimeUDT as YearUDT in (commit: 1b1a8e4) — gengliang / githubweb
  9. [SPARK-35682][PYTHON][TESTS] Pin mypy==0.812 in GitHub Actions CI (commit: d12c147) — gurwls223 / githubweb
  10. [SPARK-35647][PYTHON][DOCS] Restructure User Guide in PySpark (commit: afff421) — gurwls223 / githubweb
  11. [SPARK-35378][SQL] Eagerly execute commands in QueryExecution instead of (commit: 8013f98) — wenchen / githubweb
  12. [SPARK-35436][SS] RocksDBFileManager - save checkpoint to DFS (commit: 9f010a8) — kabhwan.opensource / githubweb
  13. [SPARK-35687][SQL][TEST] PythonUDFSuite move assume into its methods (commit: 825b620) — gurwls223 / githubweb
  14. [SPARK-35664][SQL] Support java.time.LocalDateTime as an external type (commit: 84c5ca3) — gengliang / githubweb
  15. Revert "[SPARK-35668][INFRA] Use "concurrency" syntax on Github Actions (commit: 3be7b29) — gurwls223 / githubweb
  16. [SPARK-35058][SQL] Group exception messages in hive/client (commit: ebb4858) — wenchen / githubweb
  17. [SPARK-35674][SQL][TESTS] Test timestamp without time zone in UDF (commit: 43f6b4a) — gengliang / githubweb
  18. [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven (commit: 0b5683a) — gengliang / githubweb
  19. [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce (commit: ce16369) — wenchen / githubweb
  20. [SPARK-35390][SQL] Handle type coercion when resolving V2 functions (commit: 7d8181b) — wenchen / githubweb
  21. [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test (commit: f4c8968) — wenchen / githubweb
  22. [SPARK-35661][SQL] Allow deserialized off-heap memory entry (commit: 224ebae) — wenchen / githubweb
  23. [SPARK-35697][SQL][TESTS] Test TimestampWithoutTZType as ordered and (commit: 313dc2d) — wenchen / githubweb
  24. [SPARK-35423][ML] PCA results should be consistent, If the Matrix (commit: 519be23) — srowen / githubweb
  25. [SPARK-34382][SQL] Support LATERAL subqueries (commit: f49bf1a) — wenchen / githubweb
  26. [SPARK-35698][SQL] Support casting of timestamp without time zone to (commit: 74b3df8) — gengliang / githubweb
  27. [SPARK-35601][PYTHON] Complete arithmetic operators involving bool (commit: 3c66c11) — ueshin / githubweb
  28. [SPARK-35705][PYTHON] Adjust pandas-on-spark (commit: e9d6015) — gurwls223 / githubweb
  29. [MINOR][SQL] Modify the example of rand and randn (commit: 94b66f5) — gurwls223 / githubweb
  30. [SPARK-35194][SQL][FOLLOWUP] Change Seq to collections.Seq in (commit: 7e99b65) — wenchen / githubweb
  31. [MINOR][SQL] No need to normolize name for built-in functions (commit: 87d2ffb) — wenchen / githubweb
  32. [SPARK-35675][SQL] EnsureRequirements remove shuffle should respect (commit: 8dde20a) — yao / githubweb
  33. [SPARK-35679][SQL] instantToMicros overflow (commit: aa3de40) — max.gekk / githubweb
  34. [SPARK-35474] Enable disallow_untyped_defs mypy check for (commit: cadd3a0) — ueshin / githubweb
  35. [SPARK-35673][SQL] Fix user-defined hint and unrecognized hint in (commit: 5280f02) — wenchen / githubweb
  36. [SPARK-34524][SQL][FOLLOWUP] Remove unused checkAlterTablePartition in (commit: 88f1d82) — wenchen / githubweb
  37. [SPARK-35711][SQL] Support casting of timestamp without time zone to (commit: 4180692) — gengliang / githubweb
  38. [SPARK-35653][SQL] Fix CatalystToExternalMap interpreted path fails for (commit: e2e3fe7) — viirya / githubweb

#795 (Jun 7, 2021, 10:20:34 PM)

  1. [SPARK-35558] Optimizes for multi-quantile retrieval (commit: 6f8c620) — srowen / githubweb
  2. [SPARK-35656][BUILD] Upgrade SBT to 1.5.3 (commit: 5e30666) — dhyun / githubweb
  3. [SPARK-35654][CORE] Allow ShuffleDataIO control (commit: d4e32c8) — dhyun / githubweb
  4. [SPARK-35499][PYTHON] Apply black to pandas API on Spark codes (commit: b8740a1) — viirya / githubweb
  5. [SPARK-35599][PYTHON] Adjust `check_exact` parameter for older (commit: 50f7686) — gurwls223 / githubweb
  6. [SPARK-35100][ML][FOLLOWUP] AFT cleanup (commit: d8e37a8) — ruifengz / githubweb
  7. [SPARK-35619][ML] Refactor LinearRegression - make huber support virtual (commit: ffc61c6) — ruifengz / githubweb
  8. [SPARK-35660][BUILD][K8S] Upgrade kubernetes-client to 5.4.1 (commit: 6f2ffcc) — dhyun / githubweb
  9. [SPARK-35646][PYTHON][DOCS] Relocate pandas-on-Spark API references in (commit: 7ce7aa4) — gurwls223 / githubweb
  10. [SPARK-35665][SQL] Resolve UnresolvedAlias in CollectMetrics (commit: a70e66e) — gurwls223 / githubweb
  11. [SPARK-35543][CORE] Fix memory leak in BlockManagerMasterEndpoint (commit: 4534c0c) — piros.attila.zsolt / githubweb
  12. [SPARK-35663][SQL] Add Timestamp without time zone type (commit: 33f2627) — wenchen / githubweb
  13. [SPARK-35074][CORE] hardcoded configs move to config package (commit: 6c3b7f9) — tgraves / githubweb
  14. [SPARK-35343][PYTHON] Make the conversion from/to pandas data-type-based (commit: 04a8d2c) — ueshin / githubweb
  15. [SPARK-35341][PYTHON] Introduce BooleanExtensionOps (commit: dfd8a8d) — ueshin / githubweb
  16. [SPARK-35638][PYTHON] Introduce InternalField to manage dtypes and (commit: 04418e1) — gurwls223 / githubweb
  17. [SPARK-35603][R][DOCS] Add data source options link for R API (commit: 745756c) — gurwls223 / githubweb
  18. [SPARK-35668][INFRA] Use "concurrency" syntax on Github Actions workflow (commit: f3dc549) — gurwls223 / githubweb

#794 (Jun 5, 2021, 3:23:54 AM)

  1. [SPARK-35617][INFRA] Update GitHub Action docker image to 20210602 (commit: 2550490) — dhyun / githubweb
  2. [SPARK-35011][CORE] Avoid Block Manager registrations when StopExecutor (commit: b9e53f8) — yi.wu / githubweb
  3. [SPARK-35620][BUILD][PYTHON] Remove documentation build in Python linter (commit: d478cff) — gurwls223 / githubweb
  4. [SPARK-35528][DOCS] Add more options at Data Source Options pages (commit: e0bccc1) — gurwls223 / githubweb
  5. [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings (commit: 4a549f2) — gurwls223 / githubweb
  6. [SPARK-35081][DOCS] Add Data Source Option links to missing documents (commit: 2658bc5) — gurwls223 / githubweb
  7. [SPARK-35609][BUILD] Add style rules to prohibit to use a Guava's API (commit: c532f82) — sarutak / githubweb
  8. [SPARK-35316][SQL] UnwrapCastInBinaryComparison support In/InSet (commit: cfde117) — wenchen / githubweb
  9. [SPARK-35416][K8S][FOLLOWUP] Use Set instead of ArrayBuffer (commit: 4f0db87) — mridulatgmail.com / githubweb
  10. [SPARK-35580][SQL] Implement canonicalized method for (commit: 0342dcb) — viirya / githubweb
  11. [SPARK-35612][SQL] Support LZ4 compression in ORC data source (commit: 878527d) — dhyun / githubweb
  12. [SPARK-35606][PYTHON][INFRA] List Python 3.9 installed libraries in (commit: 7eeb07d) — dhyun / githubweb
  13. [SPARK-35589][CORE][TESTS][FOLLOWUP] Remove the duplicated test coverage (commit: 745bd09) — gurwls223 / githubweb
  14. [SPARK-35587][PYTHON][DOCS] Initial porting of Koalas documentation (commit: 3d158f9) — gurwls223 / githubweb
  15. [SPARK-35642][INFRA] Split pyspark-pandas tests to rebalance the test (commit: 221553c) — gurwls223 / githubweb
  16. [SPARK-35396][CORE][FOLLOWUP] Free memory entry immediately (commit: 63ab38f) — dhyun / githubweb
  17. [SPARK-35523] Fix the default value in Data Source Options page (commit: 7c32415) — gurwls223 / githubweb
  18. [SPARK-35648][PYTHON] Refine and add dependencies needed for dev in (commit: 807b400) — gurwls223 / githubweb
  19. [SPARK-35636][SQL] Lambda keys should not be referenced outside of the (commit: 53a758b) — gurwls223 / githubweb
  20. [SPARK-35629][SQL] Use better exception type if database doesn't exist (commit: c7fb0e1) — gengliang / githubweb
  21. [SPARK-35568][SQL] Add the BroadcastExchange after re-optimizing the (commit: 6ce5f24) — wenchen / githubweb
  22. [SPARK-21957][SQL][FOLLOWUP] Support CURRENT_USER without tailing (commit: dc3317f) — wenchen / githubweb
  23. [SPARK-32975][K8S] Add config for driver readiness timeout before (commit: 497c80a) — dhyun / githubweb
  24. [SPARK-35643][PYTHON] Fix ambiguous reference in functions.py column() (commit: f2c0a04) — gurwls223 / githubweb
  25. [SPARK-35446] Override getJDBCType in MySQLDialect to map FloatType to (commit: b5678be) — gurwls223 / githubweb
  26. [SPARK-35621][SQL] Add rule id pruning to the TypeCoercion rule (commit: 7bc364b) — gengliang / githubweb
  27. [SPARK-35655][BUILD] Upgrade HtmlUnit and its related artifacts to 2.50 (commit: 510bde4) — gengliang / githubweb

#793 (Jun 2, 2021, 6:11:29 PM)

  1. [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all (commit: cd2ef9c) — wenchen / githubweb
  2. [SPARK-35576][SQL] Redact the sensitive info in the result of Set (commit: 8e11f5f) — dhyun / githubweb
  3. [SPARK-35453][PYTHON] Move Koalas accessor to pandas_on_spark accessor (commit: 7e27173) — gurwls223 / githubweb
  4. [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+ (commit: 1ba1b70) — gurwls223 / githubweb
  5. [SPARK-35578][SQL][TEST] Add a test case for a bug in janino (commit: bb2a074) — gurwls223 / githubweb
  6. [SPARK-35433][DOCS] Move CSV data source options from Python and Scala (commit: 73d4f67) — gurwls223 / githubweb
  7. [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules (commit: 1dd0ca2) — gengliang / githubweb
  8. [SPARK-35582][PYTHON][DOCS] Remove # noqa in Python API documents (commit: fe09def) — gurwls223 / githubweb
  9. [SPARK-35586][K8S][TESTS] Set a default value for (commit: e048838) — dhyun / githubweb
  10. [SPARK-35584][CORE][TESTS] Increase the timeout in FallbackStorageSuite (commit: d773373) — dhyun / githubweb
  11. [SPARK-35516][WEBUI] Storage UI tab Storage Level tool tip correction (commit: b7dd4b3) — sarutak / githubweb
  12. [SPARK-35581][SQL] Support special datetime values in typed literals (commit: a59063d) — max.gekk / githubweb
  13. [SPARK-35577][TESTS] Allow to log container output for docker (commit: 08e6f63) — yamamuro / githubweb
  14. [SPARK-35402][WEBUI] Increase the max thread pool size of jetty server (commit: a127d91) — yao / githubweb
  15. [SPARK-35314][PYTHON] Support arithmetic operations against bool (commit: 0ac5c16) — ueshin / githubweb
  16. [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore (commit: 35cfabc) — dhyun / githubweb
  17. [SPARK-35600][TESTS] Move Set command related test cases to (commit: 6a277bb) — gurwls223 / githubweb
  18. [SPARK-35539][PYTHON] Restore to_koalas to keep the backward (commit: 0ad5ae5) — gurwls223 / githubweb
  19. [SPARK-35595][TESTS] Support multiple loggers in testing method (commit: 9d0d4ed) — gengliang / githubweb
  20. [SPARK-35560][SQL] Remove redundant subexpression evaluation in nested (commit: dbf0b50) — viirya / githubweb
  21. [SPARK-35100][ML] Refactor AFT - support virtual centering (commit: c2de0a6) — ruifengz / githubweb
  22. [SPARK-35077][SQL] Migrate to transformWithPruning for leftover (commit: 3f6322f) — gengliang / githubweb
  23. [SPARK-35583][DOCS] Move JDBC data source options from Python and Scala (commit: 48252ba) — gurwls223 / githubweb
  24. [SPARK-35604][SQL] Fix condition check for FULL OUTER sort merge join (commit: 54e9999) — ltnwgl / githubweb
  25. [SPARK-35585][SQL] Support propagate empty relation through (commit: daf9d19) — wenchen / githubweb
  26. [SPARK-21957][SQL] Support current_user function (commit: 345d35e) — wenchen / githubweb
  27. [SPARK-35059][SQL] Group exception messages in hive/execution (commit: 9f7cdb8) — wenchen / githubweb
  28. [SPARK-34808][SQL][FOLLOWUP] Remove canPlanAsBroadcastHashJoin check in (commit: 8041aed) — wenchen / githubweb
  29. [SPARK-35610][CORE] Fix the memory leak introduced by the Executor's (commit: 806edf8) — dhyun / githubweb

#792 (May 31, 2021, 8:04:08 AM)

  1. [SPARK-35194][SQL][FOLLOWUP] Recover build error with Scala 2.13 on GA (commit: b763db3) — sarutak / githubweb
  2. [SPARK-35559][TEST] Speed up one test in AdaptiveQueryExecSuite (commit: 678592a) — dhyun / githubweb
  3. [SPARK-35538][SQL] Migrate transformAllExpressions call sites to use (commit: 5c8a141) — xingbo.jiang / githubweb
  4. [SPARK-31168][BUILD] Upgrade Scala to 2.12.14 (commit: 6c4b60f) — dhyun / githubweb
  5. [SPARK-35532][TESTS] Ensure mllib and kafka-0-10 module can be maven (commit: 16d9de8) — dhyun / githubweb
  6. [SPARK-35526][CORE][SQL][ML][MLLIB] Re-Cleanup `procedure syntax is (commit: 09d039d) — dhyun / githubweb
  7. [SPARK-35550][BUILD] Upgrade Jackson to 2.12.3 (commit: ff27264) — gurwls223 / githubweb
  8. [SPARK-31168][BUILD][FOLLOWUP] Update scala-2.12 profile (commit: 1a55019) — dhyun / githubweb
  9. [SPARK-35545][SQL] Split SubqueryExpression's children field into outer (commit: 806da9d) — wenchen / githubweb
  10. [SPARK-35507][INFRA] Add Python 3.9 in the docker image for GitHub (commit: c225196) — dhyun / githubweb
  11. [SPARK-35566][SS] Fix StateStoreRestoreExec output rows (commit: 73ba449) — gurwls223 / githubweb
  12. [SPARK-35562][DOC] Fix docs about Kubernetes and Yarn (commit: 8c69e9c) — dhyun / githubweb
  13. [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on (commit: 6cd6c43) — yumwang / githubweb
  14. [SPARK-35575][INFRA] Recover updating build status in GitHub Actions (commit: 14e12c6) — gurwls223 / githubweb
  15. [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing (commit: 1603775) — wenchen / githubweb

#791 (May 28, 2021, 7:39:24 AM)

  1. [SPARK-35490][BUILD] Update json4s to 3.7.0-M11 (commit: e3c6907) — max.gekk / githubweb
  2. [SPARK-35509][DOCS] Move text data source options from Python and Scala (commit: 79a6b0c) — gurwls223 / githubweb
  3. [SPARK-35527][SQL][TESTS] Fix HiveExternalCatalogVersionsSuite to pass (commit: 50fefc6) — gurwls223 / githubweb
  4. [SPARK-35501][SQL][TESTS] Add a feature for removing pulled container (commit: 116a97e) — gurwls223 / githubweb
  5. [SPARK-35529][SQL] Add fallback metrics for hash aggregate (commit: dd67777) — wenchen / githubweb
  6. [SPARK-35282][SQL] Support AQE side shuffled hash join formula using (commit: dc7b5a9) — wenchen / githubweb
  7. [SPARK-35452][PYTHON] Introduce ArrayOps, MapOps and StructOps (commit: 266608d) — ueshin / githubweb
  8. [SPARK-35522][PYTHON] Introduce BinaryOps for BinaryType (commit: 8cc7232) — ueshin / githubweb
  9. [SPARK-35537][PYTHON] Introduce a util function spark_column_equals (commit: d6d3209) — gurwls223 / githubweb
  10. [SPARK-35098][PYTHON] Re-enable pandas-on-Spark test cases (commit: 79a2a46) — gurwls223 / githubweb
  11. [SPARK-35351][SQL][FOLLOWUP] Avoid using `loaded` variable for LEFT ANTI (commit: 5cc17ba) — wenchen / githubweb
  12. [SPARK-35057][SQL] Group exception messages in hive/thriftserver (commit: 3e19080) — wenchen / githubweb
  13. [SPARK-35535][SQL] New data source V2 API: LocalScan (commit: 5bcd1c2) — gurwls223 / githubweb
  14. [SPARK-33428][SQL] Match the behavior of conv function to MySQL's (commit: 52a1f8c) — wenchen / githubweb
  15. [SPARK-35172][SS] The implementation of RocksDBCheckpointMetadata (commit: f98a063) — kabhwan.opensource / githubweb
  16. [SPARK-35541][SQL] Simplify OptimizeSkewedJoin (commit: 29ed1a2) — viirya / githubweb
  17. [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA (commit: 0a74ad6) — gurwls223 / githubweb
  18. [SPARK-35530][ML][TESTS] Fix rounding error in (commit: 3267b17) — gurwls223 / githubweb
  19. Revert "[SPARK-35483][INFRA] Add docker-integration-tests to (commit: d189cf7) — gurwls223 / githubweb
  20. [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA (commit: 2de19e4) — gurwls223 / githubweb
  21. [SPARK-35510][PYTHON] Fix and reenable (commit: 7eb7448) — gurwls223 / githubweb
  22. [SPARK-35552][SQL] Make query stage materialized more readable (commit: 3b94aad) — gengliang / githubweb
  23. [SPARK-35194][SQL] Refactor nested column aliasing for readability (commit: e863166) — wenchen / githubweb

#790 (May 25, 2021, 11:28:58 PM)

  1. [SPARK-35467][SPARK-35468][SPARK-35477][PYTHON] Fix (commit: 1b75c24) — gurwls223 / githubweb
  2. [SPARK-35495][R] Change SparkR maintainer for CRAN (commit: 1530876) — dhyun / githubweb
  3. [SPARK-35449][SQL] Only extract common expressions from CaseWhen values (commit: 6c0c617) — viirya / githubweb
  4. [SPARK-34981][SQL][FOLLOWUP] Use SpecificInternalRow in (commit: c709efc) — gurwls223 / githubweb
  5. [SPARK-35287][SQL] Allow RemoveRedundantProjects to preserve ProjectExec (commit: d4fb983) — wenchen / githubweb
  6. [SPARK-35498][PYTHON] Add thread target wrapper API for pyspark pin (commit: fdd7ca5) — gurwls223 / githubweb
  7. [SPARK-33122][SQL][FOLLOWUP] Extend RemoveRedundantAggregates optimizer (commit: 548e37b) — yamamuro / githubweb
  8. [SPARK-35497][PYTHON] Enable plotly tests in pandas-on-Spark (commit: 4a6d844) — gurwls223 / githubweb
  9. [SPARK-35455][SQL] Unify empty relation optimization between normal and (commit: 631077d) — wenchen / githubweb
  10. [SPARK-35486][CORE] TaskMemoryManager: retry if other task takes memory (commit: 58d4da1) — yi.wu / githubweb
  11. [SPARK-29223][SQL][SS] New option to specify timestamp on all (commit: a57afd4) — kabhwan.opensource / githubweb
  12. [SPARK-35447][SQL] Optimize skew join before coalescing shuffle (commit: 859a534) — wenchen / githubweb
  13. [SPARK-35396] Add AutoCloseable close to BlockManager and (commit: 7258f69) — srowen / githubweb
  14. [SPARK-35514][INFRA] Automatically update version index of DocSearch via (commit: 321c654) — ltnwgl / githubweb
  15. [SPARK-35505][PYTHON] Remove APIs which have been deprecated in Koalas (commit: d67d73b) — ueshin / githubweb
  16. [SPARK-35513][BUILD] Update joda-time to 2.10.10 (commit: 4ba1db9) — dhyun / githubweb
  17. [SPARK-35506][PYTHON][INFRA] Run tests with Python 3.9 in GitHub Actions (commit: e47e615) — gurwls223 / githubweb
  18. [SPARK-32194][PYTHON] Use proper exception classes instead of plain (commit: 20750a3) — gurwls223 / githubweb
  19. [SPARK-35440][SQL] Add function type to `ExpressionInfo` for UDF (commit: af1dba7) — wenchen / githubweb

#789 (May 23, 2021, 1:19:21 PM)

  1. [SPARK-35456][CORE] Print the invalid value in config validation error (commit: 2e9936d) — gurwls223 / githubweb
  2. [SPARK-35445][SQL] Reduce the execution time of DeduplicateRelations (commit: e1296ea) — ltnwgl / githubweb
  3. [SPARK-35479][SQL] Format PartitionFilters IN strings in scan nodes (commit: 1a923f5) — wenchen / githubweb
  4. [SPARK-35063][SQL] Group exception messages in sql/catalyst (commit: c740c09) — wenchen / githubweb
  5. [SPARK-35427][SQL][TESTS] Check the `EXCEPTION` rebase mode for (commit: 2b08070) — wenchen / githubweb
  6. [SPARK-35063][SQL][FOLLOWUP] Fix scala 2.13 error (commit: 8373785) — wenchen / githubweb
  7. [SPARK-35454][SQL] One LogicalPlan can match multiple dataset ids (commit: 34284c0) — wenchen / githubweb
  8. [SPARK-35395][DOCS] Move ORC data source options from Python and Scala (commit: 0fe65b5) — gurwls223 / githubweb
  9. [SPARK-34494][SQL][DOCS] Move JSON data source options from Python and (commit: 419ddcb) — gurwls223 / githubweb
  10. [SPARK-35025][SQL][PYTHON][DOCS] Move Parquet data source options from (commit: d2bdd65) — gurwls223 / githubweb
  11. [SPARK-35482][K8S] Use `spark.blockManager.port` not the wrong (commit: d957426) — dhyun / githubweb
  12. [SPARK-34558][SQL][FOLLOWUP] Do not fail Spark startup with a broken (commit: 7274e3a) — dhyun / githubweb
  13. [SPARK-34558][SQL][TESTS][FOLLOWUP] Fix a test to use a unknown (commit: cc05daa) — dhyun / githubweb
  14. [SPARK-35439][SQL] Children subexpr should come first than parent (commit: 066944c) — viirya / githubweb
  15. [SPARK-35465][PYTHON] Set up the mypy configuration to enable (commit: 2616d5c) — ueshin / githubweb
  16. [SPARK-28551][SQL][FOLLOWUP] Use the corrected hadoop conf (commit: b624b7e) — yao / githubweb
  17. [SPARK-35487][BUILD] Upgrade dropwizard metrics to 4.2.0 (commit: 6bd6e46) — dhyun / githubweb
  18. [MINOR][SQL] Change the script name for creating oracle docker image (commit: 0549caf) — dhyun / githubweb
  19. [SPARK-35488][BUILD] Upgrade ASM to 7.3.1 (commit: 003294c) — sarutak / githubweb
  20. [SPARK-35489][BUILD] Upgrade ORC to 1.6.8 (commit: fa424ac) — dhyun / githubweb
  21. [SPARK-35480][SQL] Make percentile_approx work with pivot (commit: 1d9f09d) — gurwls223 / githubweb
  22. [SPARK-35463][BUILD][FOLLOWUP] Redirect output for skipping checksum (commit: 594ffd2) — dhyun / githubweb
  23. [MINOR][FOLLOWUP] Update SHA for the oracle docker image (commit: a59a214) — dhyun / githubweb
  24. [SPARK-35226][SQL][FOLLOWUP] Fix test added in SPARK-35226 for (commit: 1a43415) — dhyun / githubweb
  25. [SPARK-35493][K8S] make `spark.blockManager.port` fallback for (commit: 96b0548) — dhyun / githubweb
  26. [SPARK-35492][BUILD] Upgrade httpcore to 4.4.14 (commit: d5868eb) — dhyun / githubweb
  27. [SPARK-35410][SQL] SubExpr elimination should not include redundant (commit: 9e1b204) — dhyun / githubweb

#786 (May 20, 2021, 5:13:36 PM)

  1. [SPARK-35434][BUILD] Upgrade scalatestplus artifacts to 3.2.9.0 (commit: 8c70c17) — dhyun / githubweb
  2. [SPARK-35263][TEST] Refactor ShuffleBlockFetcherIteratorSuite to reduce (commit: 186477c) — mridulatgmail.com / githubweb
  3. [SPARK-35398][SQL] Simplify the way to get classes from (commit: b1493d8) — yamamuro / githubweb
  4. [SPARK-35421][SS] Remove redundant ProjectExec from streaming queries (commit: 0b3758e) — wenchen / githubweb
  5. [SPARK-35106][CORE][SQL] Avoid failing rename caused by destination (commit: a72d05c) — wenchen / githubweb
  6. [SPARK-35368][SQL] Update histogram statistics for RANGE operator for (commit: 46f7d78) — yamamuro / githubweb
  7. [SPARK-35418][SQL] Add sentences function to functions.{scala,py} (commit: 9283beb) — sarutak / githubweb
  8. [SPARK-35362][SQL] Update null count in the column stats for UNION (commit: 1214213) — yamamuro / githubweb
  9. [SPARK-35093][SQL] AQE now uses newQueryStage plan as key for looking up (commit: 52e3cf9) — tgraves / githubweb
  10. [SPARK-35338][PYTHON] Separate arithmetic operations into data type (commit: d1b24d8) — ueshin / githubweb
  11. [SPARK-35438][SQL][DOCS] Minor documentation fix for window physical (commit: 586caae) — yamamuro / githubweb
  12. Revert "[SPARK-35338][PYTHON] Separate arithmetic operations into data (commit: d44e6c7) — ueshin / githubweb
  13. [SPARK-35450][INFRA] Follow checkout-merge way to use the latest commit (commit: c064805) — gurwls223 / githubweb
  14. [SPARK-35408][PYTHON][FOLLOW-UP] Avoid unnecessary f-string format (commit: 7eaabf4) — gurwls223 / githubweb
  15. [SPARK-35338][PYTHON] Separate arithmetic operations into data type (commit: a970f85) — ueshin / githubweb
  16. [SPARK-35443][K8S] Mark K8s ConfigMaps and Secrets created by Spark as (commit: de59e01) — dhyun / githubweb
  17. [SPARK-27991][CORE] Defer the fetch request on Netty OOM (commit: 00b63c8) — wenchen / githubweb
  18. [SPARK-28551][SQL] CTAS with LOCATION should not allow to a non-empty (commit: bdd8e1d) — wenchen / githubweb
  19. [SPARK-35457][BUILD] Bump ANTLR runtime version to 4.8 (commit: e170e63) — yamamuro / githubweb
  20. [SPARK-35424][SHUFFLE] Remove some useless code in the (commit: 4869e43) — gurwls223 / githubweb
  21. [SPARK-35459][SQL][TESTS] Move `AvroRowReaderSuite` to a separate file (commit: 2bd3254) — gurwls223 / githubweb
  22. [SPARK-35373][BUILD][FOLLOWUP] Fix "binary operator expected" error on (commit: 3c3533d) — srowen / githubweb
  23. [SPARK-35458][BUILD] Use ` > /dev/null` to replace `-q` in shasum (commit: 38fbc0b) — srowen / githubweb
  24. [SPARK-35462][BUILD][K8S] Upgrade Kubernetes-client to 5.4.0 to support (commit: 3757c18) — dhyun / githubweb
  25. [SPARK-35463][BUILD] Skip checking checksum on a system without `shasum` (commit: 8e13b8c) — dhyun / githubweb
  26. [SPARK-35364][PYTHON] Renaming the existing Koalas related codes (commit: 6b912e4) — ueshin / githubweb

#785 (May 18, 2021, 8:57:43 AM)

  1. [SPARK-34981][SQL][TESTS][FOLLOWUP] Fix test failure under Scala 2.13 (commit: a60c364) — dhyun / githubweb
  2. [SPARK-35419][PYTHON] Enable (commit: 747fe72) — gurwls223 / githubweb
  3. [SPARK-35431][SQL][TESTS] Sort elements generated by collect_set in (commit: 3b859a1) — dhyun / githubweb
  4. [SPARK-35425][BUILD] Pin jinja2 in `spark-rm/Dockerfile` and add as a (commit: 7b942d5) — sarutak / githubweb
  5. [SPARK-35351][SQL] Add code-gen for left anti sort merge join (commit: cce0048) — yamamuro / githubweb
  6. [SPARK-35389][SQL] V2 ScalarFunction should support magic method with (commit: 44d762a) — wenchen / githubweb
  7. [SPARK-35422][SQL] Fix plan-printing issues to pass the TPCDS plan (commit: 746d80d) — wenchen / githubweb
  8. [SPARK-35411][SQL] Add essential information while serializing TreeNode (commit: 9804f07) — wenchen / githubweb

#784 (May 17, 2021, 1:58:15 PM)

  1. [SPARK-35286][SQL] Replace SessionState.start with (commit: 520a355) — yumwang / githubweb
  2. [SPARK-34661][SQL] Clean up `OriginalType` and `DecimalMetadata ` usage (commit: 7ca0a09) — srowen / githubweb
  3. [SPARK-35363][SQL][FOLLOWUP] Use fresh name for findNextJoinRows instead (commit: 5c1567b) — dhyun / githubweb
  4. [SPARK-35412][SQL] Fix a bug in groupBy of year-month/day-time intervals (commit: 2eef2f9) — dhyun / githubweb
  5. [SPARK-35413][INFRA] Use the SHA of the latest commit when checking out (commit: 2390b9d) — yamamuro / githubweb
  6. [SPARK-35417][BUILD] Upgrade SBT to 1.5.2 (commit: bf5d332) — gurwls223 / githubweb
  7. [SPARK-32792][SQL] Improve Parquet In filter pushdown (commit: d2d1f0b) — dhyun / githubweb
  8. [SPARK-32792][SQL][FOLLOWUP] Fix conflict with SPARK-34661 (commit: fb93163) — dhyun / githubweb
  9. [SPARK-35416][K8S] Support PersistentVolumeClaim Reuse (commit: 4c01555) — dhyun / githubweb
  10. [SPARK-35408][PYTHON] Improve parameter validation in DataFrame.show (commit: 9eb45ec) — gurwls223 / githubweb
  11. [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session (commit: 7c13636) — kabhwan.opensource / githubweb
  12. [SPARK-35420][BUILD] Replace the usage of toStringHelper with (commit: b4348b7) — sarutak / githubweb
  13. [SPARK-35399][DOCUMENTATION] State is still needed in the event of (commit: ceb8122) — srowen / githubweb
  14. [SPARK-35400][SQL] Simplify getOuterReferences and improve error message (commit: 3b63f32) — wenchen / githubweb
  15. [SPARK-35359][SQL] Insert data with char/varchar datatype will fail when (commit: 3a3f8ca) — wenchen / githubweb
  16. [SPARK-34941][PYTHON] Fix mypy errors and enable mypy check for (commit: 2a335f2) — ueshin / githubweb

#783 (May 15, 2021, 5:38:09 PM)

  1. [SPARK-35350][SQL] Add code-gen for left semi sort merge join (commit: c1e995a) — wenchen / githubweb
  2. [SPARK-34720][SQL] MERGE ... UPDATE/INSERT * should do by-name (commit: d1b8bd7) — wenchen / githubweb
  3. [SPARK-34637][SQL] Support DPP + AQE when the broadcast exchange can be (commit: b6d57b6) — wenchen / githubweb
  4. [SPARK-35392][ML][PYTHON] Fix flaky tests in ml/clustering.py and (commit: f7704ec) — gurwls223 / githubweb
  5. [SPARK-35373][BUILD] Check Maven artifact checksum in build/mvn (commit: 6c5fcac) — srowen / githubweb
  6. [SPARK-35162][SQL] New SQL functions: TRY_ADD/TRY_DIVIDE (commit: 02c99f1) — ltnwgl / githubweb
  7. [SPARK-35332][SQL] Make cache plan disable configs configurable (commit: 6f63057) — wenchen / githubweb
  8. [SPARK-35062][SQL] Group exception messages in sql/streaming (commit: c2e15cc) — wenchen / githubweb
  9. [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and (commit: 6aa2594) — wenchen / githubweb
  10. [SPARK-35393][PYTHON][INFRA][TESTS] Recover pip packaging test in Github (commit: 7d371d2) — dhyun / githubweb
  11. [SPARK-35397][SQL] Replace sys.err usage with explicit exception type (commit: 6a949d1) — dhyun / githubweb
  12. [SPARK-34764][CORE][K8S][UI] Propagate reason for exec loss to Web UI (commit: 160b3be) — hkarau / githubweb
  13. [SPARK-35329][SQL] Split generated switch code into pieces in ExpandExec (commit: 8fa739f) — viirya / githubweb
  14. [SPARK-35311][SS][UI][DOCS] Structured Streaming Web UI state (commit: b6a0a7e) — kabhwan.opensource / githubweb
  15. [SPARK-34764][UI][FOLLOW-UP] Fix indentation and missing arguments for (commit: f7af9ab) — sarutak / githubweb
  16. [SPARK-35207][SQL] Normalize hash function behavior with negative zero (commit: 9ea55fe) — wenchen / githubweb
  17. [MINOR][DOC] ADD toc for monitoring page (commit: d424771) — yao / githubweb
  18. [SPARK-35332][SQL][FOLLOWUP] Refine wrong comment (commit: 6218bc5) — yao / githubweb
  19. [SPARK-35404][CORE] Name the timers in TaskSchedulerImpl (commit: 68239d1) — gurwls223 / githubweb
  20. [SPARK-35206][TESTS][SQL] Extract common used get project path into a (commit: 94bd480) — wenchen / githubweb
  21. [SPARK-35405][DOC] Submitting Applications documentation has outdated (commit: d2fbf0d) — dhyun / githubweb
  22. [SPARK-35384][SQL][FOLLOWUP] Move `HashMap.get` out of (commit: a8032e7) — dhyun / githubweb
  23. [MINOR][DOCS] Add required imports to CV, train validation split Pyspark (commit: a37cce9) — srowen / githubweb
  24. [SPARK-32484][SQL] Fix log info BroadcastExchangeExec.scala (commit: 9789ee8) — srowen / githubweb

#782 (May 13, 2021, 3:40:30 AM)

  1. [SPARK-35146][SQL] Migrate to transformWithPruning or resolveWithPruning (commit: 7c9a9ec) — ltnwgl / githubweb
  2. [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline (commit: 2b6640a) — ltnwgl / githubweb
  3. [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven (commit: b59d5ab) — sarutak / githubweb
  4. [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in (commit: af0d99c) — gurwls223 / githubweb
  5. [SPARK-35361][SQL] Improve performance for ApplyFunctionExpression (commit: 78221bd) — gurwls223 / githubweb
  6. [MINOR][DOCS] Avoid some python docs where first sentence has "e.g." or (commit: a189be8) — gurwls223 / githubweb
  7. [SPARK-35377][INFRA] Add JS linter to GA (commit: 7e3446a) — gurwls223 / githubweb
  8. [SPARK-35381][R] Fix lambda variable name issues in nested higher order (commit: ecb48cc) — gurwls223 / githubweb
  9. [SPARK-35243][SQL] Support columnar execution on ANSI interval types (commit: 82c520a) — gurwls223 / githubweb
  10. [SPARK-35298][SQL] Migrate to transformWithPruning for rules in (commit: d92018e) — ltnwgl / githubweb
  11. [SPARK-29145][SQL][FOLLOWUP] Clean up code about support sub-queries in (commit: ed05954) — wenchen / githubweb
  12. [SPARK-35357][GRAPHX] Allow to turn off the normalization applied by (commit: 402375b) — srowen / githubweb
  13. [SPARK-35253][SQL][BUILD] Bump up the janino version to v3.1.4 (commit: 101b0cc) — srowen / githubweb
  14. [SPARK-35295][ML] Replace fully com.github.fommil.netlib by (commit: b52d47a) — srowen / githubweb
  15. [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join (commit: 7bcaded) — wenchen / githubweb
  16. [SPARK-35347][SQL][FOLLOWUP] Throw exception with an explicit exception (commit: f156a95) — viirya / githubweb
  17. [SPARK-35387][INFRA] Increase the JVM stack size for Java 11 build test (commit: dac6f17) — dongjoon / githubweb
  18. [SPARK-35383][CORE] Improve s3a magic committer support by inferring (commit: 77b7fe1) — dongjoon / githubweb
  19. [SPARK-35361][SQL][FOLLOWUP] Switch to use while loop (commit: bc95c3a) — dongjoon / githubweb
  20. [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0 (commit: b3c916e) — dongjoon / githubweb
  21. [SPARK-35369][DOC] Document ExecutorAllocationManager metrics (commit: ae0579a) — dongjoon / githubweb
  22. [SPARK-35385][SQL][TESTS] Skip duplicate queries in the TPCDS-related (commit: 3241aeb) — yamamuro / githubweb
  23. [SPARK-35388][INFRA] Allow the PR source branch to include slashes (commit: c0b52da) — gurwls223 / githubweb
  24. [SPARK-35384][SQL] Improve performance for InvokeLike.invoke (commit: 0ab9bd7) — dhyun / githubweb
  25. [SPARK-35382][PYTHON] Fix lambda variable name issues in nested (commit: 17b59a9) — gurwls223 / githubweb
  26. [SPARK-35394][K8S][BUILD] Move kubernetes-client.version to root pom (commit: dd54649) — dhyun / githubweb
  27. [SPARK-35380][SQL] Loading SparkSessionExtensions from ServiceLoader (commit: 5181543) — yao / githubweb

#781 (May 10, 2021, 7:32:43 PM)

  1. Revert "[SPARK-35321][SQL] Don't register Hive permanent functions when (commit: e31bef1) — dongjoon / githubweb
  2. [SPARK-35347][SQL] Use MethodUtils for looking up methods in Invoke and (commit: 5b65d8a) — dongjoon / githubweb
  3. [SPARK-35231][SQL] logical.Range override maxRowsPerPartition (commit: 620f072) — yamamuro / githubweb
  4. [SPARK-35354][SQL] Replace BaseJoinExec with ShuffledJoin in (commit: 38eb5a6) — yamamuro / githubweb
  5. [SPARK-35111][SPARK-35112][SQL][FOLLOWUP] Rename ANSI interval patterns (commit: 2c8ced9) — max.gekk / githubweb
  6. [SPARK-35261][SQL][TESTS][FOLLOW-UP] Change failOnError to false for (commit: 245dce1) — wenchen / githubweb
  7. [SPARK-35358][BUILD] Increase maximum Java heap used for release build (commit: 20d3224) — dongjoon / githubweb
  8. [MINOR][INFRA] Add python/.idea into git ignore (commit: d808956) — gurwls223 / githubweb
  9. [SPARK-35360][SQL] RepairTableCommand respects (commit: 7182f8c) — max.gekk / githubweb
  10. [SPARK-34246][FOLLOWUP] Change the definition of (commit: d2a535f) — ltnwgl / githubweb
  11. [SPARK-34736][K8S][TESTS] Kubernetes and Minikube version upgrade for (commit: 8b94eff) — piros.attila.zsolt / githubweb
  12. [SPARK-35088][SQL][FOLLOWUP] Improve the error message for Sequence (commit: 44bd0a8) — gurwls223 / githubweb
  13. [SPARK-35363][SQL] Refactor sort merge join code-gen be agnostic to join (commit: c4ca232) — yamamuro / githubweb

#780 (May 8, 2021, 6:15:14 AM)

  1. [SPARK-35318][SQL] Hide internal view properties for describe table cmd (commit: 3f5a209) — wenchen / githubweb
  2. [SPARK-35240][SS] Use CheckpointFileManager for checkpoint file (commit: c6d3f37) — viirya / githubweb
  3. [SPARK-35215][SQL] Update custom metric per certain rows and at the end (commit: 6cd5cf5) — wenchen / githubweb
  4. [SPARK-34526][SS] Ignore the error when checking the path in (commit: dfb3343) — kabhwan.opensource / githubweb
  5. [SPARK-35326][BUILD] Upgrade Jersey to 2.34 (commit: bb93547) — dhyun / githubweb
  6. [SPARK-35326][BUILD][FOLLOWUP] Update dependency manifest files (commit: 482b43d) — dhyun / githubweb
  7. [SPARK-35293][SQL][TESTS][FOLLOWUP] Update the hash key to refresh (commit: e834ef7) — dhyun / githubweb
  8. [SPARK-35306][MLLIB][TESTS] Add benchmark results for BLASBenchmark (commit: 94bbca3) — gurwls223 / githubweb
  9. [SPARK-35133][SQL] Explain codegen works with AQE (commit: 42f59ca) — dhyun / githubweb
  10. [SPARK-34701][SQL][FOLLOW-UP] Children/innerChildren should be mutually (commit: 33c1034) — wenchen / githubweb
  11. [SPARK-26164][SQL][FOLLOWUP] WriteTaskStatsTracker should know which (commit: e83910f) — wenchen / githubweb
  12. [SPARK-35020][SQL] Group exception messages in catalyst/util (commit: cf2c4ba) — wenchen / githubweb
  13. [SPARK-35333][SQL] Skip object null check in Invoke if possible (commit: 9aa18df) — wenchen / githubweb
  14. [SPARK-35144][SQL] Migrate to transformWithPruning for object rules (commit: 72d3266) — ltnwgl / githubweb
  15. [SPARK-35021][SQL] Group exception messages in connector/catalog (commit: d3b92ee) — wenchen / githubweb
  16. [SPARK-35175][BUILD] Add linter for JavaScript source files (commit: 2634dba) — sarutak / githubweb
  17. [SPARK-35297][CORE][DOC][MINOR] Modify the comment about the executor (commit: 6f0ef93) — yamamuro / githubweb
  18. [SPARK-35288][SQL] StaticInvoke should find the method without exact (commit: 33fbf56) — viirya / githubweb
  19. [SPARK-35321][SQL] Don't register Hive permanent functions when creating (commit: b4ec9e2) — dhyun / githubweb
  20. [SPARK-35261][SQL] Support static magic method for stateless Java (commit: f47e0f8) — dhyun / githubweb
  21. [SPARK-35232][SQL] Nested column pruning should retain column metadata (commit: 323a6e8) — viirya / githubweb
  22. [SPARK-35331][SQL] Support resolving missing attrs for (commit: b025780) — dongjoon / githubweb
  23. [SPARK-35327][SQL][TESTS] Filters out the TPC-DS queries that can cause (commit: 06c4009) — yamamuro / githubweb

#779 (May 6, 2021, 12:08:31 AM)

  1. [SPARK-35255][BUILD] Automated formatting for Scala Code for Blank Lines (commit: 77e9152) — gurwls223 / githubweb
  2. [SPARK-35277][BUILD] Upgrade snappy to 1.1.8.4 (commit: ac8813e) — dhyun / githubweb
  3. [SPARK-35111][SQL] Support Cast string to year-month interval (commit: 11ea255) — max.gekk / githubweb
  4. [SPARK-35264][SQL] Support AQE side broadcastJoin threshold (commit: 39889df) — wenchen / githubweb
  5. [SPARK-35280][K8S] Promote KubernetesUtils to DeveloperApi (commit: 4e8701a) — dhyun / githubweb
  6. [SPARK-35273][SQL] CombineFilters support non-deterministic expressions (commit: 72e238a) — wenchen / githubweb
  7. [SPARK-35278][SQL] Invoke should find the method with correct number of (commit: 6ce1b16) — viirya / githubweb
  8. [SPARK-34581][SQL] Don't optimize out grouping expressions from (commit: cfc0495) — wenchen / githubweb
  9. [SPARK-35112][SQL] Support Cast string to day-second interval (commit: caa46ce) — max.gekk / githubweb
  10. [SPARK-35192][SQL][TESTS] Port minimal TPC-DS datagen code from (commit: cd689c9) — yamamuro / githubweb
  11. [SPARK-35285][SQL] Parse ANSI interval types in SQL schema (commit: 335f00b) — gurwls223 / githubweb
  12. [SPARK-35281][SQL] StaticInvoke should not apply boxing if return type (commit: 2a8d7ed) — gurwls223 / githubweb
  13. [SPARK-35176][PYTHON] Standardize input validation error type (commit: 44b7931) — gurwls223 / githubweb
  14. [SPARK-35266][TESTS] Fix error in BenchmarkBase.scala that occurs when (commit: be6ecb6) — gurwls223 / githubweb
  15. [MINOR][SS][DOCS] Fix a typo in the documentation of GroupState (commit: 54e0aa1) — gurwls223 / githubweb
  16. [SPARK-35250][SQL][DOCS] Fix duplicated STOP_AT_DELIMITER to SKIP_VALUE (commit: 8aaa9e8) — gurwls223 / githubweb
  17. [SPARK-35292][PYTHON] Delete redundant parameter in mypy configuration (commit: 176218b) — gurwls223 / githubweb
  18. [SPARK-34887][PYTHON] Port Koalas dependencies into PySpark (commit: 120c389) — gurwls223 / githubweb
  19. [SPARK-35300][PYTHON][DOCS] Standardize module names in install.rst (commit: 5ecb112) — gurwls223 / githubweb
  20. [SPARK-35302][INFRA] Benchmark workflow should create new files for new (commit: a2927cb) — gurwls223 / githubweb
  21. [SPARK-35308][TESTS] Fix bug in SPARK-35266 that creates benchmark files (commit: 9b387a1) — gurwls223 / githubweb
  22. [SPARK-35294][SQL] Add tree traversal pruning in rules with dedicated (commit: 7fd3f8f) — ltnwgl / githubweb
  23. [SPARK-34794][SQL] Fix lambda variable name issues in nested DataFrame (commit: f550e03) — yamamuro / githubweb
  24. [SPARK-34854][SQL][SS] Expose source metrics via progress report and add (commit: bbdbe0f) — kabhwan.opensource / githubweb
  25. [SPARK-35315][TESTS] Keep benchmark result consistent between (commit: 4fe4b65) — yumwang / githubweb
  26. [SPARK-35155][SQL] Add rule id pruning to Analyzer rules (commit: 7970318) — ltnwgl / githubweb
  27. [SPARK-35323][BUILD] Remove unused libraries from LICENSE-binary (commit: 0126924) — dhyun / githubweb
  28. [SPARK-35319][K8S][BUILD] Upgrade K8s client to 5.3.1 (commit: a0c76a8) — dhyun / githubweb
  29. [SPARK-35325][SQL][TESTS] Add nested column ORC encryption test case (commit: 19661f6) — dhyun / githubweb
  30. [SPARK-35293][SQL][TESTS] Use the newer dsdgen for TPCDSQueryTestSuite (commit: 5c67d0c) — yamamuro / githubweb

#778 (Apr 29, 2021, 2:53:12 PM)

  1. [SPARK-35150][ML] Accelerate fallback BLAS with dev.ludovic.netlib (commit: 5b77ebb) — srowen / githubweb
  2. [SPARK-34979][PYTHON][DOC] Add PyArrow installation note for PySpark (commit: 0769049) — hyukjinkwon / githubweb
  3. [SPARK-35236][SQL] Support archive files as resources for CREATE (commit: abb1f0c) — hyukjinkwon / githubweb
  4. [SPARK-35244][SQL] Invoke should throw the original exception (commit: 10c2b68) — hyukjinkwon / githubweb
  5. [SPARK-35246][SS] Don't allow streaming-batch intersects (commit: 253a1ae) — hyukjinkwon / githubweb
  6. [SPARK-34878][SQL][TESTS] Check actual sizes of year-month and day-time (commit: 046c8c3) — max.gekk / githubweb
  7. [SPARK-35085][SQL] Get columns operation should handle ANSI interval (commit: 56bb815) — max.gekk / githubweb
  8. [SPARK-33976][SQL][DOCS][FOLLOWUP] Fix syntax error in select doc page (commit: 26a5e33) — yamamuro / githubweb
  9. [SPARK-35214][SQL] OptimizeSkewedJoin support ShuffledHashJoinExec (commit: 8b62c29) — yamamuro / githubweb
  10. [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules (commit: 0bcf348) — wenchen / githubweb
  11. [SPARK-34981][SQL] Implement V2 function resolution and evaluation (commit: 86d3bb5) — wenchen / githubweb
  12. [SPARK-35244][SQL][FOLLOWUP] Add null check for the exception cause (commit: 403e479) — yamamuro / githubweb
  13. [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait (commit: 74b9326) — yi.wu / githubweb
  14. [SPARK-34786][SQL][FOLLOWUP] Explicitly declare DecimalType(20, 0) for (commit: 7713565) — wenchen / githubweb
  15. [SPARK-35226][SQL] Support refreshKrb5Config option in JDBC datasources (commit: 529b875) — sarutak / githubweb
  16. [SPARK-35105][SQL] Support multiple paths for ADD FILE/JAR/ARCHIVE (commit: 132cbf0) — sarutak / githubweb
  17. [SPARK-35234][CORE] Reserve the format of stage failureMessage (commit: 068b6c8) — piros.attila.zsolt / githubweb
  18. [SPARK-35269][BUILD] Upgrade commons-lang3 to 3.12.0 (commit: 7b78e34) — dhyun / githubweb
  19. [SPARK-35254][BUILD] Upgrade SBT to 1.5.1 (commit: 4e3daa5) — dhyun / githubweb
  20. [SPARK-35009][CORE] Avoid creating multiple python worker monitor (commit: 738cf7f) — piros.attila.zsolt / githubweb
  21. [SPARK-35268][BUILD] Upgrade GenJavadoc to 0.17 (commit: 8a5af37) — dhyun / githubweb
  22. [SPARK-35047][SQL] Allow Json datasources to write non-ascii characters (commit: e8bf8fe) — dhyun / githubweb

#777 (Apr 27, 2021, 11:30:44 AM)

  1. [SPARK-35168][SQL] mapred.reduce.tasks should be shuffle.partitions not (commit: 5b1353f) — yao / githubweb
  2. [SPARK-35220][SQL] DayTimeIntervalType/YearMonthIntervalType show (commit: 6f782ef) — hyukjinkwon / githubweb
  3. [SPARK-35087][UI] Some columns in table Aggregated Metrics by Executor (commit: 2d6467d) — sarutak / githubweb
  4. [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based (commit: 38ef477) — mridulatgmail.com / githubweb
  5. [SPARK-35224][SQL][TESTS] Fix buffer overflow in (commit: d572a85) — max.gekk / githubweb
  6. [SPARK-35213][SQL] Keep the correct ordering of nested structs in (commit: 74afc68) — viirya / githubweb
  7. [SPARK-35088][SQL] Accept ANSI intervals by the Sequence expression (commit: c0a3c0c) — max.gekk / githubweb
  8. [SPARK-35223] Add IssueNavigationLink (commit: 84026d7) — yao / githubweb
  9. [SPARK-35230][SQL] Move custom metric classes to proper package (commit: bdac191) — dhyun / githubweb
  10. [SPARK-35220][DOCS][FOLLOWUP] DayTimeIntervalType/YearMonthIntervalType (commit: 1db031f) — max.gekk / githubweb
  11. [SPARK-34638][SQL] Single field nested column prune on generator output (commit: c59988a) — viirya / githubweb
  12. [SPARK-33985][SQL][TESTS] Add query test of combine usage of TRANSFORM (commit: f009046) — wenchen / githubweb
  13. [SPARK-35060][SQL] Group exception messages in sql/types (commit: 1b609c7) — wenchen / githubweb
  14. [SPARK-28247][SS][TEST] Fix flaky test "query without test harness" on (commit: 0df3b50) — kabhwan.opensource / githubweb
  15. [SPARK-35227][BUILD] Update the resolver for spark-packages in (commit: f738fe0) — hyukjinkwon / githubweb
  16. [SPARK-35225][SQL] EXPLAIN command should handle empty output of (commit: 7779fce) — hyukjinkwon / githubweb
  17. [SPARK-26164][SQL] Allow concurrent writers for writing dynamic (commit: 7f51106) — wenchen / githubweb
  18. [SPARK-35139][SQL] Support ANSI intervals as Arrow Column vectors (commit: eb08b90) — wenchen / githubweb
  19. [SPARK-35235][SQL][TEST] Add row-based hash map into aggregate benchmark (commit: c4ad86f) — wenchen / githubweb
  20. [SPARK-35169][SQL] Fix wrong result of min ANSI interval division by -1 (commit: 2d2f467) — wenchen / githubweb
  21. [SPARK-34837][SQL][FOLLOWUP] Fix division by zero in the avg function (commit: 55dea2d) — max.gekk / githubweb
  22. [SPARK-35239][SQL] Coalesce shuffle partition should handle empty input (commit: 4ff9f1f) — wenchen / githubweb
  23. [SPARK-35091][SPARK-35090][SQL] Support extract from ANSI Intervals (commit: 16d223e) — wenchen / githubweb
  24. [MINOR][DOCS][ML] Explicit return type of array_to_vector utility (commit: 592230e) — srowen / githubweb
  25. [SPARK-35238][DOC] Add JindoFS SDK in cloud integration documents (commit: 26a8d2f) — srowen / githubweb

#776 (Apr 25, 2021, 3:22:41 AM)

  1. Revert "[SPARK-34581][SQL] Don't optimize out grouping expressions from (commit: fdccd88) — wenchen / githubweb
  2. [SPARK-35078][SQL] Add tree traversal pruning in expression rules (commit: 9af338c) — ltnwgl / githubweb
  3. [SPARK-35201][SQL] Format empty grouping set exception in CUBE/ROLLUP (commit: e503b9c) — yamamuro / githubweb
  4. [SPARK-35204][SQL] CatalystTypeConverters of date/timestamp should (commit: a9345a0) — max.gekk / githubweb
  5. [SPARK-34297][SQL][SS] Add metrics for data loss and offset out range (commit: b2a2b5d) — viirya / githubweb
  6. [SPARK-35210][BUILD] Upgrade Jetty to 9.4.40 to fix ERR_CONNECTION_RESET (commit: 44c1387) — sarutak / githubweb
  7. [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite (commit: 166cc62) — dhyun / githubweb
  8. [SPARK-35200][CORE] Avoid to recompute the pending speculative tasks in (commit: bcac733) — dhyun / githubweb
  9. [SPARK-35024][ML] Refactor LinearSVC - support virtual centering (commit: 1f150b9) — ruifengz / githubweb
  10. [SPARK-33913][SS] Upgrade Kafka to 2.8.0 (commit: b108e7f) — hyukjinkwon / githubweb

#775 (Apr 23, 2021, 12:16:57 AM)

  1. [SPARK-35096][SQL] SchemaPruning should adhere spark.sql.caseSensitive (commit: 4f309ce) — wenchen / githubweb
  2. [SPARK-35152][SQL] ANSI mode: IntegralDivide throws exception on (commit: 43ad939) — ltnwgl / githubweb
  3. [SPARK-35142][PYTHON][ML] Fix incorrect return type for (commit: b6350f5) — weichen.xu / githubweb
  4. [SPARK-35171][R] Declare the markdown package as a dependency of the (commit: 8e9e700) — gurwls223 / githubweb
  5. [SPARK-35140][INFRA] Add error message guidelines to PR template (commit: 355c399) — gurwls223 / githubweb
  6. [SPARK-34692][SQL] Support Not(Int) and Not(InSet) propagate null in (commit: 81dbaed) — wenchen / githubweb
  7. [SPARK-34897][SQL] Support reconcile schemas based on index after nested (commit: e609395) — viirya / githubweb
  8. [SPARK-35178][BUILD] Use new Apache 'closer.lua' syntax to obtain Maven (commit: 6860efe) — dhyun / githubweb
  9. [SPARK-34692][SQL][FOLLOWUP] Add INSET to (commit: 548e66c) — dhyun / githubweb
  10. [SPARK-34674][CORE][K8S] Close SparkContext after the Main method has (commit: b17a0e6) — dhyun / githubweb
  11. [SPARK-35177][SQL] Fix arithmetic overflow in parsing the minimal (commit: bb5459f) — max.gekk / githubweb
  12. [SPARK-35180][BUILD] Allow to build SparkR with SBT (commit: c0972de) — hyukjinkwon / githubweb
  13. [SPARK-35127][UI] When we switch between different stage-detail pages, (commit: 7242d7f) — sarutak / githubweb
  14. [SPARK-35026][SQL] Support nested CUBE/ROLLUP/GROUPING SETS in GROUPING (commit: b22d54a) — wenchen / githubweb
  15. [SPARK-35183][SQL] Use transformAllExpressions in CombineConcats (commit: 7f7a3d8) — wenchen / githubweb
  16. [SPARK-35110][SQL] Handle ANSI intervals in WindowExecBase (commit: 6c587d2) — max.gekk / githubweb
  17. [SPARK-35187][SQL] Fix failure on the minimal interval literal (commit: 04e2305) — max.gekk / githubweb
  18. [SPARK-34999][PYTHON] Consolidate PySpark testing utils (commit: 4d2b559) — ueshin / githubweb
  19. [SPARK-35182][K8S] Support driver-owned on-demand PVC (commit: 6ab0048) — dhyun / githubweb
  20. [SPARK-35040][PYTHON] Remove Spark-version related codes from test codes (commit: 4fcbf59) — ueshin / githubweb
  21. [SPARK-35075][SQL] Add traversal pruning for subquery related rules (commit: 47f8687) — ltnwgl / githubweb
  22. [SPARK-35195][SQL][TEST] Move InMemoryTable etc to (commit: 86238d0) — viirya / githubweb
  23. [SPARK-35141][SQL] Support two level of hash maps for final hash (commit: cab205e) — wenchen / githubweb
  24. [SPARK-35143][SQL][SHELL] Add default log level config for spark-sql (commit: 7582dc8) — hyukjinkwon / githubweb
  25. [SPARK-35159][SQL][DOCS] Extract hive format doc (commit: 20d68dc) — wenchen / githubweb

#774 (Apr 21, 2021, 12:14:46 AM)

  1. [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data (commit: a74f601) — gurwls223 / githubweb
  2. [SPARK-35045][SQL][FOLLOW-UP] Add a configuration for CSV input buffer (commit: 70b606f) — gurwls223 / githubweb
  3. [SPARK-34837][SQL] Support ANSI SQL intervals by the aggregate function (commit: 8dc455b) — max.gekk / githubweb
  4. [SPARK-35107][SQL] Parse unit-to-unit interval literals to ANSI (commit: 1d1ed3e) — max.gekk / githubweb
  5. [SPARK-34715][SQL][TESTS] Add round trip tests for period <-> month and (commit: 7f34035) — max.gekk / githubweb
  6. [SPARK-35125][K8S] Upgrade K8s client to 5.3.0 to support K8s 1.20 (commit: 425dc58) — dhyun / githubweb
  7. [SPARK-35102][SQL] Make spark.sql.hive.version read-only, not deprecated (commit: 2d161cb) — wenchen / githubweb
  8. [SPARK-35136] Remove initial null value of LiveStage.info (commit: d37d18d) — wenchen / githubweb
  9. [SPARK-35138][SQL] Remove Antlr4 workaround (commit: 0c2e9b9) — dhyun / githubweb
  10. [SPARK-35120][INFRA] Guide users to sync branch and enable GitHub (commit: dc7d41e) — dhyun / githubweb
  11. [SPARK-35131][K8S] Support early driver service clean-up during app (commit: 00f06dd) — dhyun / githubweb
  12. [SPARK-35103][SQL] Make TypeCoercion rules more efficient (commit: 9a6d773) — herman / githubweb
  13. [SPARK-35117][UI] Change progress bar back to highlight ratio of tasks (commit: e55ff83) — sarutak / githubweb
  14. [SPARK-35080][SQL] Only allow a subset of correlated equality predicates (commit: bad4b6f) — wenchen / githubweb
  15. [SPARK-35052][SQL] Use static bits for AttributeReference and Literal (commit: f4926d1) — ltnwgl / githubweb
  16. [SPARK-35134][BUILD][TESTS] Manually exclude redundant netty jars in (commit: 670c365) — gurwls223 / githubweb
  17. [SPARK-35018][SQL][TESTS] Check transferring of year-month intervals via (commit: aa0d00d) — max.gekk / githubweb
  18. [SPARK-34974][SQL] Improve subquery decorrelation framework (commit: b6bb24c) — wenchen / githubweb
  19. [SPARK-35068][SQL] Add tests for ANSI intervals to (commit: b219e37) — max.gekk / githubweb
  20. [SPARK-33976][SQL][DOCS] Add a SQL doc page for a TRANSFORM clause (commit: 9c956ab) — wenchen / githubweb
  21. [SPARK-34877][CORE][YARN] Add the code change for adding the Spark AM (commit: 1e64b4f) — tgraves / githubweb
  22. [SPARK-34035][SQL] Refactor ScriptTransformation to remove input (commit: 3614448) — wenchen / githubweb
  23. [SPARK-34338][SQL] Report metrics from Datasource v2 scan (commit: eb9a439) — wenchen / githubweb
  24. [SPARK-35145][SQL] CurrentOrigin should support nested invoking (commit: e08c40f) — wenchen / githubweb
  25. [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode (commit: 83f753e) — tgraves / githubweb
  26. [SPARK-35153][SQL] Make textual representation of ANSI interval (commit: e8d6992) — max.gekk / githubweb
  27. [SPARK-35132][BUILD][CORE] Upgrade netty-all to 4.1.63.Final (commit: c7e18ad) — srowen / githubweb
  28. [SPARK-35044][SQL][FOLLOWUP][TEST-HADOOP2.7] Fix hadoop 2.7 test due to (commit: 81c3cc2) — gurwls223 / githubweb
  29. [SPARK-35113][SQL] Support ANSI intervals in the Hash expression (commit: d259f93) — max.gekk / githubweb
  30. [SPARK-35120][INFRA][FOLLOW-UP] Try catch an error to show the correct (commit: 97ec57e) — ltnwgl / githubweb

#773 (Apr 19, 2021, 1:01:18 AM)

  1. [MINOR][DOCS] Soften security warning and keep it in cluster management (commit: 2e1e1f8) — srowen / githubweb
  2. [SPARK-34787][CORE] Option variable in Spark historyServer log should be (commit: 94849af) — dhyun / githubweb
  3. [SPARK-35101][INFRA] Add GitHub status check in PR instead of a comment (commit: 2bdb26b) — gurwls223 / githubweb
  4. [MINOR][INFRA] Upgrade Jira client to 2.0.0 (commit: 7f6dee8) — gurwls223 / githubweb
  5. [SPARK-35116][SQL][TESTS] The generated data fits the precision of (commit: 03191e8) — max.gekk / githubweb
  6. [SPARK-35114][SQL][TESTS] Add checks for ANSI intervals to (commit: d04b467) — max.gekk / githubweb
  7. [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function (commit: 12abfe7) — max.gekk / githubweb
  8. [SPARK-35115][SQL][TESTS] Check ANSI intervals in (commit: 074f770) — yamamuro / githubweb
  9. [SPARK-35092][UI] the auto-generated rdd's name in the storage tab (commit: 978cd0b) — sarutak / githubweb
  10. [SPARK-35109][SQL] Fix minor exception messages of HashedRelation and (commit: fd08c93) — yamamuro / githubweb
  11. [SPARK-34581][SQL] Don't optimize out grouping expressions from (commit: c8d78a7) — wenchen / githubweb
  12. [SPARK-35122][SQL] Migrate CACHE/UNCACHE TABLE to use (commit: 7a06cdd) — wenchen / githubweb

#772 (Apr 16, 2021, 6:01:38 PM)

  1. [SPARK-35082][INFRA] Use permissive and squshed merge when syncing to (commit: 963f434) — gurwls223 / githubweb
  2. [SPARK-35071][PYTHON] Rename Koalas to pandas-on-Spark in main codes (commit: 7ff9d2e) — gurwls223 / githubweb
  3. [SPARK-34789][TEST] Introduce Jetty based construct for integration (commit: 8a3815f) — dhyun / githubweb
  4. [MINOR][SQL] Refactor the comments in HiveClientImpl.withHiveState (commit: 271aa33) — dhyun / githubweb
  5. [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too (commit: 9b2e0d6) — yumwang / githubweb
  6. [SPARK-34225][CORE][FOLLOWUP] Replace Hadoop's Path with (commit: 767ea86) — dhyun / githubweb
  7. [SPARK-35070][SQL] TRANSFORM not support alias in inputs (commit: 71133e1) — wenchen / githubweb
  8. [MINOR][CORE] Correct the number of started fetch requests in log (commit: 2cb962b) — piros.attila.zsolt / githubweb
  9. [SPARK-34995] Port/integrate Koalas remaining codes into PySpark (commit: 9689c44) — gurwls223 / githubweb
  10. Revert "[SPARK-34995] Port/integrate Koalas remaining codes into (commit: 637f593) — gurwls223 / githubweb
  11. [SPARK-34843][SQL][FOLLOWUP] Fix a test failure in (commit: ba92de0) — dhyun / githubweb
  12. [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark (commit: 4aee19e) — gurwls223 / githubweb
  13. [SPARK-35099][SQL] Convert ANSI interval literals to SQL string in ANSI (commit: 3f4c32b) — max.gekk / githubweb
  14. [SPARK-35083][CORE] Support remote scheduler pool files (commit: 345c380) — dhyun / githubweb
  15. [SPARK-35104][SQL] Fix ugly indentation of multiple JSON records in a (commit: 95db7e6) — max.gekk / githubweb
  16. [SPARK-34995] Port/integrate Koalas remaining codes into PySpark (commit: 91bd384) — gurwls223 / githubweb

#771 (Apr 14, 2021, 7:45:59 PM)

  1. [SPARK-35041][SQL] Revise the overflow in UTF8String (commit: e70b0f8) — max.gekk / githubweb
  2. [SPARK-35043][SQL] Add condition lambda and rule id to the resolve (commit: 49618c9) — ltnwgl / githubweb
  3. [SPARK-35014] Fix the PhysicalAggregation pattern to not rewrite (commit: 9cd25b4) — wenchen / githubweb
  4. [SPARK-35045][SQL] Add an internal option to control input buffer in (commit: 1f56215) — max.gekk / githubweb
  5. [SPARK-34916][SQL][FOLLOWUP] Remove duplicate code in (commit: ade3a1d) — ltnwgl / githubweb
  6. [SPARK-34947][SQL] Streaming write to a V2 table should invalidate its (commit: 1a67089) — wenchen / githubweb
  7. [SPARK-33604][SQL] Group exception messages in sql/execution (commit: 27bec91) — wenchen / githubweb
  8. [SPARK-35049][CORE] Remove unused MapOutputTracker in (commit: ee7d838) — mridulatgmail.com / githubweb
  9. [SPARK-35012][PYTHON] Port Koalas DataFrame-related unit tests into (commit: 8ebc3fc) — ueshin / githubweb
  10. [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple (commit: ef05e89) — sarutak / githubweb
  11. [MINOR][PYTHON][DOCS] Fix docstring for pyspark.sql.DataFrameWriter.json (commit: faa928c) — gurwls223 / githubweb
  12. [SPARK-35050][DOCS][MESOS] Document deprecation of Apache Mesos in 3.2.0 (commit: 700aa17) — gurwls223 / githubweb
  13. [SPARK-35033][PYTHON] Port Koalas plot unit tests into PySpark (commit: cd1e8e8) — gurwls223 / githubweb
  14. [SPARK-35048][INFRA] Distribute GitHub Actions workflows to fork (commit: 2974b70) — gurwls223 / githubweb
  15. [SPARK-35035][PYTHON] Port Koalas internal implementation unit tests (commit: 47d62af) — gurwls223 / githubweb
  16. [SPARK-35039][PYTHON] Remove PySpark version dependent codes (commit: 4ae57d5) — gurwls223 / githubweb
  17. [SPARK-34577][SQL][FOLLOWUP] Add change of `DESC NAMESPACE`'s schema to (commit: 0fc97b5) — wenchen / githubweb
  18. [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL (commit: 816f6dd) — wenchen / githubweb
  19. [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its (commit: b5241c9) — wenchen / githubweb
  20. [SPARK-35002][YARN][TESTS][FOLLOW-UP] Fix java.net.BindException in (commit: a153efa) — yumwang / githubweb
  21. [SPARK-35069][SQL] TRANSFORM forbidden  `DISTICNT` and `ALL`, also make (commit: 4ca9958) — wenchen / githubweb
  22. [SPARK-35061][BUILD] Upgrade pycodestyle from 2.6.0 to 2.7.0 (commit: 3e218ad) — dhyun / githubweb
  23. [SPARK-35051][SQL] Support add/subtract of a day-time interval to/from a (commit: de9e8b6) — max.gekk / githubweb
  24. [SPARK-33882][ML] Add a vectorized BLAS implementation (commit: 9244066) — srowen / githubweb
  25. [SPARK-34834][NETWORK] Fix a potential Netty memory leak in (commit: bf9f3b8) — srowen / githubweb
  26. [SPARK-35044][SQL] `SET propertyKey` shall also lookup (commit: f32114d) — yao / githubweb
  27. [SPARK-34630][PYTHON][FOLLOWUP] Add __version__ into pyspark init (commit: 31555f7) — mszymkiewicz / githubweb
  28. [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark (commit: 58feb85) — gurwls223 / githubweb

#770 (Apr 13, 2021, 2:40:37 AM)

  1. [SPARK-35016][SQL] Format ANSI intervals in Hive style (commit: 0e761c7) — max.gekk / githubweb
  2. [SPARK-34983][PYTHON] Renaming the package alias from pp to ps (commit: fd8081c) — gurwls223 / githubweb
  3. [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in (commit: 03431d4) — gurwls223 / githubweb
  4. [SPARK-35023][BUILD] Migrate from deprecated `in` to `slash` syntax in (commit: d6df84e) — gurwls223 / githubweb
  5. [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server (commit: 90820b3) — gurwls223 / githubweb
  6. [SPARK-34916][SQL] Add condition lambda and rule id to the transform (commit: 3db8ec2) — ltnwgl / githubweb
  7. [SPARK-33229][SQL] Support partial grouping analytics and concatenated (commit: 2123237) — wenchen / githubweb
  8. [SPARK-34905][SQL][TESTS] Enable ANSI intervals in (commit: 8f8bac6) — wenchen / githubweb
  9. [SPARK-35005][SQL] Improve error msg if UTF8String concatWs length (commit: 1be1012) — max.gekk / githubweb
  10. [SPARK-34562][SQL] Add test and doc for Parquet Bloom filter push down (commit: e40fce9) — max.gekk / githubweb
  11. [SPARK-34593][SQL][FOLLOWUP] Fix (commit: 8627cab) — viirya / githubweb
  12. [SPARK-35019][PYTHON][SQL] Fix type hints mismatches in pyspark.sql.* (commit: b43f7e6) — gurwls223 / githubweb
  13. [SPARK-35031][PYTHON] Port Koalas operations on different frames tests (commit: 9c1f807) — gurwls223 / githubweb
  14. [SPARK-28227][SQL] Support projection, aggregate/window functions, and (commit: 278203d) — yamamuro / githubweb
  15. [SPARK-35028][SQL] ANSI mode: disallow group by aliases (commit: 79e55b4) — ltnwgl / githubweb
  16. [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and (commit: 16e2faa) — yao / githubweb
  17. [SPARK-35029][CORE] Extract `tryOrFetchFailedException` method to (commit: aae4ab2) — gurwls223 / githubweb
  18. [SPARK-34996][PYTHON] Port Koalas Series-related unit tests into PySpark (commit: a392633) — gurwls223 / githubweb
  19. [SPARK-35037][SQL] Recognize sign before the interval string in literals (commit: 26f312e) — max.gekk / githubweb
  20. [SPARK-33411][SQL] Cardinality estimation of union, sort and range (commit: caf33be) — yamamuro / githubweb
  21. [SPARK-28379][SQL] Allow non-aggregated single row correlated scalar (commit: 6b8405b) — wenchen / githubweb
  22. [MINOR][TESTS] Enhance the test instruction of (commit: 5d12653) — ltnwgl / githubweb
  23. [SPARK-34212][SQL][FOLLOWUP] Move the added test to ParquetQuerySuite (commit: b34a84e) — wenchen / githubweb

#769 (Apr 10, 2021, 7:27:48 PM)

  1. [SPARK-34973][SQL] Cleanup unused fields and methods in vectorized (commit: 5013171) — viirya / githubweb
  2. [SPARK-34674][CORE][K8S] Close SparkContext after the Main method has (commit: ab97db7) — dhyun / githubweb
  3. Revert "[SPARK-34674][CORE][K8S] Close SparkContext after the Main (commit: ed3f103) — dhyun / githubweb
  4. [SPARK-35002][INFRA] Fix the java.net.BindException when testing with (commit: 9663c40) — dhyun / githubweb
  5. [SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into (commit: 3af2c1b) — gurwls223 / githubweb
  6. [SPARK-34881][SQL][FOLLOWUP] Implement toString() and sql() methods for (commit: bfba7fa) — ltnwgl / githubweb
  7. [SPARK-35002][INFRA][FOLLOW-UP] Use localhost instead of 127.0.0.1 at (commit: a3d1e00) — yumwang / githubweb
  8. [SPARK-34989] Improve the performance of mapChildren and withNewChildren (commit: 0945baf) — herman / githubweb
  9. [SPARK-35004][TEST] Fix Incorrect assertion of `master/worker web ui (commit: c067588) — ltnwgl / githubweb
  10. [SPARK-35003][SQL] Improve performance for reading smallint in (commit: ee7bf7d) — dhyun / githubweb
  11. [SPARK-34963][SQL] Fix nested column pruning for extracting (commit: 364d1ea) — viirya / githubweb
  12. [MINOR][SS][DOC] Fix wrong Python code sample (commit: 214a46a) — max.gekk / githubweb
  13. [SPARK-34630][PYTHON] Add typehint for pyspark.__version__ (commit: 4c1ccda) — gurwls223 / githubweb
  14. [SPARK-34972][PYTHON][TEST][FOLLOWUP] Fix pyspark.pandas doctests which (commit: ff1fc5e) — gurwls223 / githubweb

#768 (Apr 8, 2021, 10:34:16 AM)

  1. [SPARK-34955][SQL] ADD JAR command cannot add jar files which contains (commit: e5d972e) — dhyun / githubweb
  2. [SPARK-34988][CORE] Upgrade Jetty for CVE-2021-28165 (commit: 59c8131) — max.gekk / githubweb
  3. [SPARK-34946][SQL] Block unsupported correlated scalar subquery in (commit: ac01070) — wenchen / githubweb
  4. [SPARK-33233][SQL] CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal (commit: 90613df) — wenchen / githubweb
  5. [SPARK-34962][SQL] Explicit representation of * in UpdateAction and (commit: c1c9a31) — wenchen / githubweb
  6. [SPARK-34984][SQL] ANSI intervals formatting in hive results (commit: 96a3533) — wenchen / githubweb

#767 (Apr 7, 2021, 11:36:24 AM)

  1. [SPARK-34965][BUILD] Remove .sbtopts that duplicately sets the default (commit: 2eda1c6) — dhyun / githubweb
  2. [SPARK-34968][TEST][PYTHON] Add the `-fr` argument to xargs rm (commit: 390d5bd) — dhyun / githubweb
  3. [SPARK-34922][SQL] Use a relative cost comparison function in the CBO (commit: 7c8dc5e) — yamamuro / githubweb
  4. [SPARK-34678][SQL] Add table function registry (commit: 0aa2c28) — wenchen / githubweb
  5. [SPARK-34969][SPARK-34906][SQL] Followup for Refactor TreeNode's (commit: 06c09a7) — herman / githubweb
  6. [SPARK-27658][SQL] Add FunctionCatalog API (commit: 3c7d6c3) — wenchen / githubweb
  7. [SPARK-34970][SQL][SERCURITY] Redact map-type options in the output of (commit: f208d80) — ltnwgl / githubweb
  8. [SPARK-34972][PYTHON] Make pandas-on-Spark doctests work (commit: 2635c38) — gurwls223 / githubweb
  9. [SPARK-34976][SQL] Rename GroupingSet to BaseGroupingSets (commit: 5a3f41a) — wenchen / githubweb
  10. [SPARK-34668][SQL] Support casting of day-time intervals to strings (commit: 3dfd456) — wenchen / githubweb
  11. [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents (commit: 8e15ac1) — max.gekk / githubweb

#766 (Apr 6, 2021, 11:19:39 AM)

  1. [SPARK-34951][INFRA][PYTHON][TESTS] Set the system encoding as UTF-8 to (commit: 82ad2f9) — gurwls223 / githubweb
  2. [SPARK-34479][FOLLOWUP][DOC] Add zstandard codec to (commit: ba32b20) — yumwang / githubweb
  3. [SPARK-34954][SQL] Use zstd codec name in ORC file names (commit: 748f05f) — dhyun / githubweb
  4. [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents (commit: a72f0d7) — gurwls223 / githubweb
  5. [SPARK-34934] Fix race condition while adding/removing sources in (commit: aff6c0f) — srowen / githubweb
  6. [SPARK-34959][BUILD] Upgrade SBT to 1.5.0 (commit: ac4334b) — dhyun / githubweb
  7. [SPARK-34949][CORE] Prevent BlockManager reregister when Executor is (commit: a9ca197) — mridulatgmail.com / githubweb
  8. [SPARK-34932][SQL] deprecate GROUP BY ... GROUPING SETS (...) and (commit: 39d5677) — yamamuro / githubweb
  9. [SPARK-34935][SQL] CREATE TABLE LIKE should respect the reserved table (commit: 7cfface) — yamamuro / githubweb
  10. [SPARK-34890][PYTHON] Port/integrate Koalas main codes into PySpark (commit: caf04f9) — gurwls223 / githubweb
  11. [SPARK-34923][SQL] Metadata output should be empty for more plans (commit: 3b634f6) — wenchen / githubweb
  12. Revert "[SPARK-34884][SQL] Improve DPP evaluation to make filtering side (commit: 19c7d2f) — wenchen / githubweb
  13. [SPARK-34667][SQL] Support casting of year-month intervals to strings (commit: 4b5fc1d) — max.gekk / githubweb

#765 (Apr 4, 2021, 12:09:36 AM)

  1. [SPARK-34933][DOC][SQL] Remove the description that || and && can be (commit: 8724f2b) — srowen / githubweb
  2. [SPARK-34779][CORE] ExecutorMetricsPoller should keep stage entry in (commit: f03c7c0) — piros.attila.zsolt / githubweb
  3. [SPARK-34862][SQL] Support nested column in ORC vectorized reader (commit: 1fc66f6) — viirya / githubweb
  4. [SPARK-34354][SQL] Fix failure when apply CostBasedJoinReorder on (commit: f897cc2) — wenchen / githubweb
  5. [SPARK-34938][SQL][TESTS] Benchmark only legacy interval in (commit: 1d08451) — gurwls223 / githubweb
  6. [SPARK-34940][SQL][TEST] Fix test of BasicWriteTaskStatsTrackerSuite (commit: 280a2f3) — gurwls223 / githubweb
  7. [SPARK-34926][SQL] PartitioningUtils.getPathFragment() should respect (commit: 65da928) — max.gekk / githubweb
  8. [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module (commit: f1d42bb) — dhyun / githubweb
  9. [SPARK-34948][K8S] Add ownerReference to executor configmap to fix (commit: a42dc93) — dhyun / githubweb
  10. [SPARK-34821][INFRA] Set up a workflow for developers to run benchmark (commit: 71effba) — gurwls223 / githubweb
  11. [SPARK-34950][TESTS] Update benchmark results to the ones created by (commit: ebf01ec) — max.gekk / githubweb
  12. [SPARK-34939][CORE] Throw fetch failure exception when unable to (commit: 571acc8) — dhyun / githubweb
  13. [MINOR][DOCS] Use ASCII characters when possible in PySpark (commit: 2ca76a5) — max.gekk / githubweb

#764 (Apr 1, 2021, 2:50:15 PM)

  1. [SPARK-34860][ML] Multinomial Logistic Regression with intercept support (commit: d372e6e) — srowen / githubweb
  2. [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the (commit: 46f96e9) — yamamuro / githubweb
  3. [SPARK-34907][TESTS] Add main class that detects and runs all benchmarks (commit: 065cbf1) — gurwls223 / githubweb
  4. [SPARK-34909][SQL] Fix conversion of negative to unsigned in conv() (commit: 13b255f) — wenchen / githubweb
  5. [SPARK-34896][SQL] Return day-time interval from dates subtraction (commit: 162f056) — max.gekk / githubweb
  6. [SPARK-34568][SQL] When SparkContext's conf not enable hive, we should (commit: eecc43c) — wenchen / githubweb
  7. [SPARK-34354][SQL] Fix failure when apply CostBasedJoinReorder on (commit: f05b940) — wenchen / githubweb
  8. [SPARK-34911][SQL] Fix code not close issue in monitoring.md (commit: 1c3bdab) — srowen / githubweb
  9. [SPARK-34915][INFRA] Cache Maven, SBT and Scala in all jobs that use (commit: 48ef9bd) — ltnwgl / githubweb
  10. [SPARK-34881][SQL] New SQL Function: TRY_CAST (commit: 3951e33) — ltnwgl / githubweb
  11. [SPARK-34882][SQL] Replace if with filter clause in (commit: 90f2d4d) — yamamuro / githubweb
  12. Revert "[SPARK-34354][SQL] Fix failure when apply CostBasedJoinReorder (commit: cc451c1) — gurwls223 / githubweb
  13. [SPARK-34881][SQL][FOLLOW-UP] Use multiline string for TryCast' (commit: 8a2138d) — ltnwgl / githubweb
  14. [SPARK-34919][SQL] Change partitioning to SinglePartition if partition (commit: 89ae83d) — wenchen / githubweb
  15. [SPARK-34903][SQL] Return day-time interval from timestamps subtraction (commit: 5911faa) — max.gekk / githubweb
  16. [SPARK-34908][SQL][TESTS] Add test cases for char and varchar with (commit: 1b553da) — gurwls223 / githubweb
  17. [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters (commit: 2796812) — srowen / githubweb
  18. [SPARK-24931][INFRA] Fix the GA failure related to R linter (commit: f99a831) — dhyun / githubweb

#763 (Mar 30, 2021, 3:51:46 PM)

  1. [SPARK-34622][SQL] Push down limit through Project with Join (commit: fcef237) — yamamuro / githubweb
  2. [SPARK-34894][CORE] Use 'io.connectionTimeout' as a hint instead of (commit: 5692aa0) — yao / githubweb
  3. [SPARK-34900][TEST] Make sure benchmarks can run using spark-submit cmd (commit: 7158e7f) — gurwls223 / githubweb
  4. [SPARK-34463][PYSPARK][DOCS] Document caveats of Arrow selfDestruct (commit: 1237124) — gurwls223 / githubweb
  5. [SPARK-32985][SQL][FOLLOWUP] Rename createNonBucketedReadRDD and minor (commit: 935aa8c) — gurwls223 / githubweb
  6. [SPARK-33308][SQL] Refactor current grouping analytics (commit: a98dc60) — wenchen / githubweb
  7. [SPARK-34884][SQL] Improve DPP evaluation to make filtering side must (commit: de66fa6) — wenchen / githubweb
  8. [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle (commit: 24d39a5) — wenchen / githubweb
  9. [SPARK-34828][YARN] Make shuffle service name configurable on client (commit: 9f065ff) — tgraves / githubweb
  10. [SPARK-34906] Refactor TreeNode's children handling methods into (commit: bd0990e) — herman / githubweb
  11. [SPARK-34856][FOLLOWUP][SQL] Remove dead code from (commit: c902f77) — srowen / githubweb

#762 (Mar 29, 2021, 1:40:34 PM)

  1. [SPARK-34841][SQL] Push ANSI interval binary expressions into into (commit: 468b944) — max.gekk / githubweb
  2. [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0 (commit: cbffc12) — dhyun / githubweb
  3. [SPARK-34880][SQL][TESTS] Add Parquet ZSTD compression test coverage (commit: e7af448) — dhyun / githubweb
  4. [SPARK-34092][SQL] Support Stage level restful api filter task details (commit: 066c055) — srowen / githubweb
  5. [SPARK-34869][K8S][TEST] Extend "EXTRA LOGS FOR THE FAILED TEST" section (commit: c8b7a09) — dhyun / githubweb
  6. [SPARK-32855][SQL][FOLLOWUP] Fix code format in SQLConf and comment in (commit: 540f1fb) — dhyun / githubweb
  7. [SPARK-34829][SQL] Fix higher order function results (commit: 3382190) — dhyun / githubweb
  8. [SPARK-34843][SQL] Calculate more precise partition stride in (commit: 4fceef0) — srowen / githubweb
  9. [SPARK-34876][SQL] Fill defaultResult of non-nullable aggregates (commit: 4b9e94c) — gurwls223 / githubweb
  10. [SPARK-34814][SQL] LikeSimplification should handle NULL (commit: 2356cdd) — gurwls223 / githubweb
  11. [SPARK-34879][SQL] HiveInspector supports DayTimeIntervalType and (commit: 015c598) — max.gekk / githubweb
  12. [SPARK-34872][SQL] quoteIfNeeded should quote a name which contains (commit: 14c7bb8) — wenchen / githubweb
  13. [SPARK-34255][SQL] Support partitioning with static number on required (commit: 43e08b1) — wenchen / githubweb
  14. [SPARK-34845][CORE] ProcfsMetricsGetter shouldn't return partial procfs (commit: b2bfe98) — dhyun / githubweb

#761 (Mar 27, 2021, 2:30:46 AM)

  1. Revert "[SPARK-34822][SQL] Update the plan stability golden files even (commit: 7838f55) — gurwls223 / githubweb
  2. [SPARK-34701][SQL] Remove analyzing temp view again in CreateViewCommand (commit: da04f1f) — wenchen / githubweb
  3. [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 (commit: 8c6748f) — wenchen / githubweb
  4. [SPARK-34850][SQL] Support multiply a day-time interval by a numeric (commit: a68d7ca) — max.gekk / githubweb
  5. [SPARK-34857][SQL] Correct AtLeastNNonNulls's explain output (commit: 1d6acd5) — gurwls223 / githubweb
  6. [SPARK-34822][SQL] Update the plan stability golden files even if only (commit: 6ba8445) — wenchen / githubweb
  7. [SPARK-33600][SQL] Group exception messages in execution/datasources/v2 (commit: 0d91f9c) — wenchen / githubweb
  8. [SPARK-34856][SQL] ANSI mode: Allow casting complex types as string type (commit: 0515f49) — ltnwgl / githubweb
  9. [SPARK-34840][SHUFFLE] Fixes cases of corruption in merged shuffle … (commit: 6d88212) — mridulatgmail.com / githubweb
  10. [SPARK-34833][SQL][FOLLOWUP] Handle outer references in all the places (commit: 658e95c) — yamamuro / githubweb
  11. [SPARK-34871][SS] Move the checkpoint location resolving into the rule (commit: 5ffc389) — gurwls223 / githubweb
  12. [SPARK-34786][SQL] Read Parquet unsigned int64 logical type that stored (commit: 820b465) — yao / githubweb
  13. [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for (commit: aaa0d2a) — wenchen / githubweb
  14. [SPARK-34868][SQL] Support divide an year-month interval by a numeric (commit: f212c61) — wenchen / githubweb
  15. Revert "[SPARK-34701][SQL] Remove analyzing temp view again in (commit: 61d038f) — wenchen / githubweb
  16. [SPARK-34874][INFRA] Recover test reports for failed GA builds (commit: c8233f1) — gurwls223 / githubweb
  17. [SPARK-34875][SQL] Support divide a day-time interval by a numeric (commit: 9ba889b) — wenchen / githubweb
  18. [SPARK-34858][SPARK-34448][ML] Binary Logistic Regression with intercept (commit: aa21e86) — srowen / githubweb
  19. [SPARK-34848][CORE] Add duration to TaskMetricDistributions (commit: 36a5104) — srowen / githubweb
  20. [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout (commit: d58587b) — srowen / githubweb
  21. [SPARK-34744][SQL] Improve error message for casting cause overflow (commit: 769cf7b) — yao / githubweb
  22. [SPARK-34848][SQL][FLLOW-UP] Fix merge conflict issue cause UT failed (commit: 15bf01e) — dhyun / githubweb

#760 (Mar 24, 2021, 7:36:18 PM)

  1. [SPARK-34811][CORE] Redact fs.s3a.access.key like secret and token (commit: 3c32b54) — dhyun / githubweb
  2. [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default (commit: 3bc6fe4) — dhyun / githubweb
  3. [SPARK-34772][TESTS][FOLLOWUP] Disable a test case using Hive 1.2.1 in (commit: c5fd94f) — dhyun / githubweb
  4. [SPARK-34470][ML] VectorSlicer utilize ordering if possible (commit: 47da944) — ruifengz / githubweb
  5. [MINOR][SQL] Spelling: filters - PushedFilers (commit: f4de93e) — max.gekk / githubweb
  6. [SPARK-34225][CORE] Don't encode further when a URI form string is (commit: 0734101) — sarutak / githubweb
  7. Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT (commit: 3bef2dc) — gurwls223 / githubweb
  8. [SPARK-34748][SS] Create a rule of the analysis logic for streaming (commit: 45235ac) — wenchen / githubweb
  9. [SPARK-34818][PYTHON][DOCS] Reorder the items in User Guide at PySpark (commit: c7bf8ad) — gurwls223 / githubweb
  10. [SPARK-34708][SQL] Code-gen for left semi/anti broadcast nested loop (commit: f8838fe) — wenchen / githubweb
  11. [SPARK-34383][SS] Optimize WAL commit phase via reducing cost of (commit: 121883b) — gabor.g.somogyi / githubweb
  12. [SPARK-34815][SQL] Update CSVBenchmark (commit: ec70467) — max.gekk / githubweb
  13. [SPARK-34089][CORE] HybridRowQueue should respect the configured memory (commit: e4bb975) — wenchen / githubweb
  14. [SPARK-34700][SQL] SessionCatalog's temporary view related APIs should (commit: 7953fcd) — wenchen / githubweb
  15. [SPARK-34800][SQL] Use fine-grained lock in SessionCatalog.tableExists (commit: f44608a) — wenchen / githubweb
  16. [SPARK-34778][BUILD] Upgrade to Avro 1.10.2 (commit: 8a552bf) — yumwang / githubweb
  17. [SPARK-34803][PYSPARK] Pass the raised ImportError if pandas or pyarrow (commit: ddfc75e) — gurwls223 / githubweb
  18. [SPARK-34812][SQL] RowNumberLike and RankLike should not be nullable (commit: 51cf0ca) — wenchen / githubweb
  19. [SPARK-33925][CORE][FOLLOW-UP] Remove the unused variables 'secMgr' (commit: 85581f6) — srowen / githubweb
  20. [SPARK-34820][K8S][R] add apt-update before gnupg install (commit: 31da907) — dhyun / githubweb
  21. [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io (commit: 39542bb) — dhyun / githubweb
  22. [SPARK-34707][SQL] Code-gen broadcast nested loop join (left outer/right (commit: e768eaa) — wenchen / githubweb
  23. [MINOR][DOCS] Updating the link for Azure Data Lake Gen 2 in docs (commit: d32bb4e) — max.gekk / githubweb
  24. [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register (commit: e00afd3) — wenchen / githubweb
  25. [SPARK-33482][SPARK-34756][SQL] Fix FileScan equality check (commit: 93a5d34) — wenchen / githubweb
  26. [SPARK-34366][SQL] Add interface for DS v2 metrics (commit: 115ed89) — wenchen / githubweb
  27. [SPARK-34719][SQL] Correctly resolve the view query with duplicated (commit: 3b70829) — wenchen / githubweb
  28. [MINOR][DOCS] Update sql-ref-syntax-dml-insert-into.md (commit: 06d4069) — gurwls223 / githubweb
  29. [SPARK-34824][SQL] Support multiply an year-month interval by a numeric (commit: 760556a) — max.gekk / githubweb
  30. [SPARK-34842][SQL][TESTS] Corrects the type of `date_dim.d_quarter_name` (commit: 0494dc9) — dhyun / githubweb
  31. [SPARK-33720][K8S] Support submit to k8s only with token (commit: 985c653) — dhyun / githubweb
  32. [SPARK-34763][SQL] col(), $"<name>" and df("name") should handle quoted (commit: f7e9b6e) — wenchen / githubweb
  33. [SPARK-34832][SQL][TEST] Set EXECUTOR_ALLOW_SPARK_CONTEXT to true to (commit: 712a62c) — gurwls223 / githubweb
  34. [SPARK-34477][CORE] Register KryoSerializers for Avro GenericData (commit: 2298ceb) — ltnwgl / githubweb
  35. [SPARK-34295][CORE] Exclude filesystems from token renewal at YARN (commit: 95c61df) — viirya / githubweb
  36. [SPARK-34488][CORE] Support task Metrics Distributions and executor (commit: 8ed5808) — srowen / githubweb
  37. [SPARK-34853][SQL] Remove duplicated definition of output (commit: 35c70e4) — yamamuro / githubweb
  38. [SPARK-34630][PYTHON][SQL] Added typehint for (commit: ad211cc) — mszymkiewicz / githubweb
  39. [SPARK-34822][SQL] Update the plan stability golden files even if only (commit: 84df54b) — wenchen / githubweb
  40. [SPARK-34769][SQL] AnsiTypeCoercion: return closest convertible type (commit: abfd9b2) — wenchen / githubweb
  41. [SPARK-34797][ML] Refactor Logistic Aggregator - support virtual (commit: 88cf86f) — srowen / githubweb
  42. [SPARK-34833][SQL] Apply right-padding correctly for correlated (commit: 150769b) — yamamuro / githubweb
  43. [SPARK-34852][SQL] Close Hive session state should use withHiveState (commit: 9d561e6) — yao / githubweb

#759 (Mar 21, 2021, 1:05:27 PM)

  1. [SPARK-31897][SQL] Enable codegen for GenerateExec (commit: 0a58029) — viirya / githubweb
  2. [SPARK-34761][SQL] Support add/subtract of a day-time interval to/from a (commit: a48b208) — wenchen / githubweb
  3. [SPARK-34772][SQL] RebaseDateTime loadRebaseRecords should use Spark (commit: 5850956) — yumwang / githubweb
  4. [SPARK-34558][SQL][FOLLOWUP] Use final Hadoop conf to instantiate (commit: 4b4f8e2) — wenchen / githubweb
  5. [SPARK-34798][SQL][TESTS] Fix incorrect join condition (commit: 6f89cdf) — yumwang / githubweb
  6. [SPARK-34793][SQL] Prohibit saving of day-time and year-month intervals (commit: 089c3b7) — max.gekk / githubweb
  7. [SPARK-34783][K8S] Support remote template files (commit: 2fa792a) — dhyun / githubweb
  8. [SPARK-34776][SQL] Nested column pruning should not prune Window (commit: 7a8a600) — dhyun / githubweb
  9. [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier (commit: 620cae0) — yamamuro / githubweb
  10. [SPARK-34796][SQL] Initialize counter variable for LIMIT code-gen in (commit: 2ff0032) — yamamuro / githubweb
  11. [SPARK-32384][CORE] repartitionAndSortWithinPartitions avoid shuffle (commit: f11950f) — yi.wu / githubweb
  12. [SPARK-34128][SQL] Suppress undesirable TTransportException warnings (commit: 2cdedef) — dhyun / githubweb
  13. [MINOR][DOCS][ML] Doc 'mode' as a supported Imputer strategy in Pyspark (commit: ed641fb) — srowen / githubweb
  14. [SPARK-28220][SQL] Improve PropagateEmptyRelation to support join with (commit: 908318f) — yumwang / githubweb
  15. [SPARK-34636][FOLLOWUP][SQL] Fix an incompatible behavior of (commit: 94fd6cb) — dhyun / githubweb
  16. [SPARK-34810][TEST] Update PostgreSQL test with the latest results (commit: c799d04) — yumwang / githubweb
  17. [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2 (commit: 2888d18) — yumwang / githubweb

#758 (Mar 18, 2021, 7:00:07 PM)

  1. [SPARK-34504][SQL] Avoid unnecessary resolving of SQL temp views for DDL (commit: af55373) — wenchen / githubweb
  2. [SPARK-34699][SQL] 'CREATE OR REPLACE TEMP VIEW USING' should uncache (commit: 387d866) — wenchen / githubweb
  3. [SPARK-34742][SQL] ANSI mode: Abs throws exception if input is out of (commit: 1433031) — wenchen / githubweb
  4. [SPARK-34575][SQL] Push down limit through window when partitionSpec is (commit: c234c5b) — wenchen / githubweb
  5. [SPARK-21449][SQL][FOLLOWUP] Avoid log undesirable IllegalStateException (commit: 115f777) — yao / githubweb
  6. [SPARK-34770][SQL] InMemoryCatalog.tableExists should not fail if (commit: 1a4971d) — wenchen / githubweb
  7. [SPARK-34768][SQL] Respect the default input buffer size in Univocity (commit: 385f1e8) — gurwls223 / githubweb
  8. [SPARK-34766][SQL] Do not capture maven config for views (commit: 48637a9) — yao / githubweb
  9. [SPARK-34749][SQL] Simplify ResolveCreateNamedStruct (commit: bf4570b) — yamamuro / githubweb
  10. [SPARK-34758][SQL] Simplify Analyzer.resolveLiteralFunction (commit: 9f7b0a0) — yamamuro / githubweb
  11. [SPARK-33602][SQL] Group exception messages in execution/datasources (commit: 569fb13) — wenchen / githubweb
  12. [SPARK-34762][BUILD] Fix the build failure with Scala 2.13 which is (commit: c5cadfe) — gurwls223 / githubweb
  13. [SPARK-34087][SQL] Fix memory leak of ExecutionListenerBus (commit: 4d90c5d) — gurwls223 / githubweb
  14. [SPARK-34731][CORE] Avoid ConcurrentModificationException when redacting (commit: f8a8b34) — gurwls223 / githubweb
  15. [SPARK-34728][SQL] Remove all SQLConf.get if extends from SQLConfHelper (commit: 25e7d1c) — gurwls223 / githubweb
  16. [SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in (commit: 86ea520) — gurwls223 / githubweb
  17. [SPARK-34741][SQL] MergeIntoTable should avoid ambiguous reference in (commit: d99135b) — wenchen / githubweb
  18. [SPARK-34774][BUILD] Ensure change-scala-version.sh update scala.version (commit: 2e836cd) — srowen / githubweb
  19. [SPARK-34760][EXAMPLES] Replace `favorite_color` with `age` in (commit: 5570f81) — yao / githubweb
  20. [SPARK-34781][SQL] Eliminate LEFT SEMI/ANTI joins to its left child side (commit: 8207e2f) — yamamuro / githubweb
  21. [SPARK-34747][SQL][DOCS] Add virtual operators to the built-in function (commit: 07ee732) — gurwls223 / githubweb

#757 (Mar 16, 2021, 11:54:22 AM)

  1. [SPARK-34737][SQL] Cast input float to double in `TIMESTAMP_SECONDS` (commit: 7aaed76) — gurwls223 / githubweb
  2. [SPARK-34722][CORE][SQL][TEST] Clean up deprecated API usage related to (commit: e757091) — dhyun / githubweb
  3. [SPARK-34729][SQL] Faster execution for broadcast nested loop join (left (commit: a0f3b72) — dhyun / githubweb
  4. [SPARK-34639][SQL] Always remove unnecessary Alias in (commit: be888b2) — wenchen / githubweb
  5. [SPARK-34743][SQL][TESTS] ExpressionEncoderSuite should use deepEquals (commit: 363a7f0) — dhyun / githubweb
  6. [SPARK-34739][SQL] Support add/subtract of a year-month interval to/from (commit: 9809a2f) — max.gekk / githubweb
  7. [MINOR][SQL] Remove unused variable in NewInstance.constructor (commit: 0a70dff) — dhyun / githubweb
  8. [SPARK-21449][SPARK-23745][SQL] add ShutdownHook to cloes HiveClient's (commit: 202529e) — yumwang / githubweb
  9. [SPARK-34729][SQL][FOLLOWUP] Broadcast nested loop join to use (commit: bb05dc9) — dhyun / githubweb
  10. [SPARK-34752][BUILD] Bump Jetty to 9.4.37 to address CVE-2020-27223 (commit: 4a6f534) — gurwls223 / githubweb
  11. Revert "[SPARK-33428][SQL] Conv UDF use BigInt to avoid  Long value (commit: cef6650) — wenchen / githubweb

#756 (Mar 14, 2021, 3:45:02 AM)

  1. [SPARK-34697][SQL] Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain (commit: fa1cf5c) — gurwls223 / githubweb
  2. [SPARK-34702][SQL] Avoid unnecessary code generation in (commit: da086a8) — wenchen / githubweb
  3. [SPARK-34538][SQL] Hive Metastore support filter by not-in (commit: 744a73d) — wenchen / githubweb
  4. [SPARK-34695][SQL] Fix long overflow in conversion of minimum duration (commit: d7bb327) — wenchen / githubweb
  5. [SPARK-34688][PYTHON] Upgrade to Py4J 0.10.9.2 (commit: 60e324a) — srowen / githubweb
  6. [SPARK-34713][SQL] Fix group by CreateStruct with ExtractValue (commit: 6a42b63) — dhyun / githubweb
  7. [SPARK-34712][SQL][TESTS] Refactor UT about hive build in version, avoid (commit: badca97) — dhyun / githubweb
  8. [SPARK-34718][SQL] Assign pretty names to YearMonthIntervalType and (commit: cebe2be) — dhyun / githubweb
  9. [SPARK-25769][SPARK-34636][SPARK-34626][SQL] sql method in (commit: 03dd33c) — wenchen / githubweb
  10. [SPARK-34724][SQL] Fix Interpreted evaluation by using getMethod instead (commit: 9a79779) — gurwls223 / githubweb
  11. [SPARK-34721][SQL] Support add/subtract of a year-month interval to/from (commit: 4f1e434) — wenchen / githubweb
  12. [SPARK-34723][SQL] Correct parameter type for subexpression elimination (commit: 86baa36) — viirya / githubweb
  13. [SPARK-34732][K8S][TESTS] Fix IndexOutOfBoundsException in (commit: 124b5af) — dhyun / githubweb
  14. [SPARK-34727][SQL] Fix discrepancy in casting float to timestamp (commit: e0a1399) — gurwls223 / githubweb
  15. [SPARK-34734][BUILD] Update sbt to version 1.4.9 (commit: 1e06031) — gurwls223 / githubweb

#755 (Mar 11, 2021, 3:23:43 AM)

  1. [SPARK-34676][SQL][TEST] TableCapabilityCheckSuite should not inherit (commit: 48377d5) — dhyun / githubweb
  2. [SPARK-34681][SQL] Fix bug for full outer shuffled hash join when (commit: a916690) — dhyun / githubweb
  3. [SPARK-34682][SQL] Fix regression in canonicalization error check in (commit: fd48438) — gurwls223 / githubweb
  4. [SPARK-34682][SQL] Use PrivateMethodTester instead of reflection (commit: fc182f7) — dhyun / githubweb
  5. [SPARK-34507][BUILD] Update scala.version in parent POM when changing (commit: 5e120e4) — gurwls223 / githubweb
  6. [SPARK-34546][SQL] AlterViewAs.query should be analyzed during the (commit: 2a6e68e) — wenchen / githubweb
  7. [SPARK-34457][SQL] DataSource V2: Add default null ordering to (commit: 7226379) — wenchen / githubweb
  8. [SPARK-34711][SQL][TESTS] Exercise code-gen enable/disable code paths (commit: 9aa8f06) — dhyun / githubweb
  9. [MINOR][SQL] Remove unnecessary extend from BroadcastHashJoinExec (commit: 14ad7af) — dhyun / githubweb
  10. [SPARK-34696][SQL][TESTS] Fix CodegenInterpretedPlanTest to generate (commit: 5c4d8f9) — dhyun / githubweb
  11. [SPARK-34677][SQL] Support the `+`/`-` operators over ANSI SQL intervals (commit: 9d3d25b) — wenchen / githubweb

#754 (Mar 9, 2021, 7:20:27 AM)

  1. [SPARK-34642][DOCS][ML] Fix TypeError in Pyspark Linear Regression docs (commit: 2f30cde) — dhyun / githubweb
  2. [SPARK-34628][SQL] Remove GlobalLimit operator if its child max rows not (commit: 616c818) — dhyun / githubweb
  3. [SPARK-34647][CORE] Use ZSTD JNI NoFinalizer classes and bump to 1.4.8-7 (commit: 1f6089b) — dhyun / githubweb
  4. [SPARK-34650][BUILD][SS] Exclude zstd-jni transitive dependency from (commit: 631a85e) — gurwls223 / githubweb
  5. [SPARK-34634][SQL] ResolveReferences.dedupRight should handle (commit: 9ec8696) — gurwls223 / githubweb
  6. [SPARK-34545][SQL] Fix issues with valueCompare feature of pyrolite (commit: ab8a9a0) — srowen / githubweb
  7. [SPARK-34657][PYTHON][DOCS] Replace the tag of release to the hash to (commit: 2526fde) — gurwls223 / githubweb
  8. [SPARK-34597][SQL] Replaces `ParquetFileReader.readFooter` with (commit: 43f355b) — dhyun / githubweb
  9. [SPARK-34615][SQL] Support `java.time.Period` as an external type of the (commit: e10bf64) — wenchen / githubweb
  10. [SPARK-34598][SQL] RewritePredicateSubquery Rule must not update Filters (commit: 02e74b2) — wenchen / githubweb
  11. [SPARK-34541][CORE] Fixed an issue where data could not be cleaned up (commit: f340857) — srowen / githubweb
  12. [SPARK-34665][SQL][DOCS] Revise the type coercion section of ANSI (commit: ee756fd) — yamamuro / githubweb
  13. [SPARK-34627][SQL] Use FunctionIdentifier in (commit: c32cac4) — wenchen / githubweb
  14. [SPARK-34670][BUILD] Upgrade ZSTD-JNI to 1.4.9-1 (commit: ba7e525) — dhyun / githubweb
  15. [SPARK-34666][SQL][TESTS] Test DayTimeIntervalType and (commit: 4ea2778) — wenchen / githubweb
  16. [SPARK-34663][SQL][TESTS] Test year-month and day-time intervals in UDF (commit: 6a7701a) — wenchen / githubweb
  17. [SPARK-33498][SQL][TESTS][FOLLOWUP] Remove SQLConf.withExistingConf in (commit: 43b23fd) — dhyun / githubweb
  18. [SPARK-34620][SQL] Code-gen broadcast nested loop join (inner/cross) (commit: b5b1985) — wenchen / githubweb
  19. [SPARK-34649][SQL][DOCS] (commit: a9c1189) — wenchen / githubweb
  20. [SPARK-34152][SQL][FOLLOW-UP] Global temp view's identifier should be (commit: cf8bbc1) — wenchen / githubweb
  21. [SPARK-34603][SQL] Support ADD ARCHIVE and LIST ARCHIVES command (commit: 2fd8517) — gurwls223 / githubweb

#753 (Mar 6, 2021, 5:09:45 AM)

  1. [SPARK-34604][PYTHON][TESTS] Use eventually in (commit: 8005900) — gurwls223 / githubweb
  2. [SPARK-33084][SQL][TEST][FOLLOWUP] Add ResetSystemProperties trait to (commit: 9d2d620) — gurwls223 / githubweb
  3. [SPARK-34610][PYTHON][TEST] Fix Python UDF used in (commit: 331d459) — gurwls223 / githubweb
  4. [SPARK-34584][SQL] Static partition should also follow (commit: 8f1eec4) — gurwls223 / githubweb
  5. [SPARK-34577][SQL] Fix drop/add columns to a dataset of `DESCRIBE (commit: db62710) — wenchen / githubweb
  6. [SPARK-34599][SQL] Fix the issue that INSERT INTO OVERWRITE doesn't (commit: 53e4dba) — wenchen / githubweb
  7. [SPARK-34614][SQL] ANSI mode: Casting String to Boolean should throw (commit: 2b1c170) — gengliang.wang / githubweb
  8. [SPARK-34567][SQL] CreateTableAsSelect should update metrics too (commit: 401e270) — wenchen / githubweb
  9. [SPARK-34482][SS] Correct the active SparkSession for (commit: e7e0161) — wenchen / githubweb
  10. [SPARK-34605][SQL] Support `java.time.Duration` as an external type of (commit: 17601e0) — wenchen / githubweb
  11. [SPARK-32924][WEBUI] Make duration column in master UI sorted in the (commit: 9ac5ee2) — dhyun / githubweb
  12. [SPARK-34607][SQL] Add `Utils.isMemberClass` to fix a malformed class (commit: dbce74d) — yamamuro / githubweb
  13. [SPARK-34376][SQL] Support regexp as a SQL function (commit: 814d81c) — gurwls223 / githubweb
  14. [SPARK-34613][SQL] Fix view does not capture disable hint config (commit: 43aacd5) — wenchen / githubweb
  15. [SPARK-34608][SQL] Remove unused output of AddJarCommand (commit: 979b9bc) — dhyun / githubweb
  16. [SPARK-34609][SQL] Unify resolveExpressionBottomUp and (commit: dc78f33) — wenchen / githubweb
  17. [MINOR][SQL][DOCS] Fix some spelling issues in SQL migration guide (commit: 75db6e7) — dhyun / githubweb
  18. [SPARK-34635][UI] Add trailing slashes in URLs to reduce unnecessary (commit: 358697b) — dhyun / githubweb
  19. [SPARK-22748][SQL] Analyze __grouping__id as a literal function (commit: ca326c4) — wenchen / githubweb
  20. [SPARK-34621][SQL] Unify output of ShowCreateTableAsSerdeCommand  and (commit: 654f19d) — wenchen / githubweb
  21. [SPARK-34592][WEBUI] Mark indeterminate RDD in Web UI (commit: c91a756) — viirya / githubweb
  22. [SPARK-34624][CORE] Exclude non-jar dependencies of ivy/maven packages (commit: 1fd7368) — dhyun / githubweb
  23. [SPARK-34643][R][DOCS] Use CRAN URL in canonical form (commit: f72b906) — dhyun / githubweb
  24. [SPARK-34595][SQL] DPP support RLIKE (commit: 1a97224) — yamamuro / githubweb

#752 (Mar 3, 2021, 11:52:58 AM)

  1. [SPARK-34561][SQL] Fix drop/add columns from/to a dataset of v2 (commit: 984ff39) — wenchen / githubweb
  2. [SPARK-34539][BUILD][INFRA] Remove stand-alone version Zinc server (commit: 85b50d4) — srowen / githubweb
  3. [SPARK-34560][SQL] Generate unique output attributes in the `SHOW (commit: 70f6267) — wenchen / githubweb
  4. [SPARK-34503][DOCS][FOLLOWUP] Document available codecs for event log (commit: 499cc79) — dhyun / githubweb
  5. [SPARK-34573][SQL] Avoid global locking in SQLConf object for (commit: b13a4b8) — yamamuro / githubweb
  6. [SPARK-33678][SQL] Product aggregation function (commit: 7d0743b) — gurwls223 / githubweb
  7. [SPARK-32703][SQL] Replace deprecated API calls from (commit: ce13dcc) — gurwls223 / githubweb
  8. [SPARK-34578][SQL][TESTS][TEST-MAVEN] Refactor ORC encryption tests and (commit: 4818847) — gurwls223 / githubweb
  9. [SPARK-34585][SQL] Remove no longer needed BatchWriteHelper (commit: 08a1257) — gurwls223 / githubweb
  10. [SPARK-34417][SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap (commit: 4bda3c0) — wenchen / githubweb
  11. [SPARK-34547][SQL] Only use metadata columns for resolution as last (commit: 2e54d68) — wenchen / githubweb
  12. [SPARK-34498][SQL][TESTS] fix the remaining problems in #31560 (commit: 9e8547c) — wenchen / githubweb
  13. [SPARK-34558][SQL] warehouse path should be qualified ahead of (commit: 6093a78) — wenchen / githubweb
  14. [SPARK-34361][K8S] In case of downscaling avoid killing of executors (commit: 6c5322d) — hkarau / githubweb
  15. [SPARK-34548][SQL] Remove unnecessary children from Union under Distince (commit: bab9531) — viirya / githubweb
  16. [SPARK-34548][SQL][FOLLOW-UP] Call toSeq to recover Scala 2.13 build in (commit: 1077666) — gurwls223 / githubweb
  17. [SPARK-34596][SQL] Use Utils.getSimpleName to avoid hitting Malformed (commit: ecf4811) — gurwls223 / githubweb
  18. [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch (commit: 4e43819) — wenchen / githubweb
  19. [SPARK-34593][SQL] Preserve broadcast nested loop join partitioning and (commit: 5362f08) — wenchen / githubweb
  20. [SPARK-27793][SQL] Add ANSI SQL day-time and year-month interval types (commit: cd649e7) — wenchen / githubweb
  21. [SPARK-34576][SQL] Fix drop/add columns to a dataset of `DESCRIBE (commit: 17f0e70) — wenchen / githubweb
  22. [SPARK-34222][SQL] Enhance boolean simplification rule (commit: 229d2e0) — wenchen / githubweb
  23. [MINOR][SQL][DOCS] Fix some wrong default values in SQL tuning guide's (commit: 499f620) — gurwls223 / githubweb
  24. [SPARK-33474][SQL] Support TypeConstructed partition spec value (commit: 56edb81) — yamamuro / githubweb
  25. [SPARK-34555][SQL] Resolve metadata output from DataFrame (commit: b01dd12) — wenchen / githubweb
  26. [SPARK-34222][SQL][FOLLOWUP] Non-recursive implementation of (commit: 5aaab19) — gengliang.wang / githubweb
  27. [SPARK-34590][TESTS] Allow JDWP debug for tests (commit: 33d1c16) — dhyun / githubweb

#751 (Feb 28, 2021, 10:43:51 PM)

  1. [SPARK-34474][SQL] Remove unnecessary Union under Distinct/Deduplicate (commit: f7ac2d6) — viirya / githubweb
  2. [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't (commit: dffb01f) — dhyun / githubweb
  3. [SPARK-34505][BUILD] Upgrade Scala to 2.13.5 (commit: 1967760) — dhyun / githubweb
  4. [SPARK-34535][SQL] Cleanup unused symbol in Orc related code (commit: 0d3a9cd) — gurwls223 / githubweb
  5. Revert "[SPARK-32617][K8S][TESTS] Configure kubernetes client based on (commit: 4d428a8) — dhyun / githubweb
  6. [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while (commit: 5c7d019) — wenchen / githubweb
  7. [SPARK-34551][INFRA] Fix credit related scripts to recover, drop Python (commit: 5b92531) — gurwls223 / githubweb
  8. [SPARK-34553][INFRA] Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in (commit: ac774ec) — gurwls223 / githubweb
  9. [SPARK-34524][SQL] Simplify v2 partition commands resolution (commit: 73857cd) — wenchen / githubweb
  10. [SPARK-34533][SQL] Eliminate LEFT ANTI join to empty relation in AQE (commit: 7d5021f) — wenchen / githubweb
  11. [SPARK-34550][SQL] Skip InSet null value during push filter to Hive (commit: 82267ac) — gurwls223 / githubweb
  12. [SPARK-34549][BUILD] Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844 (commit: a9e8e05) — gurwls223 / githubweb
  13. [SPARK-34554][SQL] Implement the copy() method in ColumnarMap (commit: c1beb16) — gurwls223 / githubweb
  14. [SPARK-33971][SQL] Eliminate distinct from more aggregates (commit: 67ec4f7) — yamamuro / githubweb
  15. [MINOR] Add more known translations of contributors (commit: 8d68f3f) — gurwls223 / githubweb
  16. [SPARK-34392][SQL] Support ZoneOffset +h:mm in DateTimeUtils. getZoneId (commit: 56e664c) — srowen / githubweb
  17. [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 (commit: 05069ff) — yamamuro / githubweb
  18. [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency (commit: d758210) — dongjoon / githubweb
  19. [SPARK-34559][BUILD] Upgrade to ZSTD JNI 1.4.8-6 (commit: 1aeafb4) — dongjoon / githubweb
  20. [SPARK-34415][ML] Randomization in hyperparameter optimization (commit: 397b843) — srowen / githubweb
  21. [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list (commit: 54c053a) — dongjoon / githubweb
  22. [SPARK-34415][ML] Python example (commit: 5a48eb8) — srowen / githubweb
  23. [SPARK-33687][SQL] Support analyze all tables in a specific database (commit: d07fc30) — yamamuro / githubweb
  24. [SPARK-34506][CORE] ADD JAR with ivy coordinates should be compatible (commit: 0216051) — yamamuro / githubweb
  25. [SPARK-34579][SQL][TEST] Fix wrong UT in SQLQuerySuite (commit: d574308) — dongjoon / githubweb
  26. [SPARK-34570][SQL] Remove dead code from constructors of (commit: 1afe284) — yamamuro / githubweb
  27. [SPARK-33212][FOLLOWUP] Add hadoop-yarn-server-web-proxy for Hadoop 3.x (commit: f494c5c) — dongjoon / githubweb
  28. [SPARK-34520][CORE][FOLLOW-UP] Remove SecurityManager in GangliaSink (commit: 3d0ee96) — gurwls223 / githubweb
  29. [SPARK-34556][SQL] Checking duplicate static partition columns should (commit: 62737e1) — gurwls223 / githubweb
  30. [SPARK-34574][DOCS] Jekyll fails to generate Scala API docs for Scala (commit: a6cc5e6) — gurwls223 / githubweb

#750 (Feb 25, 2021, 12:40:07 PM)

  1. [MINOR][DOCS] Replace http to https when possible in PySpark (commit: b5470ae) — gurwls223 / githubweb
  2. [SPARK-34500][DOCS][EXAMPLES] Replace symbol literals with $"" in (commit: 612d523) — gurwls223 / githubweb
  3. [SPARK-34490][SQL] Analysis should fail if the view refers a dropped (commit: be675a0) — wenchen / githubweb
  4. [SPARK-34475][SQL] Rename logical nodes of v2 `ALTER` commands (commit: 8f994cb) — wenchen / githubweb
  5. Revert "[SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET (commit: 429f8af) — wenchen / githubweb
  6. [SPARK-34502][SQL] Remove unused parameters in join methods (commit: 443139b) — viirya / githubweb
  7. [SPARK-34508][SQL][TEST] Skip HiveExternalCatalogVersionsSuite if (commit: 0d5d248) — dhyun / githubweb
  8. [SPARK-34168][SQL][FOLLOWUP] Improve DynamicPartitionPruningSuiteBase (commit: 95e45c6) — dhyun / githubweb
  9. [SPARK-31891][SQL] Support `MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} (commit: 7f27d33) — dhyun / githubweb
  10. [SPARK-34503][CORE] Use zstd for spark.eventLog.compression.codec by (commit: 2e31e2c) — dhyun / githubweb
  11. [SPARK-26138][SQL] Pushdown limit through InnerLike when condition is (commit: b5afff5) — yumwang / githubweb
  12. [MINOR][DOCS][K8S] Use hadoop-aws 3.2.2 in K8s example (commit: a6dcd55) — gurwls223 / githubweb
  13. Revert "[SPARK-32703][SQL] Replace deprecated API calls from (commit: 80bad08) — gurwls223 / githubweb
  14. [SPARK-34245][CORE] Ensure Master removes executors that failed to send (commit: f542ecd) — wenchen / githubweb
  15. [SPARK-34290][SQL] Support v2 `TRUNCATE TABLE` (commit: f64fc22) — wenchen / githubweb
  16. [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode (commit: 5d9cfd7) — gengliang.wang / githubweb
  17. [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's (commit: 714ff73) — wenchen / githubweb
  18. [SPARK-33599][SQL][FOLLOWUP] Group exception messages in (commit: 14934f4) — wenchen / githubweb
  19. [SPARK-34514][SQL] Push down limit for LEFT SEMI and LEFT ANTI join (commit: 6ef57d3) — wenchen / githubweb
  20. [SPARK-31891][SQL][DOCS][FOLLOWUP] Fix typo in the description of `MSCK (commit: 87409c4) — gurwls223 / githubweb
  21. [SPARK-34515][SQL] Fix NPE if InSet contains null value during (commit: 999d3b8) — wenchen / githubweb
  22. [SPARK-32617][K8S][TESTS] Configure kubernetes client based on (commit: b17754a) — hkarau / githubweb
  23. [SPARK-34497][SQL] Fix built-in JDBC connection providers to restore JVM (commit: 44eadb9) — gurwls223 / githubweb
  24. [SPARK-34531][CORE] Remove Experimental API tag in PrometheusServlet (commit: 22383e3) — dhyun / githubweb
  25. [SPARK-34520][CORE] Remove unused SecurityManager references (commit: 8a1e172) — dhyun / githubweb
  26. [SPARK-34518][SQL] Rename `AlterTableRecoverPartitionsCommand` to (commit: c56af69) — wenchen / githubweb
  27. [SPARK-34436][SQL] DPP support LIKE ANY/ALL expression (commit: 4a3200b) — wenchen / githubweb

#749 (Feb 22, 2021, 12:17:09 PM)

  1. [SPARK-34466][SQL][DOCS] Improve docs for `ALTER TABLE .. RENAME TO` (commit: 4a9a1d4) — wenchen / githubweb
  2. [SPARK-34314][SQL] Fix partitions schema inference (commit: b26e7b5) — wenchen / githubweb
  3. [SPARK-34421][SQL] Resolve temporary functions and views in views with (commit: 27abb6a) — wenchen / githubweb
  4. [SPARK-28123][SQL] String Functions: support btrim (commit: 06df121) — wenchen / githubweb
  5. [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single (commit: 96bcb4b) — wenchen / githubweb
  6. [SPARK-34469][K8S] Ignore RegisterExecutor when SparkContext is stopped (commit: 484a83e) — dhyun / githubweb
  7. [SPARK-24818][CORE] Support delay scheduling for barrier execution (commit: 4dc16f2) — mridulatgmail.com / githubweb
  8. [SPARK-34471][SS][DOCS] Document Streaming Table APIs in Structured (commit: 489d32a) — kabhwan.opensource / githubweb
  9. [SPARK-7768][CORE][SQL] Open UserDefinedType as a Developer API (commit: f78466d) — srowen / githubweb
  10. [SPARK-34379][SQL] Map JDBC RowID to StringType rather than LongType (commit: 82b33a3) — sarutak / githubweb
  11. [SPARK-34481][SQL] Refactor dataframe reader/writer optionsWithPath (commit: 7de49a8) — dhyun / githubweb
  12. [SPARK-20977][CORE] Use a non-final field for the state of (commit: fadd0f5) — srowen / githubweb
  13. [SPARK-34373][SQL] HiveThriftServer2 startWithContext may hang with a (commit: 1fac706) — gurwls223 / githubweb
  14. [SPARK-34360][SQL] Support truncation of v2 tables (commit: 04c3125) — gurwls223 / githubweb
  15. [SPARK-34384][CORE] Add missing docs for ResourceProfile APIs (commit: 546d2eb) — gurwls223 / githubweb
  16. [SPARK-34486][K8S] Upgrade kubernetes-client to 4.13.2 (commit: 020e84e) — gurwls223 / githubweb
  17. [SPARK-34487][K8S][TESTS] Use the runtime Hadoop version in K8s IT (commit: 9942548) — dhyun / githubweb
  18. [SPARK-34129][SQL] Add table name to LogicalRelation.simpleString (commit: 94f9617) — srowen / githubweb
  19. [SPARK-34029][SQL][TESTS] Add OrcEncryptionSuite and FakeKeyProvider (commit: 03f4cf5) — dhyun / githubweb
  20. [SPARK-34401][SQL][DOCS] Update docs about altering cached tables/views (commit: 6ea4b5f) — wenchen / githubweb
  21. [SPARK-34468][SQL] Rename v2 table in place if new name has single part (commit: a22d20a) — wenchen / githubweb
  22. [SPARK-34167][SQL] Reading parquet with IntDecimal written as a (commit: 38fbe56) — wenchen / githubweb
  23. [SPARK-34495][TESTS] Add `DedicatedJVMTest` test tag (commit: 2fb5f21) — gurwls223 / githubweb
  24. [SPARK-34450][SQL][TESTS] Unify v1 and v2 ALTER TABLE .. RENAME tests (commit: 23a5996)