WDescription%
Build stability: 2 out of the last 5 builds failed.60
Test Result: 190 tests failing out of a total of 28,601 tests.99
Build History
x

Changes

#3074 (Oct 19, 2021, 4:10:31 AM)

  1. [SPARK-36871][SQL][FOLLOWUP] Move error checking from create cmd to — wenchen / githubweb
  2. [SPARK-37052][CORE] Spark should only pass --verbose argument to main — wenchen / githubweb
  3. [SPARK-37017][SQL] Reduce the scope of synchronized to prevent potential — wenchen / githubweb
  4. [SPARK-37057][INFRA] Fix wrong DocSearch facet filter in release-tag.sh — gengliang / githubweb

#3073 (Oct 18, 2021, 9:49:30 PM)

  1. [SPARK-36945][PYTHON] Inline type hints for python/pyspark/sql/udf.py — ueshin / githubweb
  2. [SPARK-36834][SHUFFLE] Add support for namespacing log lines emitted by — mridulatgmail.com / githubweb

#3072 (Oct 18, 2021, 3:13:14 PM)

  1. [SPARK-36886][PYTHON] Inline type hints for — ueshin / githubweb
  2. [SPARK-36933][CORE] Clean up TaskMemoryManager.acquireExecutionMemory() — joshrosen / githubweb

#3071 (Oct 18, 2021, 8:12:18 AM)

  1. [SPARK-36978][SQL] InferConstraints rule should create IsNotNull — wenchen / githubweb
  2. [SPARK-36965][PYTHON] Extend python test runner by logging out the temp — piros.attila.zsolt / githubweb
  3. [SPARK-35925][SQL] Support DayTimeIntervalType in width-bucket function — max.gekk / githubweb

#3070 (Oct 18, 2021, 1:15:07 AM)

  1. [SPARK-36151][INFRA] MiMa updates after 3.2.0 release: bump — gurwls223 / githubweb
  2. [SPARK-37032][SQL] Fix broken SQL syntax link in SQL Reference page — wenchen / githubweb

#3069 (Oct 17, 2021, 6:32:04 PM)

  1. [SPARK-37026][ML][BUILD] Ensure the element type of — gurwls223 / githubweb

#3068 (Oct 16, 2021, 2:08:43 PM)

  1. [SPARK-37008][SQL][TEST] Replace `UseCompressedOops` with — srowen / githubweb
  2. [SPARK-36992][SQL] Improve byte array sort perf by unify getPrefix — srowen / githubweb

#3067 (Oct 16, 2021, 7:27:44 AM)

  1. [SPARK-36915][INFRA] Pin actions to a full length commit SHA — srowen / githubweb
  2. [SPARK-36900][SPARK-36464][CORE][TEST] Refactor `: size returns correct — srowen / githubweb

#3066 (Oct 16, 2021, 1:37:21 AM)

  1. [SPARK-36276][BUILD][FOLLOWUP] Match the version of SBT's checkstyle — gurwls223 / githubweb
  2. [SPARK-36230][SPARK-36232][PYTHON] Add regression for hasnan of — gurwls223 / githubweb

#3065 (Oct 15, 2021, 12:25:23 PM)

  1. [SPARK-36991][PYTHON] Inline type hints for — ueshin / githubweb
  2. [SPARK-36910][PYTHON] Inline type hints for python/pyspark/sql/types.py — ueshin / githubweb

#3064 (Oct 15, 2021, 7:21:32 AM)

  1. [SPARK-35926][SQL] Add support YearMonthIntervalType for width_bucket — max.gekk / githubweb

#3063 (Oct 14, 2021, 11:33:35 PM)

  1. [SPARK-36980][SQL] Insert support query with CTE — wenchen / githubweb

#3062 (Oct 14, 2021, 8:11:21 PM)

  1. [SPARK-36337][PYTHON][CORE] Switch pyrolite v4.30 to pickle v1.2 to fix — gurwls223 / githubweb

#3061 (Oct 14, 2021, 7:21:57 PM)

  1. [SPARK-37010][PYTHON] Remove unnecessary "noqa: F401" comments in — gurwls223 / githubweb

#3060 (Oct 14, 2021, 5:22:13 PM)

  1. [SPARK-36942][PYTHON] Inline type hints for — ueshin / githubweb

#3059 (Oct 14, 2021, 2:37:12 PM)

  1. [SPARK-23626][CORE] Eagerly compute RDD.partitions on entire DAG when — joshrosen / githubweb

#3058 (Oct 14, 2021, 12:07:09 PM)

  1. [SPARK-37000][PYTHON] Add type hints to python/pyspark/sql/util.py — ueshin / githubweb

#3057 (Oct 14, 2021, 11:18:42 AM)

  1. [SPARK-36938][PYTHON] Inline type hints for group.py in — ueshin / githubweb

#3056 (Oct 14, 2021, 7:23:45 AM)

  1. [SPARK-37003][DOC] Merge INSERT related doc into two part: 1. table 2. — wenchen / githubweb
  2. [SPARK-36905] Fix reading hive views without explicit column names — wenchen / githubweb

#3055 (Oct 14, 2021, 3:20:19 AM)

  1. [SPARK-37001][SQL] Disable two level of map for final hash aggregation — wenchen / githubweb

#3054 (Oct 14, 2021, 2:18:28 AM)

  1. [SPARK-36632][SQL] DivideYMInterval and DivideDTInterval should throw — wenchen / githubweb
  2. [SPARK-12567][SQL] Add aes_encrypt and aes_decrypt builtin functions — wenchen / githubweb

#3053 (Oct 14, 2021, 1:16:27 AM)

  1. [SPARK-32161][PYTHON] Removing JVM logs from SparkUpgradeException — gurwls223 / githubweb
  2. [SPARK-36946][PYTHON] Support time for ps.to_datetime — gurwls223 / githubweb

#3052 (Oct 14, 2021, 12:18:21 AM)

  1. [SPARK-36059][K8S] Support `spark.kubernetes.driver.scheduler.name` — dongjoon / githubweb

#3051 (Oct 13, 2021, 11:16:50 PM)

  1. [SPARK-36922][SQL] The SIGN/SIGNUM functions should support ANSI — sarutak / githubweb

#3050 (Oct 13, 2021, 10:17:54 PM)

  1. [SPARK-35973][SQL] Add command `SHOW CATALOGS` — wenchen / githubweb

#3049 (Oct 13, 2021, 8:05:34 PM)

  1. [SPARK-36868][SQL][FOLLOWUP] Move parsing Create Function from catalyst — wenchen / githubweb

#3048 (Oct 13, 2021, 7:15:18 PM)

  1. [SPARK-36546][SQL] Add array support to union by name — viirya / githubweb

#3047 (Oct 13, 2021, 12:14:40 PM)

  1. [SPARK-36982] Migrate SHOW NAMESPACES to use V2 command by default — max.gekk / githubweb

#3046 (Oct 13, 2021, 10:14:05 AM)

  1. [SPARK-36993][SQL] Fix json_tuple throw NPE if fields exist no foldable — max.gekk / githubweb
  2. [SPARK-36949][SQL] Disallow Hive provider tables with ANSI intervals — max.gekk / githubweb

#3045 (Oct 13, 2021, 7:24:19 AM)

  1. [SPARK-36871][SQL] Migrate CreateViewStatement to v2 command — wenchen / githubweb

#3044 (Oct 13, 2021, 5:16:23 AM)

  1. [SPARK-36921][SQL] Support ANSI intervals by `DIV` — max.gekk / githubweb

#3043 (Oct 13, 2021, 2:34:35 AM)

  1. [SPARK-36438][PYTHON] Support list-like Python objects for Series — gurwls223 / githubweb
  2. [SPARK-36972][PYTHON][FOLLOW-UP] Remove since annotation from — gurwls223 / githubweb

#3042 (Oct 13, 2021, 12:17:30 AM)

  1. [SPARK-36973][PYTHON] Deduplicate prepare data method for — gurwls223 / githubweb

#3041 (Oct 12, 2021, 11:27:37 PM)

  1. [SPARK-36976][R] Add max_by/min_by API to SparkR — gurwls223 / githubweb

#3040 (Oct 12, 2021, 10:08:48 PM)

  1. [SPARK-36953][PYTHON] Expose SQL state and error class in PySpark — gurwls223 / githubweb

#3039 (Oct 12, 2021, 9:12:26 PM)

  1. [SPARK-36794][SQL] Ignore duplicated join keys when building relation — wenchen / githubweb

#3038 (Oct 12, 2021, 8:14:23 PM)

  1. Revert "[SPARK-36900][BUILD][TESTS][FOLLOWUP] Try 5g, not 6g, for test — gurwls223 / githubweb
  2. Revert "[SPARK-36900][TESTS][BUILD] Increase test memory to 6g for Java — gurwls223 / githubweb

#3037 (Oct 12, 2021, 7:01:16 PM)

  1. [SPARK-36985][PYTHON] Fix future typing errors in pyspark.pandas — gurwls223 / githubweb

#3036 (Oct 12, 2021, 6:14:15 PM)

  1. [SPARK-36961][PYTHON] Use PEP526 style variable type hints — gurwls223 / githubweb

#3035 (Oct 12, 2021, 5:19:50 PM)

  1. [SPARK-36981][BUILD] Upgrade joda-time to 2.10.12 — sarutak / githubweb

#3034 (Oct 12, 2021, 2:10:54 PM)

  1. [SPARK-36951][PYTHON] Inline type hints for python/pyspark/sql/column.py — ueshin / githubweb

#3033 (Oct 12, 2021, 10:14:33 AM)

  1. [SPARK-36970][SQL] Manual disabled format `B` of `date_format` function — max.gekk / githubweb

#3032 (Oct 12, 2021, 8:12:26 AM)

  1. [SPARK-36914][SQL] Implement dropIndex and listIndexes in JDBC (MySQL — wenchen / githubweb
  2. [SPARK-36867][SQL] Fix error message with GROUP BY alias — wenchen / githubweb

#3031 (Oct 12, 2021, 5:09:51 AM)

  1. [SPARK-36972][PYTHON] Add max_by/min_by API to PySpark — sarutak / githubweb

#3030 (Oct 12, 2021, 1:24:56 AM)

  1. [SPARK-36979][SQL] Add RewriteLateralSubquery rule into — wenchen / githubweb

#3029 (Oct 11, 2021, 11:51:13 PM)

  1. [SPARK-36977][DOCS][PYTHON] Drop references to Python 3.6 support in — gurwls223 / githubweb
  2. [SPARK-36900][BUILD][TESTS][FOLLOWUP] Try 5g, not 6g, for test mem limit — gurwls223 / githubweb

#3028 (Oct 11, 2021, 5:20:36 PM)

  1. [SPARK-36885][PYTHON] Inline type hints for pyspark.sql.dataframe — gurwls223 / githubweb

#3027 (Oct 11, 2021, 9:38:14 AM)

  1. [SPARK-35531][SQL] Directly pass hive Table to HiveClient when call — wenchen / githubweb
  2. [SPARK-36588] Migrate SHOW TABLES to use V2 command by default — wenchen / githubweb
  3. [SPARK-36540][YARN] YARN-CLIENT mode should check Shutdown message when — tgraves / githubweb

#3026 (Oct 11, 2021, 2:48:07 AM)

  1. [SPARK-36943][SQL] Improve readability of missing column error message — wenchen / githubweb
  2. [SPARK-36645][SQL] Aggregate (Min/Max/Count) push down for Parquet — viirya / githubweb
  3. [SPARK-36849][SQL] Migrate UseStatement to v2 command framework — wenchen / githubweb
  4. [SPARK-36876][SQL] Support Dynamic Partition pruning for — wenchen / githubweb
  5. Revert "[SPARK-36794][SQL] Ignore duplicated join keys when building — wenchen / githubweb

#3025 (Oct 10, 2021, 7:58:09 PM)

  1. [SPARK-36963][SQL] Add max_by/min_by to sql.functions — gurwls223 / githubweb

#3024 (Oct 10, 2021, 4:12:20 PM)

  1. [SPARK-36900][TESTS][BUILD] Increase test memory to 6g for Java 11 — srowen / githubweb

#3023 (Oct 9, 2021, 6:59:22 AM)

  1. [SPARK-36804][YARN] Support --verbose option in YARN mode — srowen / githubweb
  2. [SPARK-36960][SQL] Pushdown filters with ANSI interval values to ORC — max.gekk / githubweb

#3022 (Oct 8, 2021, 11:48:28 PM)

  1. [SPARK-36839][INFRA][FOLLOW-UP] Respect Hadoop version configured in — gurwls223 / githubweb

#3021 (Oct 8, 2021, 11:01:57 PM)

  1. [SPARK-36897][PYTHON] Use NamedTuple with variable type hints instead of — gurwls223 / githubweb

#3020 (Oct 8, 2021, 6:55:36 PM)

  1. [SPARK-36944][PYTHON] Remove python/pyspark/sql/__init__.pyi — mszymkiewicz / githubweb

#3019 (Oct 8, 2021, 11:55:19 AM)

  1. [SPARK-36913][SQL] Implement createIndex and IndexExists in DS V2 JDBC — viirya / githubweb

#3018 (Oct 8, 2021, 5:57:12 AM)

  1. [SPARK-36717][CORE] Incorrect order of variable initialization may lead — srowen / githubweb

#3017 (Oct 8, 2021, 5:10:07 AM)

  1. [SPARK-36929][SQL] Remove Unused Method — srowen / githubweb

#3016 (Oct 8, 2021, 2:54:32 AM)

  1. [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command — wenchen / githubweb

#3015 (Oct 8, 2021, 12:53:01 AM)

  1. [SPARK-36948][SQL][TESTS] Check CREATE TABLE with ANSI intervals using — max.gekk / githubweb
  2. [SPARK-36931][SQL] Support reading and writing ANSI intervals from/to — max.gekk / githubweb

#3014 (Oct 7, 2021, 5:53:39 PM)

  1. [SPARK-36839][INFRA][FOLLOW-UP] Add Hadoop 2 daily job into schedule — gurwls223 / githubweb

#3013 (Oct 7, 2021, 5:06:24 PM)

  1. [SPARK-29871][ML] Catch all exceptions for handling invalid images in — gurwls223 / githubweb

#3012 (Oct 7, 2021, 11:52:25 AM)

  1. [SPARK-36940][PYTHON] Inline type hints for — ueshin / githubweb

#3011 (Oct 7, 2021, 6:50:13 AM)

  1. [SPARK-36798][CORE] Wait for listeners to finish before flushing metrics — mridulatgmail.com / githubweb

#3010 (Oct 7, 2021, 2:51:24 AM)

  1. [SPARK-36713][PYTHON][DOCS] Document new syntax of type hints with index — gurwls223 / githubweb

#3009 (Oct 7, 2021, 1:07:55 AM)

  1. [SPARK-36930][PYTHON][FOLLOW-UP] Fix test case for MultiIndex.dtypes — gurwls223 / githubweb
  2. [SPARK-36711][PYTHON][FOLLOW-UP] Skip docs tests having — gurwls223 / githubweb
  3. [MINOR][TEST] GzipCodec should be set with Configuration before using — gurwls223 / githubweb

#3008 (Oct 6, 2021, 11:49:23 PM)

  1. [SPARK-36941][SQL][TESTS] Check saving/loading of ANSI intervals to Hive — max.gekk / githubweb

#3007 (Oct 6, 2021, 8:49:02 PM)

  1. [SPARK-36742][PYTHON] Fix ps.to_datetime with plurals of keys like — gurwls223 / githubweb

#3006 (Oct 6, 2021, 7:50:57 PM)

  1. [SPARK-36884][PYTHON] Inline type hints for pyspark.sql.session — gurwls223 / githubweb
  2. [SPARK-36918][SQL] Ignore types when comparing structs for unionByName — viirya / githubweb

#3005 (Oct 6, 2021, 6:05:55 PM)

  1. [SPARK-36939][PYTHON][DOCS] Add orphan migration page into list in — gurwls223 / githubweb

#3004 (Oct 6, 2021, 12:02:29 PM)

  1. [SPARK-36937][SQL][TESTS] Change OrcSourceSuite to test both V1 and V2 — max.gekk / githubweb

#3003 (Oct 6, 2021, 9:01:42 AM)

  1. [SPARK-36751][PYTHON][DOCS][FOLLOW-UP] Fix unexpected section title for — sarutak / githubweb

#3002 (Oct 6, 2021, 3:45:54 AM)

  1. [SPARK-36927][PYTHON] Inline type hints for python/pyspark/sql/window.py — gurwls223 / githubweb
  2. [SPARK-36919][SQL] Make BadRecordException fields transient — gurwls223 / githubweb

#3001 (Oct 6, 2021, 12:45:51 AM)

  1. [SPARK-36892][CORE] Disable batch fetch for a shuffle when push based — gengliang / githubweb

#3000 (Oct 5, 2021, 11:44:36 PM)

  1. [SPARK-36930][PYTHON] Support ps.MultiIndex.dtypes — gurwls223 / githubweb

#2999 (Oct 5, 2021, 4:45:03 PM)

  1. [SPARK-36711][PYTHON][FOLLOW-UP] Refactor typing logic for multi-index — gurwls223 / githubweb

#2998 (Oct 5, 2021, 10:42:32 AM)

  1. [SPARK-36705][FOLLOW-UP] Support the case when user's classes need to — mridulatgmail.com / githubweb

#2997 (Oct 5, 2021, 5:41:57 AM)

  1. [SPARK-36920][SQL][FOLLOWUP] Fix input types of `ABS()`: numeric and — max.gekk / githubweb