WDescription%
Build stability: 1 out of the last 5 builds failed.80
Test Result: 0 tests failing out of a total of 29,561 tests.100
Build History
x
#3113
(pending—Build #3,112 is already in progress (ETA: 2 hr 40 min))

Changes

#3112 (Dec 2, 2021, 10:25:14 AM)

  1. [SPARK-37442][SQL] InMemoryRelation statistics bug causing broadcast — wenchen / githubweb
  2. [SPARK-37450][SQL] Prune unnecessary fields from Generate — viirya / githubweb

#3111 (Dec 2, 2021, 3:24:39 AM)

  1. [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` — wenchen / githubweb
  2. [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add — mridulatgmail.com / githubweb
  3. [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ — wenchen / githubweb
  4. [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when — gurwls223 / githubweb
  5. [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from — gurwls223 / githubweb

#3110 (Dec 1, 2021, 8:07:55 PM)

  1. [SPARK-37496][SQL] Migrate ReplaceTableAsSelectStatement to v2 command — huaxin_gao / githubweb
  2. [SPARK-37514][PYTHON] Remove workarounds due to older pandas — gurwls223 / githubweb

#3109 (Dec 1, 2021, 12:57:58 PM)

  1. [SPARK-37326][SQL][FOLLOWUP] Fix the test for Java 11 — dongjoon / githubweb

#3108 (Dec 1, 2021, 9:17:50 AM)

  1. [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 — wenchen / githubweb

#3107 (Dec 1, 2021, 5:35:37 AM)

  1. [SPARK-37480][K8S][DOC] Sync Kubernetes configuration to latest in — dongjoon / githubweb
  2. [SPARK-37326][SQL] Support TimestampNTZ in CSV data source — max.gekk / githubweb
  3. [SPARK-37458][SS] Remove unnecessary SerializeFromObject from the plan — dongjoon / githubweb
  4. [SPARK-37513][SQL][DOC] date +/- interval with only day-time fields — wenchen / githubweb
  5. [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments — wenchen / githubweb
  6. [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark — gurwls223 / githubweb
  7. [SPARK-37508][SQL] Add CONTAINS() string function — max.gekk / githubweb
  8. [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION — wenchen / githubweb

#3106 (Nov 30, 2021, 10:21:32 PM)

  1. [SPARK-37509][CORE] Improve Fallback Storage upload speed by avoiding S3 — dongjoon / githubweb
  2. [SPARK-37497][K8S] Promote — dongjoon / githubweb
  3. [SPARK-37490][SQL] Show extra hint if analyzer fails due to ANSI type — gengliang / githubweb
  4. [SPARK-37376][SQL] Introduce a new DataSource V2 interface — dongjoon / githubweb

#3105 (Nov 30, 2021, 2:42:32 PM)

  1. [SPARK-37505][MESOS][TESTS] Add a log4j.properties for `mesos` module UT — dongjoon / githubweb

#3104 (Nov 30, 2021, 3:44:31 AM)

  1. [SPARK-36850][SQL] Migrate CreateTableStatement to v2 command framework — wenchen / githubweb
  2. [SPARK-37492][SQL] Optimize Orc test code with withAllNativeOrcReaders — dongjoon / githubweb
  3. [SPARK-37465][PYTHON] Bump minimum pandas version to 1.0.5 — gurwls223 / githubweb
  4. [SPARK-37489][PYTHON] Skip hasnans check in numops if eager_check — gurwls223 / githubweb
  5. [SPARK-37291][PYSPARK][FOLLOWUP] PySpark create SparkSession should pass — gurwls223 / githubweb
  6. [SPARK-36396][PYTHON] Implement DataFrame.cov — gurwls223 / githubweb
  7. [MINOR][DOC] Update doc for `ResourceProfileManager.isSupported` — gurwls223 / githubweb

#3103 (Nov 29, 2021, 8:35:32 PM)

  1. [SPARK-37454][SQL][FOLLOWUP] Time travel timestamp expression should — gurwls223 / githubweb
  2. [SPARK-37485][CORE][SQL] Replace `map` with expressions which produce no — gurwls223 / githubweb
  3. [SPARK-37484][CORE][SQL] Replace `get` and `getOrElse` with `getOrElse` — gurwls223 / githubweb
  4. [SPARK-37482][PYTHON] Skip check monotonic increasing for Series.asof — gurwls223 / githubweb
  5. [SPARK-35867][SQL] Enable vectorized read for — sunchao / githubweb

#3102 (Nov 29, 2021, 1:20:26 PM)

  1. [SPARK-36346][SQL][FOLLOWUP] Rename `withAllOrcReaders` to — dongjoon / githubweb
  2. [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for — max.gekk / githubweb

#3101 (Nov 29, 2021, 6:11:41 AM)

  1. [SPARK-37447][SQL] Cache LogicalPlan.isStreaming() result in a lazy val — wenchen / githubweb
  2. [SPARK-37452][SQL] Char and Varchar break backward compatibility between — yao / githubweb
  3. [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of — wenchen / githubweb
  4. [SPARK-33875][SQL][FOLLOWUP] Handle the char/varchar column for — wenchen / githubweb

#3100 (Nov 28, 2021, 10:18:35 PM)

  1. [SPARK-37443][PYTHON] Provide a profiler for Python/Pandas UDFs — gurwls223 / githubweb
  2. [SPARK-37319][K8S][FOLLOWUP] Set JAVA_HOME for Java 17 installed by — dongjoon / githubweb

#3099 (Nov 28, 2021, 7:17:26 AM)

  1. [SPARK-37461][YARN] YARN-CLIENT mode client.appId is always null — srowen / githubweb

#3098 (Nov 27, 2021, 7:13:23 AM)

  1. [SPARK-37437][BUILD] Remove unused hive profile and related CI test — srowen / githubweb

#3097 (Nov 26, 2021, 6:19:34 AM)

  1. [SPARK-34735][SQL][UI] Add modified configs for SQL execution in UI — gengliang / githubweb

#3096 (Nov 25, 2021, 11:12:31 PM)

  1. Revert "[SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to — gurwls223 / githubweb
  2. [SPARK-37436][PYTHON] Uses Python's standard string formatter for SQL — gurwls223 / githubweb
  3. [SPARK-37457][PYTHON] Update cloudpickle to v2.0.0 — gurwls223 / githubweb

#3095 (Nov 25, 2021, 4:08:41 PM)

  1. [SPARK-32079][PYTHON] Remove namedtuple hack by replacing built-in — gurwls223 / githubweb

#3094 (Nov 25, 2021, 8:59:56 AM)

  1. [SPARK-37311][SQL] Migrate ALTER NAMESPACE ... SET LOCATION to use V2 — wenchen / githubweb
  2. [SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to hadoop-3 and — wenchen / githubweb

#3093 (Nov 25, 2021, 1:57:17 AM)

  1. [SPARK-37459][BUILD] Upgrade commons-cli to 1.5.0 — gurwls223 / githubweb
  2. [SPARK-37456][SQL] CREATE NAMESPACE should qualify location for v2 — wenchen / githubweb
  3. [SPARK-34332][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET LOCATION — wenchen / githubweb
  4. [SPARK-36861][SQL] Use `yyyy-MM-dd` as the date pattern in partition — wenchen / githubweb
  5. [SPARK-37454][SQL] Support expressions in time travel timestamp — wenchen / githubweb
  6. [SPARK-37357][SQL] Add small partition factor for rebalance partitions — wenchen / githubweb

#3092 (Nov 24, 2021, 6:12:21 PM)

  1. [MINOR][SQL] Fix the error message typo in QueryExecutionErrors.scala — gurwls223 / githubweb
  2. [SPARK-37453][INFRA][SQL][TESTS] Split TPC-DS build in GitHub Actions — gurwls223 / githubweb
  3. [SPARK-37446][SQL] Use reflection for getWithoutRegisterFns to allow — gurwls223 / githubweb

#3091 (Nov 24, 2021, 10:55:42 AM)

  1. [MINOR][DOCS] Update scaladoc of KnownSizeEstimation — srowen / githubweb
  2. [SPARK-37444][SQL] ALTER NAMESPACE ... SET LOCATION should handle empty — wenchen / githubweb

#3090 (Nov 24, 2021, 3:40:02 AM)

  1. [SPARK-37389][SQL] Check unclosed bracketed comments — wenchen / githubweb
  2. [MINOR][DOCS] Fix scaladoc for skewed partitions optimization — wenchen / githubweb
  3. [SPARK-37399][SPARK-37403][PYSPARK][ML] Merge {ml, mllib}/common.pyi — mszymkiewicz / githubweb

#3089 (Nov 23, 2021, 8:37:35 PM)

  1. [SPARK-37380][PYTHON] Miscellaneous Python lint infra cleanup — gurwls223 / githubweb

#3088 (Nov 23, 2021, 1:18:43 PM)

  1. [SPARK-37013][CORE][SQL][FOLLOWUP] Use the new error framework to throw — wenchen / githubweb

#3087 (Nov 23, 2021, 6:14:51 AM)

  1. [SPARK-36231][PYTHON] Support arithmetic operations of decimal(nan) — gurwls223 / githubweb

#3086 (Nov 22, 2021, 11:00:58 PM)

  1. [SPARK-30537][PYTHON] Fix toPandas  wrong dtypes when applied on empty — gurwls223 / githubweb
  2. [SPARK-37438][SQL] ANSI mode: Use store assignment rules for resolving — gengliang / githubweb

#3085 (Nov 22, 2021, 3:55:22 PM)

  1. [SPARK-37337][PYTHON] Improve the API of Spark DataFrame to — gurwls223 / githubweb

#3084 (Nov 22, 2021, 8:18:38 AM)

  1. [MINOR][R][DOCS] Fix misplaced brackets in SparkR:::mapValues doc — mszymkiewicz / githubweb
  2. [SPARK-36357][SQL] Support pushdown Timestamp without time zone for orc — wenchen / githubweb
  3. [SPARK-37192][SQL] Migrate SHOW TBLPROPERTIES to use V2 command by — wenchen / githubweb

#3083 (Nov 22, 2021, 1:13:00 AM)

  1. Revert "[SPARK-36231][PYTHON] Support arithmetic operations of — gurwls223 / githubweb
  2. [SPARK-37354][K8S][TESTS] Make the Java version installed on the — sarutak / githubweb
  3. [SPARK-37388][SQL] Fix NPE in WidthBucket in WholeStageCodegenExec — wenchen / githubweb

#3082 (Nov 21, 2021, 5:52:44 PM)

  1. [SPARK-37209][YARN][TESTS] Fix `YarnShuffleIntegrationSuite` releated — srowen / githubweb

#3081 (Nov 21, 2021, 7:50:12 AM)

  1. [SPARK-37104][PYTHON] Make RDD and DStream covariant — mszymkiewicz / githubweb

#3080 (Nov 20, 2021, 2:47:09 AM)

  1. [SPARK-37390][PYTHON][DOCS] Add default value to getattr(app, — mszymkiewicz / githubweb

#3079 (Nov 19, 2021, 7:14:08 PM)

  1. [SPARK-36997][PYTHON][TESTS] Run mypy tests against ml, sql, streaming — mszymkiewicz / githubweb
  2. [SPARK-37379][SQL] Add tree pattern pruning to CTESubstitution rule — joshrosen / githubweb
  3. [SPARK-37282][TESTS][FOLLOWUP] Extract `Utils.isMacOnAppleSilicon` for — dongjoon / githubweb

#3078 (Nov 19, 2021, 11:56:10 AM)

  1. [SPARK-37385][SQL][TESTS] Add tests for TimestampNTZ and TimestampLTZ — wenchen / githubweb
  2. [SPARK-37224][SS][FOLLOWUP] Add benchmark on basic state store — viirya / githubweb

#3077 (Nov 19, 2021, 4:44:39 AM)

  1. [SPARK-37384][CORE][TESTS] Increase timeout for job termination in — gurwls223 / githubweb
  2. [SPARK-37386][SQL] Simplify OptimizeSkewedJoin to not run the cost — wenchen / githubweb
  3. [SPARK-35672][FOLLOWUP][TESTS] Add more exclusion rules to — sarutak / githubweb

#3076 (Nov 18, 2021, 9:34:59 PM)

  1. [SPARK-37219][SQL][FOLLOWUP] Make AS OF syntax more flexible — huaxin_gao / githubweb
  2. [MINOR][R][DOCS] Fix minor issues in SparkR docs examples — gurwls223 / githubweb
  3. [SPARK-37336][ML][PYTHON] Migrate _java2py from SQLContext to — gurwls223 / githubweb
  4. [SPARK-37224][SS][FOLLOWUP] Clarify the guide doc and fix the method doc — kabhwan.opensource / githubweb
  5. [SPARK-37374][PYTHON] Fix StatCounter to use mergeStats when merging — gurwls223 / githubweb
  6. [SPARK-37371][SQL] UnionExec should support columnar if all children — viirya / githubweb
  7. [SPARK-37370][SQL] Add SQL configs to control newly added join code-gen — wenchen / githubweb
  8. [SPARK-35672][FOLLOWUP][TESTS] Add an exclusion rule to — dongjoon / githubweb
  9. [SPARK-37038][SQL][TESTS][FOLLOWUP] Fix flaky test by loosening the — gurwls223 / githubweb

#3075 (Nov 18, 2021, 2:15:30 PM)

  1. [SPARK-37356][CORE] Add fine grained locking to the BlockInfoManager — herman / githubweb