WDescription%
Build stability: 1 out of the last 5 builds failed.80
Test Result: 0 tests failing out of a total of 29,559 tests.100
Build History
x
#3225
(pending—Build #3,224 is already in progress (ETA: 3 hr 11 min))

Changes

#3224 (Dec 2, 2021, 9:43:29 AM)

  1. [SPARK-37442][SQL] InMemoryRelation statistics bug causing broadcast — wenchen / githubweb
  2. [SPARK-37450][SQL] Prune unnecessary fields from Generate — viirya / githubweb

#3223 (Dec 2, 2021, 2:45:52 AM)

  1. [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` — wenchen / githubweb
  2. [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add — mridulatgmail.com / githubweb
  3. [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ — wenchen / githubweb
  4. [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when — gurwls223 / githubweb
  5. [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from — gurwls223 / githubweb

#3222 (Dec 1, 2021, 8:05:55 PM)

  1. [SPARK-37496][SQL] Migrate ReplaceTableAsSelectStatement to v2 command — huaxin_gao / githubweb
  2. [SPARK-37514][PYTHON] Remove workarounds due to older pandas — gurwls223 / githubweb

#3221 (Dec 1, 2021, 1:20:34 PM)

  1. [SPARK-37326][SQL][FOLLOWUP] Fix the test for Java 11 — dongjoon / githubweb

#3220 (Dec 1, 2021, 9:43:19 AM)

  1. [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 — wenchen / githubweb

#3219 (Dec 1, 2021, 6:03:31 AM)

  1. [SPARK-37480][K8S][DOC] Sync Kubernetes configuration to latest in — dongjoon / githubweb
  2. [SPARK-37326][SQL] Support TimestampNTZ in CSV data source — max.gekk / githubweb
  3. [SPARK-37458][SS] Remove unnecessary SerializeFromObject from the plan — dongjoon / githubweb
  4. [SPARK-37513][SQL][DOC] date +/- interval with only day-time fields — wenchen / githubweb
  5. [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments — wenchen / githubweb
  6. [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark — gurwls223 / githubweb
  7. [SPARK-37508][SQL] Add CONTAINS() string function — max.gekk / githubweb
  8. [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION — wenchen / githubweb

#3218 (Nov 30, 2021, 10:03:01 PM)

  1. [SPARK-37497][K8S] Promote — dongjoon / githubweb
  2. [SPARK-37490][SQL] Show extra hint if analyzer fails due to ANSI type — gengliang / githubweb
  3. [SPARK-37376][SQL] Introduce a new DataSource V2 interface — dongjoon / githubweb

#3217 (Nov 30, 2021, 4:07:02 PM)

  1. [SPARK-37505][MESOS][TESTS] Add a log4j.properties for `mesos` module UT — dongjoon / githubweb
  2. [SPARK-37509][CORE] Improve Fallback Storage upload speed by avoiding S3 — dongjoon / githubweb

#3216 (Nov 30, 2021, 9:57:08 AM)

  1. [MINOR][DOC] Update doc for `ResourceProfileManager.isSupported` — gurwls223 / githubweb

#3215 (Nov 30, 2021, 2:39:31 AM)

  1. [SPARK-35867][SQL] Enable vectorized read for — sunchao / githubweb
  2. [SPARK-36850][SQL] Migrate CreateTableStatement to v2 command framework — wenchen / githubweb
  3. [SPARK-37492][SQL] Optimize Orc test code with withAllNativeOrcReaders — dongjoon / githubweb
  4. [SPARK-37465][PYTHON] Bump minimum pandas version to 1.0.5 — gurwls223 / githubweb
  5. [SPARK-37489][PYTHON] Skip hasnans check in numops if eager_check — gurwls223 / githubweb
  6. [SPARK-37291][PYSPARK][FOLLOWUP] PySpark create SparkSession should pass — gurwls223 / githubweb
  7. [SPARK-36396][PYTHON] Implement DataFrame.cov — gurwls223 / githubweb

#3214 (Nov 29, 2021, 7:12:55 PM)

  1. [SPARK-37454][SQL][FOLLOWUP] Time travel timestamp expression should — gurwls223 / githubweb
  2. [SPARK-37485][CORE][SQL] Replace `map` with expressions which produce no — gurwls223 / githubweb
  3. [SPARK-37484][CORE][SQL] Replace `get` and `getOrElse` with `getOrElse` — gurwls223 / githubweb
  4. [SPARK-37482][PYTHON] Skip check monotonic increasing for Series.asof — gurwls223 / githubweb

#3213 (Nov 29, 2021, 12:21:42 PM)

  1. [SPARK-36346][SQL][FOLLOWUP] Rename `withAllOrcReaders` to — dongjoon / githubweb
  2. [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for — max.gekk / githubweb

#3212 (Nov 29, 2021, 5:14:59 AM)

  1. [SPARK-37447][SQL] Cache LogicalPlan.isStreaming() result in a lazy val — wenchen / githubweb
  2. [SPARK-37452][SQL] Char and Varchar break backward compatibility between — yao / githubweb
  3. [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of — wenchen / githubweb
  4. [SPARK-33875][SQL][FOLLOWUP] Handle the char/varchar column for — wenchen / githubweb

#3211 (Nov 28, 2021, 10:18:37 PM)

  1. [SPARK-37443][PYTHON] Provide a profiler for Python/Pandas UDFs — gurwls223 / githubweb
  2. [SPARK-37319][K8S][FOLLOWUP] Set JAVA_HOME for Java 17 installed by — dongjoon / githubweb

#3210 (Nov 28, 2021, 7:17:26 AM)

  1. [SPARK-37461][YARN] YARN-CLIENT mode client.appId is always null — srowen / githubweb

#3209 (Nov 27, 2021, 7:13:23 AM)

  1. [SPARK-37437][BUILD] Remove unused hive profile and related CI test — srowen / githubweb

#3208 (Nov 26, 2021, 5:09:03 AM)

  1. [SPARK-34735][SQL][UI] Add modified configs for SQL execution in UI — gengliang / githubweb

#3207 (Nov 25, 2021, 10:02:57 PM)

  1. Revert "[SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to — gurwls223 / githubweb
  2. [SPARK-37436][PYTHON] Uses Python's standard string formatter for SQL — gurwls223 / githubweb
  3. [SPARK-37457][PYTHON] Update cloudpickle to v2.0.0 — gurwls223 / githubweb

#3206 (Nov 25, 2021, 3:22:15 PM)

  1. [SPARK-32079][PYTHON] Remove namedtuple hack by replacing built-in — gurwls223 / githubweb

#3205 (Nov 25, 2021, 4:59:52 AM)

  1. [SPARK-37459][BUILD] Upgrade commons-cli to 1.5.0 — gurwls223 / githubweb
  2. [SPARK-37456][SQL] CREATE NAMESPACE should qualify location for v2 — wenchen / githubweb
  3. [SPARK-34332][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET LOCATION — wenchen / githubweb
  4. [SPARK-36861][SQL] Use `yyyy-MM-dd` as the date pattern in partition — wenchen / githubweb
  5. [SPARK-37454][SQL] Support expressions in time travel timestamp — wenchen / githubweb
  6. [SPARK-37357][SQL] Add small partition factor for rebalance partitions — wenchen / githubweb
  7. [SPARK-37311][SQL] Migrate ALTER NAMESPACE ... SET LOCATION to use V2 — wenchen / githubweb
  8. [SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to hadoop-3 and — wenchen / githubweb

#3204 (Nov 24, 2021, 9:58:12 PM)

  1. [MINOR][SQL] Fix the error message typo in QueryExecutionErrors.scala — gurwls223 / githubweb
  2. [SPARK-37453][INFRA][SQL][TESTS] Split TPC-DS build in GitHub Actions — gurwls223 / githubweb
  3. [SPARK-37446][SQL] Use reflection for getWithoutRegisterFns to allow — gurwls223 / githubweb

#3203 (Nov 24, 2021, 3:21:24 PM)

  1. [SPARK-37444][SQL] ALTER NAMESPACE ... SET LOCATION should handle empty — wenchen / githubweb

#3202 (Nov 24, 2021, 8:26:11 AM)

  1. [SPARK-37399][SPARK-37403][PYSPARK][ML] Merge {ml, mllib}/common.pyi — mszymkiewicz / githubweb
  2. [MINOR][DOCS] Update scaladoc of KnownSizeEstimation — srowen / githubweb

#3201 (Nov 24, 2021, 1:35:13 AM)

  1. [SPARK-37389][SQL] Check unclosed bracketed comments — wenchen / githubweb
  2. [MINOR][DOCS] Fix scaladoc for skewed partitions optimization — wenchen / githubweb

#3200 (Nov 23, 2021, 6:48:28 PM)

  1. [SPARK-37380][PYTHON] Miscellaneous Python lint infra cleanup — gurwls223 / githubweb

#3199 (Nov 23, 2021, 12:02:39 PM)

  1. [SPARK-37013][CORE][SQL][FOLLOWUP] Use the new error framework to throw — wenchen / githubweb

#3198 (Nov 23, 2021, 5:26:29 AM)

  1. [SPARK-36231][PYTHON] Support arithmetic operations of decimal(nan) — gurwls223 / githubweb

#3197 (Nov 22, 2021, 10:37:48 PM)

  1. [SPARK-30537][PYTHON] Fix toPandas  wrong dtypes when applied on empty — gurwls223 / githubweb
  2. [SPARK-37438][SQL] ANSI mode: Use store assignment rules for resolving — gengliang / githubweb

#3196 (Nov 22, 2021, 3:55:25 PM)

  1. [SPARK-37337][PYTHON] Improve the API of Spark DataFrame to — gurwls223 / githubweb

#3195 (Nov 22, 2021, 8:21:28 AM)

  1. [MINOR][R][DOCS] Fix misplaced brackets in SparkR:::mapValues doc — mszymkiewicz / githubweb
  2. [SPARK-36357][SQL] Support pushdown Timestamp without time zone for orc — wenchen / githubweb
  3. [SPARK-37192][SQL] Migrate SHOW TBLPROPERTIES to use V2 command by — wenchen / githubweb

#3194 (Nov 22, 2021, 1:13:10 AM)

  1. Revert "[SPARK-36231][PYTHON] Support arithmetic operations of — gurwls223 / githubweb
  2. [SPARK-37354][K8S][TESTS] Make the Java version installed on the — sarutak / githubweb
  3. [SPARK-37388][SQL] Fix NPE in WidthBucket in WholeStageCodegenExec — wenchen / githubweb

#3193 (Nov 21, 2021, 5:52:53 PM)

  1. [SPARK-37209][YARN][TESTS] Fix `YarnShuffleIntegrationSuite` releated — srowen / githubweb

#3192 (Nov 21, 2021, 7:50:17 AM)

  1. [SPARK-37104][PYTHON] Make RDD and DStream covariant — mszymkiewicz / githubweb

#3191 (Nov 20, 2021, 7:42:58 AM)

  1. [SPARK-37390][PYTHON][DOCS] Add default value to getattr(app, — mszymkiewicz / githubweb

#3190 (Nov 20, 2021, 1:03:15 AM)

  1. [SPARK-37282][TESTS][FOLLOWUP] Extract `Utils.isMacOnAppleSilicon` for — dongjoon / githubweb

#3189 (Nov 19, 2021, 6:18:51 PM)

  1. [SPARK-36997][PYTHON][TESTS] Run mypy tests against ml, sql, streaming — mszymkiewicz / githubweb
  2. [SPARK-37379][SQL] Add tree pattern pruning to CTESubstitution rule — joshrosen / githubweb

#3188 (Nov 19, 2021, 11:38:45 AM)

  1. [SPARK-37385][SQL][TESTS] Add tests for TimestampNTZ and TimestampLTZ — wenchen / githubweb
  2. [SPARK-37224][SS][FOLLOWUP] Add benchmark on basic state store — viirya / githubweb

#3187 (Nov 19, 2021, 4:42:47 AM)

  1. [SPARK-37384][CORE][TESTS] Increase timeout for job termination in — gurwls223 / githubweb
  2. [SPARK-37386][SQL] Simplify OptimizeSkewedJoin to not run the cost — wenchen / githubweb
  3. [SPARK-35672][FOLLOWUP][TESTS] Add more exclusion rules to — sarutak / githubweb

#3186 (Nov 18, 2021, 9:06:42 PM)

  1. [SPARK-37219][SQL][FOLLOWUP] Make AS OF syntax more flexible — huaxin_gao / githubweb
  2. [MINOR][R][DOCS] Fix minor issues in SparkR docs examples — gurwls223 / githubweb
  3. [SPARK-37336][ML][PYTHON] Migrate _java2py from SQLContext to — gurwls223 / githubweb
  4. [SPARK-37224][SS][FOLLOWUP] Clarify the guide doc and fix the method doc — kabhwan.opensource / githubweb
  5. [SPARK-37374][PYTHON] Fix StatCounter to use mergeStats when merging — gurwls223 / githubweb
  6. [SPARK-37371][SQL] UnionExec should support columnar if all children — viirya / githubweb
  7. [SPARK-37370][SQL] Add SQL configs to control newly added join code-gen — wenchen / githubweb
  8. [SPARK-35672][FOLLOWUP][TESTS] Add an exclusion rule to — dongjoon / githubweb
  9. [SPARK-37038][SQL][TESTS][FOLLOWUP] Fix flaky test by loosening the — gurwls223 / githubweb

#3185 (Nov 18, 2021, 1:38:51 PM)

  1. [SPARK-37356][CORE] Add fine grained locking to the BlockInfoManager — herman / githubweb