WDescription%
Build stability: 1 out of the last 5 builds failed.80
Test Result: 1 test failing out of a total of 31,647 tests.99
Build History
x

Changes

#3413 (Dec 2, 2021, 11:55:39 AM)

  1. [SPARK-37522][PYTHON][TESTS] Fix — dongjoon / githubweb

#3412 (Dec 2, 2021, 9:32:19 AM)

  1. [SPARK-37450][SQL] Prune unnecessary fields from Generate — viirya / githubweb

#3411 (Dec 2, 2021, 6:34:01 AM)

  1. [SPARK-37442][SQL] InMemoryRelation statistics bug causing broadcast — wenchen / githubweb

#3410 (Dec 2, 2021, 1:27:36 AM)

  1. [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add — mridulatgmail.com / githubweb
  2. [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ — wenchen / githubweb
  3. [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when — gurwls223 / githubweb
  4. [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from — gurwls223 / githubweb

#3409 (Dec 1, 2021, 10:35:53 PM)

  1. [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` — wenchen / githubweb

#3408 (Dec 1, 2021, 7:25:41 PM)

  1. [SPARK-37514][PYTHON] Remove workarounds due to older pandas — gurwls223 / githubweb

#3407 (Dec 1, 2021, 4:27:59 PM)

  1. [SPARK-37496][SQL] Migrate ReplaceTableAsSelectStatement to v2 command — huaxin_gao / githubweb

#3406 (Dec 1, 2021, 10:27:18 AM)

  1. [SPARK-37326][SQL][FOLLOWUP] Fix the test for Java 11 — dongjoon / githubweb

#3405 (Dec 1, 2021, 6:51:41 AM)

  1. [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION — wenchen / githubweb
  2. [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 — wenchen / githubweb

#3404 (Dec 1, 2021, 3:16:40 AM)

  1. [SPARK-37458][SS] Remove unnecessary SerializeFromObject from the plan — dongjoon / githubweb
  2. [SPARK-37513][SQL][DOC] date +/- interval with only day-time fields — wenchen / githubweb
  3. [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments — wenchen / githubweb
  4. [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark — gurwls223 / githubweb
  5. [SPARK-37508][SQL] Add CONTAINS() string function — max.gekk / githubweb

#3403 (Nov 30, 2021, 11:59:15 PM)

  1. [SPARK-37376][SQL] Introduce a new DataSource V2 interface — dongjoon / githubweb
  2. [SPARK-37480][K8S][DOC] Sync Kubernetes configuration to latest in — dongjoon / githubweb
  3. [SPARK-37326][SQL] Support TimestampNTZ in CSV data source — max.gekk / githubweb

#3402 (Nov 30, 2021, 9:11:08 PM)

  1. [SPARK-37497][K8S] Promote — dongjoon / githubweb
  2. [SPARK-37490][SQL] Show extra hint if analyzer fails due to ANSI type — gengliang / githubweb

#3401 (Nov 30, 2021, 6:03:30 PM)

  1. [SPARK-37509][CORE] Improve Fallback Storage upload speed by avoiding S3 — dongjoon / githubweb

#3400 (Nov 30, 2021, 2:44:32 PM)

  1. [SPARK-37505][MESOS][TESTS] Add a log4j.properties for `mesos` module UT — dongjoon / githubweb

#3399 (Nov 30, 2021, 3:25:54 AM)

  1. [MINOR][DOC] Update doc for `ResourceProfileManager.isSupported` — gurwls223 / githubweb

#3398 (Nov 29, 2021, 10:57:42 PM)

  1. [SPARK-36850][SQL] Migrate CreateTableStatement to v2 command framework — wenchen / githubweb
  2. [SPARK-37492][SQL] Optimize Orc test code with withAllNativeOrcReaders — dongjoon / githubweb
  3. [SPARK-37465][PYTHON] Bump minimum pandas version to 1.0.5 — gurwls223 / githubweb
  4. [SPARK-37489][PYTHON] Skip hasnans check in numops if eager_check — gurwls223 / githubweb
  5. [SPARK-37291][PYSPARK][FOLLOWUP] PySpark create SparkSession should pass — gurwls223 / githubweb
  6. [SPARK-36396][PYTHON] Implement DataFrame.cov — gurwls223 / githubweb

#3397 (Nov 29, 2021, 8:25:59 PM)

  1. [SPARK-37485][CORE][SQL] Replace `map` with expressions which produce no — gurwls223 / githubweb
  2. [SPARK-37484][CORE][SQL] Replace `get` and `getOrElse` with `getOrElse` — gurwls223 / githubweb
  3. [SPARK-37482][PYTHON] Skip check monotonic increasing for Series.asof — gurwls223 / githubweb
  4. [SPARK-35867][SQL] Enable vectorized read for — sunchao / githubweb

#3396 (Nov 29, 2021, 5:21:49 PM)

  1. [SPARK-37454][SQL][FOLLOWUP] Time travel timestamp expression should — gurwls223 / githubweb

#3395 (Nov 29, 2021, 12:12:07 PM)

  1. [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for — max.gekk / githubweb

#3394 (Nov 29, 2021, 9:20:44 AM)

  1. [SPARK-36346][SQL][FOLLOWUP] Rename `withAllOrcReaders` to — dongjoon / githubweb

#3393 (Nov 29, 2021, 6:16:50 AM)

  1. [SPARK-33875][SQL][FOLLOWUP] Handle the char/varchar column for — wenchen / githubweb

#3392 (Nov 29, 2021, 3:33:03 AM)

  1. [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of — wenchen / githubweb

#3391 (Nov 29, 2021, 1:19:06 AM)

  1. [SPARK-37447][SQL] Cache LogicalPlan.isStreaming() result in a lazy val — wenchen / githubweb
  2. [SPARK-37452][SQL] Char and Varchar break backward compatibility between — yao / githubweb

#3390 (Nov 28, 2021, 10:20:37 PM)

  1. [SPARK-37443][PYTHON] Provide a profiler for Python/Pandas UDFs — gurwls223 / githubweb
  2. [SPARK-37319][K8S][FOLLOWUP] Set JAVA_HOME for Java 17 installed by — dongjoon / githubweb

#3389 (Nov 28, 2021, 7:15:31 AM)

  1. [SPARK-37461][YARN] YARN-CLIENT mode client.appId is always null — srowen / githubweb

#3388 (Nov 27, 2021, 7:11:23 AM)

  1. [SPARK-37437][BUILD] Remove unused hive profile and related CI test — srowen / githubweb

#3387 (Nov 26, 2021, 5:07:03 AM)

  1. [SPARK-34735][SQL][UI] Add modified configs for SQL execution in UI — gengliang / githubweb

#3386 (Nov 25, 2021, 8:18:33 PM)

  1. [SPARK-37436][PYTHON] Uses Python's standard string formatter for SQL — gurwls223 / githubweb
  2. [SPARK-37457][PYTHON] Update cloudpickle to v2.0.0 — gurwls223 / githubweb

#3385 (Nov 25, 2021, 5:06:50 PM)

  1. Revert "[SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to — gurwls223 / githubweb

#3384 (Nov 25, 2021, 3:24:10 PM)

  1. [SPARK-32079][PYTHON] Remove namedtuple hack by replacing built-in — gurwls223 / githubweb

#3383 (Nov 25, 2021, 5:26:32 AM)

  1. [SPARK-37311][SQL] Migrate ALTER NAMESPACE ... SET LOCATION to use V2 — wenchen / githubweb
  2. [SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to hadoop-3 and — wenchen / githubweb

#3382 (Nov 25, 2021, 2:31:27 AM)

  1. [SPARK-37456][SQL] CREATE NAMESPACE should qualify location for v2 — wenchen / githubweb
  2. [SPARK-34332][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET LOCATION — wenchen / githubweb
  3. [SPARK-36861][SQL] Use `yyyy-MM-dd` as the date pattern in partition — wenchen / githubweb
  4. [SPARK-37454][SQL] Support expressions in time travel timestamp — wenchen / githubweb
  5. [SPARK-37357][SQL] Add small partition factor for rebalance partitions — wenchen / githubweb

#3381 (Nov 24, 2021, 11:14:22 PM)

  1. [SPARK-37459][BUILD] Upgrade commons-cli to 1.5.0 — gurwls223 / githubweb

#3380 (Nov 24, 2021, 7:27:19 PM)

  1. [SPARK-37446][SQL] Use reflection for getWithoutRegisterFns to allow — gurwls223 / githubweb

#3379 (Nov 24, 2021, 5:02:25 PM)

  1. [MINOR][SQL] Fix the error message typo in QueryExecutionErrors.scala — gurwls223 / githubweb
  2. [SPARK-37453][INFRA][SQL][TESTS] Split TPC-DS build in GitHub Actions — gurwls223 / githubweb

#3378 (Nov 24, 2021, 9:59:35 AM)

  1. [SPARK-37444][SQL] ALTER NAMESPACE ... SET LOCATION should handle empty — wenchen / githubweb

#3377 (Nov 24, 2021, 7:12:48 AM)

  1. [MINOR][DOCS] Update scaladoc of KnownSizeEstimation — srowen / githubweb

#3376 (Nov 24, 2021, 3:19:17 AM)

  1. [MINOR][DOCS] Fix scaladoc for skewed partitions optimization — wenchen / githubweb
  2. [SPARK-37399][SPARK-37403][PYSPARK][ML] Merge {ml, mllib}/common.pyi — mszymkiewicz / githubweb

#3375 (Nov 24, 2021, 12:18:06 AM)

  1. [SPARK-37389][SQL] Check unclosed bracketed comments — wenchen / githubweb

#3374 (Nov 23, 2021, 4:00:38 PM)

  1. [SPARK-37380][PYTHON] Miscellaneous Python lint infra cleanup — gurwls223 / githubweb

#3373 (Nov 23, 2021, 7:09:46 AM)

  1. [SPARK-37013][CORE][SQL][FOLLOWUP] Use the new error framework to throw — wenchen / githubweb

#3372 (Nov 23, 2021, 1:57:50 AM)

  1. [SPARK-36231][PYTHON] Support arithmetic operations of decimal(nan) — gurwls223 / githubweb

#3371 (Nov 22, 2021, 10:13:09 PM)

  1. [SPARK-37438][SQL] ANSI mode: Use store assignment rules for resolving — gengliang / githubweb

#3370 (Nov 22, 2021, 5:48:12 PM)

  1. [SPARK-37337][PYTHON] Improve the API of Spark DataFrame to — gurwls223 / githubweb
  2. [SPARK-30537][PYTHON] Fix toPandas  wrong dtypes when applied on empty — gurwls223 / githubweb

#3369 (Nov 22, 2021, 3:00:23 PM)

  1. [SPARK-37192][SQL] Migrate SHOW TBLPROPERTIES to use V2 command by — wenchen / githubweb

#3368 (Nov 22, 2021, 6:58:56 AM)

  1. [SPARK-36357][SQL] Support pushdown Timestamp without time zone for orc — wenchen / githubweb

#3367 (Nov 22, 2021, 4:10:39 AM)

  1. [MINOR][R][DOCS] Fix misplaced brackets in SparkR:::mapValues doc — mszymkiewicz / githubweb

#3366 (Nov 22, 2021, 12:53:33 AM)

  1. [SPARK-37388][SQL] Fix NPE in WidthBucket in WholeStageCodegenExec — wenchen / githubweb

#3365 (Nov 21, 2021, 8:56:48 PM)

  1. Revert "[SPARK-36231][PYTHON] Support arithmetic operations of — gurwls223 / githubweb
  2. [SPARK-37354][K8S][TESTS] Make the Java version installed on the — sarutak / githubweb

#3364 (Nov 21, 2021, 5:50:54 PM)

  1. [SPARK-37209][YARN][TESTS] Fix `YarnShuffleIntegrationSuite` releated — srowen / githubweb

#3363 (Nov 21, 2021, 7:48:22 AM)

  1. [SPARK-37104][PYTHON] Make RDD and DStream covariant — mszymkiewicz / githubweb

#3362 (Nov 20, 2021, 2:49:05 AM)

  1. [SPARK-37390][PYTHON][DOCS] Add default value to getattr(app, — mszymkiewicz / githubweb

#3361 (Nov 19, 2021, 8:04:35 PM)

  1. [SPARK-37282][TESTS][FOLLOWUP] Extract `Utils.isMacOnAppleSilicon` for — dongjoon / githubweb

#3360 (Nov 19, 2021, 5:18:39 PM)

  1. [SPARK-37379][SQL] Add tree pattern pruning to CTESubstitution rule — joshrosen / githubweb

#3359 (Nov 19, 2021, 2:26:14 PM)

  1. [SPARK-36997][PYTHON][TESTS] Run mypy tests against ml, sql, streaming — mszymkiewicz / githubweb

#3358 (Nov 19, 2021, 11:36:09 AM)

  1. [SPARK-37224][SS][FOLLOWUP] Add benchmark on basic state store — viirya / githubweb

#3357 (Nov 19, 2021, 8:41:55 AM)

  1. [SPARK-37385][SQL][TESTS] Add tests for TimestampNTZ and TimestampLTZ — wenchen / githubweb

#3356 (Nov 19, 2021, 4:38:13 AM)

  1. [SPARK-35672][FOLLOWUP][TESTS] Add more exclusion rules to — sarutak / githubweb

#3355 (Nov 19, 2021, 1:45:01 AM)

  1. [SPARK-37386][SQL] Simplify OptimizeSkewedJoin to not run the cost — wenchen / githubweb

#3354 (Nov 18, 2021, 10:50:20 PM)

  1. [SPARK-37370][SQL] Add SQL configs to control newly added join code-gen — wenchen / githubweb
  2. [SPARK-35672][FOLLOWUP][TESTS] Add an exclusion rule to — dongjoon / githubweb
  3. [SPARK-37038][SQL][TESTS][FOLLOWUP] Fix flaky test by loosening the — gurwls223 / githubweb
  4. [SPARK-37384][CORE][TESTS] Increase timeout for job termination in — gurwls223 / githubweb

#3353 (Nov 18, 2021, 8:26:46 PM)

  1. [MINOR][R][DOCS] Fix minor issues in SparkR docs examples — gurwls223 / githubweb
  2. [SPARK-37336][ML][PYTHON] Migrate _java2py from SQLContext to — gurwls223 / githubweb
  3. [SPARK-37224][SS][FOLLOWUP] Clarify the guide doc and fix the method doc — kabhwan.opensource / githubweb
  4. [SPARK-37374][PYTHON] Fix StatCounter to use mergeStats when merging — gurwls223 / githubweb
  5. [SPARK-37371][SQL] UnionExec should support columnar if all children — viirya / githubweb

#3352 (Nov 18, 2021, 4:41:30 PM)

  1. [SPARK-37219][SQL][FOLLOWUP] Make AS OF syntax more flexible — huaxin_gao / githubweb

#3351 (Nov 18, 2021, 1:40:56 PM)

  1. [SPARK-37356][CORE] Add fine grained locking to the BlockInfoManager — herman / githubweb