Changes

Summary

  1. [SPARK-33042][SQL][TEST] Add a test case to ensure changes to (commit: 0fb2574) (details)
  2. [SPARK-32914][SQL] Avoid constructing dataType multiple times (commit: 023eb48) (details)
  3. [SPARK-33063][K8S] Improve error message for insufficient K8s volume (commit: a09747b) (details)
  4. [SPARK-33038][SQL] Combine AQE initial and current plan string when two (commit: 14aeab3) (details)
  5. [SPARK-20202][BUILD][SQL] Remove references to org.spark-project.hive (commit: 008a2ad) (details)
  6. [SPARK-33069][INFRA] Skip test result report if no JUnit XML files are (commit: a0aa8f3) (details)
  7. [SPARK-33067][SQL][TESTS] Add negative checks to JDBC v2 Table Catalog (commit: 9870cf9) (details)
  8. [SPARK-33035][SQL] Updates the obsoleted entries of attribute mapping in (commit: 4adc282) (details)
  9. [SPARK-32511][SQL] Add dropFields method to Column class (commit: 2793347) (details)
  10. [SPARK-32243][SQL] HiveSessionCatalog call super.makeFunctionExpression (commit: ddc7012) (details)
  11. [SPARK-33073][PYTHON] Improve error handling on Pandas to Arrow (commit: 0812d6c) (details)
  12. [SPARK-27428][CORE][TEST] Increase receive buffer size used in (commit: b5e4b8c) (details)
  13. [SPARK-32243][SQL][FOLLOWUP] Fix compilation in HiveSessionCatalog (commit: ec6fccb) (details)
  14. [SPARK-32963][SQL] empty string should be consistent for schema name in (commit: 17d309d) (details)
  15. [SPARK-32511][SQL][FOLLOWUP] Fix the broken build for Scala 2.13 with (commit: 3b2a38d) (details)
Commit 0fb2574d4e75fa4a545da1d53357c2359c0bffeb by gurwls223
[SPARK-33042][SQL][TEST] Add a test case to ensure changes to
spark.sql.optimizer.maxIterations take effect at runtime
### What changes were proposed in this pull request?
Add a test case to ensure changes to `spark.sql.optimizer.maxIterations`
take effect at runtime.
### Why are the changes needed?
Currently, there is only one related test case:
https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala#L156
However, this test case only checks the value of the conf can be changed
at runtime. It does not check the updated value is actually used by the
Optimizer.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
unit test
Closes #29919 from yuningzh-db/add_optimizer_test.
Authored-by: Yuning Zhang <yuning.zhang@databricks.com> Signed-off-by:
HyukjinKwon <gurwls223@apache.org>
(commit: 0fb2574)
The file was addedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizerSuite.scala
Commit 023eb482b23b5d63d2157b3def9926673844e0a3 by gurwls223
[SPARK-32914][SQL] Avoid constructing dataType multiple times
### What changes were proposed in this pull request?
Some expression's data type not a static value. It needs to be
constructed a new object when calling `dataType` function. E.g.:
`CaseWhen`. We should avoid constructing dataType multiple times because
it may be used many times. E.g.:
[`HyperLogLogPlusPlus.update`](https://github.com/apache/spark/blob/10edeafc69250afef8c71ed7b3c77992f67aa4ff/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/HyperLogLogPlusPlus.scala#L122).
### Why are the changes needed?
Improve query performance. for example:
```scala spark.range(100000000L).selectExpr("approx_count_distinct(case
when id % 400 > 20 then id else 0 end)").show
```
Profiling result:
```
-- Execution profile --- Total samples       : 18365
Frame buffer usage  : 2.6688%
--- 58443254327 ns (31.82%), 5844 samples
[ 0] GenericTaskQueueSet<OverflowTaskQueue<StarTask, (MemoryType)1,
131072u>, (MemoryType)1>::steal_best_of_2(unsigned int, int*, StarTask&)
[ 1] StealTask::do_it(GCTaskManager*, unsigned int)
[ 2] GCTaskThread::run()
[ 3] java_start(Thread*)
[ 4] start_thread
--- 6140668667 ns (3.34%), 614 samples
[ 0] GenericTaskQueueSet<OverflowTaskQueue<StarTask, (MemoryType)1,
131072u>, (MemoryType)1>::peek()
[ 1] ParallelTaskTerminator::offer_termination(TerminatorTerminator*)
[ 2] StealTask::do_it(GCTaskManager*, unsigned int)
[ 3] GCTaskThread::run()
[ 4] java_start(Thread*)
[ 5] start_thread
--- 5679994036 ns (3.09%), 568 samples
[ 0] scala.collection.generic.Growable.$plus$plus$eq
[ 1] scala.collection.generic.Growable.$plus$plus$eq$
[ 2] scala.collection.mutable.ListBuffer.$plus$plus$eq
[ 3] scala.collection.mutable.ListBuffer.$plus$plus$eq
[ 4]
scala.collection.generic.GenericTraversableTemplate.$anonfun$flatten$1
[ 5]
scala.collection.generic.GenericTraversableTemplate$$Lambda$107.411506101.apply
[ 6] scala.collection.immutable.List.foreach
[ 7] scala.collection.generic.GenericTraversableTemplate.flatten
[ 8] scala.collection.generic.GenericTraversableTemplate.flatten$
[ 9] scala.collection.AbstractTraversable.flatten
[10] org.apache.spark.internal.config.ConfigEntry.readString
[11] org.apache.spark.internal.config.ConfigEntryWithDefault.readFrom
[12] org.apache.spark.sql.internal.SQLConf.getConf
[13] org.apache.spark.sql.internal.SQLConf.caseSensitiveAnalysis
[14] org.apache.spark.sql.types.DataType.sameType
[15]
org.apache.spark.sql.catalyst.analysis.TypeCoercion$.$anonfun$haveSameType$1
[16]
org.apache.spark.sql.catalyst.analysis.TypeCoercion$.$anonfun$haveSameType$1$adapted
[17]
org.apache.spark.sql.catalyst.analysis.TypeCoercion$$$Lambda$1527.1975399904.apply
[18] scala.collection.IndexedSeqOptimized.prefixLengthImpl
[19] scala.collection.IndexedSeqOptimized.forall
[20] scala.collection.IndexedSeqOptimized.forall$
[21] scala.collection.mutable.ArrayBuffer.forall
[22] org.apache.spark.sql.catalyst.analysis.TypeCoercion$.haveSameType
[23]
org.apache.spark.sql.catalyst.expressions.ComplexTypeMergingExpression.dataTypeCheck
[24]
org.apache.spark.sql.catalyst.expressions.ComplexTypeMergingExpression.dataTypeCheck$
[25] org.apache.spark.sql.catalyst.expressions.CaseWhen.dataTypeCheck
[26]
org.apache.spark.sql.catalyst.expressions.ComplexTypeMergingExpression.dataType
[27]
org.apache.spark.sql.catalyst.expressions.ComplexTypeMergingExpression.dataType$
[28] org.apache.spark.sql.catalyst.expressions.CaseWhen.dataType
[29]
org.apache.spark.sql.catalyst.expressions.aggregate.HyperLogLogPlusPlus.update
[30]
org.apache.spark.sql.execution.aggregate.AggregationIterator$$anonfun$1.$anonfun$applyOrElse$2
[31]
org.apache.spark.sql.execution.aggregate.AggregationIterator$$anonfun$1.$anonfun$applyOrElse$2$adapted
[32]
org.apache.spark.sql.execution.aggregate.AggregationIterator$$anonfun$1$$Lambda$1534.1383512673.apply
[33]
org.apache.spark.sql.execution.aggregate.AggregationIterator.$anonfun$generateProcessRow$7
[34]
org.apache.spark.sql.execution.aggregate.AggregationIterator.$anonfun$generateProcessRow$7$adapted
[35]
org.apache.spark.sql.execution.aggregate.AggregationIterator$$Lambda$1555.725788712.apply
```
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual test and benchmark test:
Benchmark code | Before this PR(Milliseconds) | After this
PR(Milliseconds)
--- | --- | ---
spark.range(100000000L).selectExpr("approx_count_distinct(case   when id
% 400 > 20 then id else 0 end)").collect() | 56462 | 3794
Closes #29790 from wangyum/SPARK-32914.
Authored-by: Yuming Wang <yumwang@ebay.com> Signed-off-by: HyukjinKwon
<gurwls223@apache.org>
(commit: 023eb48)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala (diff)
Commit a09747bf326677e212fbc284285cce822571c315 by dhyun
[SPARK-33063][K8S] Improve error message for insufficient K8s volume
confs
### What changes were proposed in this pull request? Provide error
handling when creating kubernetes volumes. Right now they keys are
expected to be there and if not it fails with a `key not found` error,
but not knowing why do you need that `key`.
Also I renamed some tests that didn't indicate the kind of kubernetes
volume
### Why are the changes needed?
Easier for the users to understand why `spark-submit` command is failing
if not providing they right kubernetes volumes properties.
### Does this PR introduce _any_ user-facing change? No
### How was this patch tested? It was tested with the current tests plus
added one more.
[Jira ticket](https://issues.apache.org/jira/browse/SPARK-33063)
Closes #29941 from
Gschiavon/SPARK-33063-provide-error-handling-k8s-volumes.
Authored-by: gschiavon <germanschiavon@gmail.com> Signed-off-by:
Dongjoon Hyun <dhyun@apple.com>
(commit: a09747b)
The file was modifiedresource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/KubernetesVolumeUtilsSuite.scala (diff)
The file was modifiedresource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/KubernetesVolumeUtils.scala (diff)
Commit 14aeab3b279b1c23cddb86b97afc048c195b9b75 by gatorsmile
[SPARK-33038][SQL] Combine AQE initial and current plan string when two
plans are the same
### What changes were proposed in this pull request? This PR combines
the current plan and the initial plan in the AQE query plan string when
the two plans are the same. It also removes the `== Current Plan ==` and
`== Initial Plan ==` headers:
Before
```scala AdaptiveSparkPlan isFinalPlan=false
+- == Current Plan ==
  SortMergeJoin [key#13], [a#23], Inner
  :- Sort [key#13 ASC NULLS FIRST], false, 0
  :  +- Exchange hashpartitioning(key#13, 5), true, [id=#94]
           ...
+- == Initial Plan ==
  SortMergeJoin [key#13], [a#23], Inner
  :- Sort [key#13 ASC NULLS FIRST], false, 0
  :  +- Exchange hashpartitioning(key#13, 5), true, [id=#94]
           ...
``` After
```scala AdaptiveSparkPlan isFinalPlan=false
+- SortMergeJoin [key#13], [a#23], Inner
  :- Sort [key#13 ASC NULLS FIRST], false, 0
  :  +- Exchange hashpartitioning(key#13, 5), true, [id=#94]
           ...
``` For SQL `EXPLAIN` output: Before
```scala AdaptiveSparkPlan (8)
+- == Current Plan ==
  Sort (7)
  +- Exchange (6)
     ...
+- == Initial Plan ==
  Sort (7)
  +- Exchange (6)
     ...
``` After
```scala AdaptiveSparkPlan (8)
+- Sort (7)
  +- Exchange (6)
     ...
```
### Why are the changes needed? To simplify the AQE plan string by
removing the redundant plan information.
### Does this PR introduce _any_ user-facing change? Yes.
### How was this patch tested? Modified the existing unit test.
Closes #29915 from allisonwang-db/aqe-explain.
Authored-by: allisonwang-db
<66282705+allisonwang-db@users.noreply.github.com> Signed-off-by: Xiao
Li <gatorsmile@gmail.com>
(commit: 14aeab3)
The file was modifiedsql/core/src/test/resources/sql-tests/results/explain-aqe.sql.out (diff)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala (diff)
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanExec.scala (diff)
Commit 008a2ad1f836ff04fafd51a9c94c355ef35f1692 by dhyun
[SPARK-20202][BUILD][SQL] Remove references to org.spark-project.hive
(Hive 1.2.1)
### What changes were proposed in this pull request?
As of today,
- SPARK-30034 Apache Spark 3.0.0 switched its default Hive execution
engine from Hive 1.2 to Hive 2.3. This removes the direct dependency to
the forked Hive 1.2.1 in maven repository.
- SPARK-32981 Apache Spark 3.1.0(`master` branch) removed Hive 1.2
related artifacts from Apache Spark binary distributions.
This PR(SPARK-20202) aims to remove the following usage of unofficial
Apache Hive fork completely from Apache Spark master for Apache Spark
3.1.0.
```
<hive.group>org.spark-project.hive</hive.group>
<hive.version>1.2.1.spark2</hive.version>
```
For the forked Hive 1.2.1.spark2 users, Apache Spark 2.4(LTS) and 3.0 (~
2021.12) will provide it.
### Why are the changes needed?
- First, Apache Spark community should not use the unofficial forked
release of another Apache project.
- Second, Apache Hive 1.2.1 was released at 2015-06-26 and the forked
Hive `1.2.1.spark2` exposed many unfixable bugs in Apache because the
forked `1.2.1.spark2` is not maintained at all. Apache Hive 2.3.0 was
released at 2017-07-19 and it has been used with less number of bugs
compared with `1.2.1.spark2`. Many bugs still exist in `hive-1.2`
profile and new Apache Spark unit tests are added with
`HiveUtils.isHive23` condition so far.
### Does this PR introduce _any_ user-facing change?
No. This is a dev-only change. PRBuilder will not accept
`[test-hive1.2]` on master and `branch-3.1`.
### How was this patch tested?
1. SBT/Hadoop 3.2/Hive 2.3
(https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129366)
2. SBT/Hadoop 2.7/Hive 2.3
(https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129382)
3. SBT/Hadoop 3.2/Hive 1.2 (This has not been supported already due to
Hive 1.2 doesn't work with Hadoop 3.2.) 4. SBT/Hadoop 2.7/Hive 1.2
(https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129383,
This is rejected)
Closes #29936 from dongjoon-hyun/SPARK-REMOVE-HIVE1.
Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: Dongjoon
Hyun <dhyun@apple.com>
(commit: 008a2ad)
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TColumn.java
The file was removedsql/hive/benchmarks/InsertIntoHiveTableBenchmark-hive1.2-results.txt
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetInfoValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/CompositeService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TPrimitiveTypeEntry.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/CompositeService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TI16Column.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TPrimitiveTypeEntry.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TTableSchema.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/MetadataOperation.java
The file was removedsql/core/v1.2/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilterSuite.scala
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/HandleIdentifier.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetPrimaryKeysReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TColumnDesc.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TOperationState.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCrossReferenceReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/server/ThreadWithGarbageCleanup.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TTypeEntry.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TColumnValue.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TExecuteStatementResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCLIServiceConstants.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/TypeDescriptor.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/OperationType.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TI16Value.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/SQLOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeDesc.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/TableTypeMapping.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTablesReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TOpenSessionReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/Handle.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionHookContext.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TFetchResultsResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetColumnsResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/session/HiveSessionBase.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/ServiceUtils.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseSessionReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/session/HiveSession.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetPrimaryKeysReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeQualifiers.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetResultSetMetadataReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelOperationReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/PlainSaslHelper.java
The file was modifiedsql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala (diff)
The file was removedsql/core/v1.2/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilters.scala
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/HiveSQLException.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/SQLOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TColumnDesc.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/OperationHandle.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/ExecuteStatementOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/TypeDescriptor.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetPrimaryKeysResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TExecuteStatementReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TI16Column.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/thrift/ThriftBinaryCLIService.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TUserDefinedTypeEntry.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TStringColumn.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TRenewDelegationTokenReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/auth/HttpAuthUtils.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetSchemasReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetCatalogsOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TI32Value.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/FetchOrientation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TOperationHandle.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TBoolValue.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/ExecuteStatementOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/HiveSessionImplwithUGI.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCancelDelegationTokenResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetOperationStatusReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetCrossReferenceOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/ColumnDescriptor.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetSchemasReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTablesResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TUnionTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/server/ThreadWithGarbageCleanup.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TByteColumn.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/Type.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/ServiceUtils.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeDesc.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TProgressUpdateResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TOperationType.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TStructTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/ServiceUtils.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/SQLOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TByteColumn.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TFetchOrientation.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetFunctionsResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/OperationState.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/TableSchema.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelDelegationTokenReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/ICLIService.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionHookContextImpl.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TI32Column.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/ICLIService.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TOpenSessionResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetDelegationTokenReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/GetInfoType.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetSchemasOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TOpenSessionResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/CookieSigner.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TProtocolVersion.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseSessionResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/HiveAuthFactory.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/AbstractService.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/ExecuteStatementOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetSchemasResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/RowBasedSet.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTypeInfoReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/THandleIdentifier.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TDoubleColumn.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TDoubleColumn.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCrossReferenceResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/Handle.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TI64Column.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetResultSetMetadataReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/HiveSQLException.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/GetInfoValue.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetTablesReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCrossReferenceReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTablesReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeQualifierValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/scala/org/apache/spark/sql/hive/thriftserver/ThriftserverShimUtils.scala
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TUnionTypeEntry.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/TSetIpAddressProcessor.java
The file was addedsql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcShimUtils.scala
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/TypeQualifiers.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TRenewDelegationTokenReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/MetadataOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/ColumnBasedSet.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TRowSet.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/HandleIdentifier.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TSessionHandle.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TStructTypeEntry.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTypeInfoResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCatalogsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TI32Column.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetTableTypesReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCancelOperationResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetFunctionsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetCatalogsResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/OperationManager.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TByteValue.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TBinaryColumn.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCatalogsResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseOperationReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetTypeInfoOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/HandleIdentifier.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/CLIService.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/HiveSession.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetInfoReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/SessionHandle.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TBinaryColumn.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/CookieSigner.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TStatus.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCloseOperationReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/GetInfoType.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetTablesOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseOperationResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/OperationState.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TI32Column.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TSessionHandle.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TTypeId.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/TableSchema.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TProtocolVersion.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/ColumnValue.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/THandleIdentifier.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TStatusCode.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TStatusCode.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCLIServiceConstants.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/FetchOrientation.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetFunctionsOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TI64Column.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TRow.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftBinaryCLIService.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TOpenSessionResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/TableSchema.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TOperationType.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TTypeDesc.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelDelegationTokenReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetDelegationTokenResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TI16Value.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetSchemasOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCLIService.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/ServiceOperations.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TMapTypeEntry.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetTablesOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCloseSessionResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/ColumnBasedSet.java
The file was modifiedsql/core/pom.xml (diff)
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/session/HiveSessionImplwithUGI.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TTableSchema.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetFunctionsReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TStringValue.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetTypeInfoReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetColumnsOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TFetchResultsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TStatus.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TFetchOrientation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/Operation.java
The file was modifiedpom.xml (diff)
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/KerberosSaslHelper.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/GetInfoType.java
The file was modifiedsql/hive/src/test/scala/org/apache/spark/sql/execution/benchmark/InsertIntoHiveTableBenchmark.scala (diff)
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseOperationResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TByteColumn.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/ServiceOperations.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCancelDelegationTokenReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TRenewDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TDoubleValue.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TI32Value.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TFetchResultsResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetInfoType.java
The file was removedsql/core/v2.3/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilterSuite.scala
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/auth/KerberosSaslHelper.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/auth/HiveAuthFactory.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetResultSetMetadataResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TProtocolVersion.java
The file was modifieddev/test-dependencies.sh (diff)
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/AbstractService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TBoolColumn.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TByteValue.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/HttpAuthUtils.java
The file was modifieddev/run-tests.py (diff)
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/RowSet.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/auth/HiveAuthFactory.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetFunctionsResp.java
The file was removedsql/core/v2.3/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilters.scala
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeId.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/CLIService.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TColumnValue.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TRenewDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/auth/PlainSaslHelper.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TI16Column.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTableTypesResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TColumn.java
The file was removedsql/core/v1.2/src/main/scala/org/apache/spark/sql/execution/datasources/orc/DaysWritable.scala
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/RowSetFactory.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TRenewDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetTableTypesResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TRowSet.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TBoolValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetCrossReferenceOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TTypeQualifierValue.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TI64Column.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetResultSetMetadataResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/Operation.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetPrimaryKeysOperation.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionBase.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/auth/KerberosSaslHelper.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetFunctionsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TOperationState.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/TableTypeMapping.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/RowBasedSet.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetSchemasReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TBoolColumn.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/THandleIdentifier.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TPrimitiveTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoType.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCatalogsReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/TypeQualifiers.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetOperationStatusReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TByteValue.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/PatternOrIdentifier.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TOperationHandle.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCloseOperationResp.java
The file was modifieddocs/sql-migration-guide.md (diff)
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetSchemasResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetSchemasResp.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/SessionHandle.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TDoubleValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/OperationState.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetInfoResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TSessionHandle.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/auth/TSetIpAddressProcessor.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/ColumnDescriptor.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TColumnValue.java
The file was removedsql/core/v1.2/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcShimUtils.scala
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TStatusCode.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/OperationType.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/TypeQualifiers.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/RowSet.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseSessionResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TRenewDelegationTokenReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetTypeInfoResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/HiveSQLException.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetDelegationTokenReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/Handle.java
The file was addedsql/core/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcColumnVector.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TI32Value.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TStatus.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseOperationReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TUnionTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TMapTypeEntry.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImplwithUGI.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetPrimaryKeysOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TExecuteStatementReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TFetchResultsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/ServiceOperations.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetCatalogsOperation.java
The file was removedsql/core/v2.3/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcShimUtils.scala
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TFetchOrientation.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/ColumnBasedSet.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TMapTypeEntry.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetColumnsReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TDoubleValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/AbstractService.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeQualifierValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/RowSetFactory.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/server/HiveServer2.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TStringColumn.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetColumnsOperation.java
The file was addedsql/hive-thriftserver/if/TCLIService.thrift
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetColumnsOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeId.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TExecuteStatementResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelOperationResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCLIServiceConstants.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelDelegationTokenResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetColumnsReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/ColumnDescriptor.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/ColumnValue.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/server/ThreadWithGarbageCleanup.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/TableTypeMapping.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TOpenSessionReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetTypeInfoOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetColumnsResp.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/server/HiveServer2.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TProgressUpdateResp.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/Operation.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/SessionManager.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TStringColumn.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/SessionHandle.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/OperationManager.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TJobExecutionStatus.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/operation/GetCatalogsOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCrossReferenceResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TBoolColumn.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TArrayTypeEntry.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/Column.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelOperationResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetOperationStatusResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/CompositeService.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/auth/TSetIpAddressProcessor.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TRow.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TRow.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetResultSetMetadataResp.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/GetInfoValue.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/RowSet.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TExecuteStatementResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TColumn.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TOpenSessionReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTableTypesReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TTableSchema.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/ICLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetResultSetMetadataReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetTypeInfoOperation.java
The file was removedsql/core/v1.2/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcColumnVector.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TArrayTypeEntry.java
The file was addedsql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ThriftserverShimUtils.scala
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TRowSet.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetColumnsResp.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/MetadataOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/ColumnValue.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TOperationHandle.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TBinaryColumn.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetFunctionsOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TStringValue.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TStructTypeEntry.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCLIService.java
The file was removedsql/core/v2.3/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcColumnVector.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/CLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCloseSessionReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/RowSetFactory.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetCatalogsResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoValue.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TDoubleColumn.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetColumnsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/OperationHandle.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/GetInfoValue.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TOperationType.java
The file was addedsql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilterSuite.scala
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TI64Value.java
The file was addedsql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilters.scala
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoType.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeQualifiers.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetTablesOperation.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TTypeEntry.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoValue.java
The file was removedsql/hive-thriftserver/v1.2/if/TCLIService.thrift
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTableTypesReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetSchemasOperation.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetOperationStatusReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TCancelOperationReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTypeInfoResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TFetchResultsResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetCatalogsReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TTypeQualifiers.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/CookieSigner.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetInfoReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TI64Value.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTablesResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TArrayTypeEntry.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/auth/HttpAuthUtils.java
The file was modifiedsql/hive-thriftserver/pom.xml (diff)
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetDelegationTokenReq.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TBoolValue.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetPrimaryKeysResp.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TExecuteStatementReq.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/server/HiveServer2.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetOperationStatusResp.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TCancelOperationReq.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TCloseSessionReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/HiveSessionHookContextImpl.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TFetchResultsReq.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTypeInfoReq.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetTableTypesResp.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TStringValue.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/HiveSessionBase.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TGetTablesResp.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/OperationHandle.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/auth/PlainSaslHelper.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/thrift/ThriftBinaryCLIService.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/RowBasedSet.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TI64Value.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TGetFunctionsResp.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/TypeDescriptor.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/HiveSessionHookContext.java
The file was removedsql/hive-thriftserver/v2.3/if/TCLIService.thrift
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TUserDefinedTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/FetchOrientation.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
The file was removedsql/hive-thriftserver/v1.2/src/gen/java/org/apache/hive/service/cli/thrift/TUserDefinedTypeEntry.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TColumnDesc.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TI16Value.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/OperationManager.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TJobExecutionStatus.java
The file was removedsql/hive-thriftserver/v2.3/src/gen/java/org/apache/hive/service/rpc/thrift/TGetOperationStatusResp.java
The file was removedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/operation/GetFunctionsOperation.java
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSession.java
The file was removedsql/hive-thriftserver/v1.2/src/main/scala/org/apache/spark/sql/hive/thriftserver/ThriftserverShimUtils.scala
The file was addedsql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java
The file was removedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/OperationType.java
The file was addedsql/hive-thriftserver/src/gen/java/org/apache/hive/service/rpc/thrift/TOperationState.java
Commit a0aa8f33a9420feb9228b51a3dfad2e7e86d65a5 by gurwls223
[SPARK-33069][INFRA] Skip test result report if no JUnit XML files are
found
### What changes were proposed in this pull request?
This PR proposes to skip test reporting ("Report test results") if there
are no JUnit XML files are found.
Currently, we're running and skipping the tests dynamically. For
example,
- if there are only changes in SparkR at the underlying commit, it only
runs the SparkR tests, and skip the other tests and generate JUnit XML
files for SparkR test cases.
- if there are only changes in `docs` at the underlying commit, the
build skips all tests except linters and do not generate any JUnit XML
files.
When test reporting ("Report test results") job is triggered after the
main build ("Build and test
") is finished, and there are no JUnit XML files found, it reports the
case as a failure. See https://github.com/apache/spark/runs/1196184007
as an example.
This PR works around it by simply skipping the testing report when there
are no JUnit XML files are found. Please see
https://github.com/apache/spark/pull/29906#issuecomment-702525542 for
more details.
### Why are the changes needed?
To avoid false alarm for test results.
### Does this PR introduce _any_ user-facing change?
No, dev-only.
### How was this patch tested?
Manually tested in my fork.
Positive case:
https://github.com/HyukjinKwon/spark/runs/1208624679?check_suite_focus=true
https://github.com/HyukjinKwon/spark/actions/runs/288996327
Negative case:
https://github.com/HyukjinKwon/spark/runs/1208229838?check_suite_focus=true
https://github.com/HyukjinKwon/spark/actions/runs/289000058
Closes #29946 from HyukjinKwon/test-junit-files.
Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by:
HyukjinKwon <gurwls223@apache.org>
(commit: a0aa8f3)
The file was modified.github/workflows/test_report.yml (diff)
Commit 9870cf9c086172a390c80f5ef23aacfe2ce3f2cf by gurwls223
[SPARK-33067][SQL][TESTS] Add negative checks to JDBC v2 Table Catalog
tests
### What changes were proposed in this pull request? Add checks for the
cases when JDBC v2 Table Catalog commands fail.
### Why are the changes needed? To improve test coverage.
### Does this PR introduce _any_ user-facing change? No
### How was this patch tested? By running `JDBCTableCatalogSuite`.
Closes #29945 from MaxGekk/jdbcv2-negative-tests.
Lead-authored-by: Max Gekk <max.gekk@gmail.com> Co-authored-by: Hyukjin
Kwon <gurwls223@gmail.com> Signed-off-by: HyukjinKwon
<gurwls223@apache.org>
(commit: 9870cf9)
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/execution/datasources/v2/jdbc/JDBCTableCatalogSuite.scala (diff)
Commit 4adc2822a3c7b7552b436ffb61d5c134680e56b3 by wenchen
[SPARK-33035][SQL] Updates the obsoleted entries of attribute mapping in
QueryPlan#transformUpWithNewOutput
### What changes were proposed in this pull request?
This PR intends to fix corner-case bugs in the
`QueryPlan#transformUpWithNewOutput` that is used to propagate updated
`ExprId`s in a bottom-up way. Let's say we have a rule to simply assign
new `ExprId`s in a projection list like this;
``` case class TestRule extends Rule[LogicalPlan] {
override def apply(plan: LogicalPlan): LogicalPlan =
plan.transformUpWithNewOutput {
   case p  Project(projList, _) =>
     val newPlan = p.copy(projectList = projList.map { _.transform {
       // Assigns a new `ExprId` for references
       case a: AttributeReference => Alias(a, a.name)()
     }}.asInstanceOf[Seq[NamedExpression]])
      val attrMapping = p.output.zip(newPlan.output)
     newPlan -> attrMapping
}
}
``` Then, this rule is applied into a plan below;
```
(3) Project [a#5, b#6]
+- (2) Project [a#5, b#6]
  +- (1) Project [a#5, b#6]
     +- LocalRelation <empty>, [a#5, b#6]
``` In the first transformation, the rule assigns new `ExprId`s in `(1)
Project` (e.g., a#5 AS a#7, b#6 AS b#8). In the second transformation,
the rule corrects the input references of `(2) Project`  first by using
attribute mapping given from `(1) Project` (a#5->a#7 and b#6->b#8) and
then assigns new `ExprId`s (e.g., a#7 AS a#9, b#8 AS b#10). But, in the
third transformation, the rule fails because it tries to correct the
references of `(3) Project` by using incorrect attribute mapping
(a#7->a#9 and b#8->b#10) even though the correct one is a#5->a#9 and
b#6->b#10. To fix this issue, this PR modified the code to update the
attribute mapping entries that are obsoleted by generated entries in a
given rule.
### Why are the changes needed?
bugfix.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Added tests in `QueryPlanSuite`.
Closes #29911 from maropu/QueryPlanBug.
Authored-by: Takeshi Yamamuro <yamamuro@apache.org> Signed-off-by:
Wenchen Fan <wenchen@databricks.com>
(commit: 4adc282)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala (diff)
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/plans/QueryPlanSuite.scala (diff)
Commit 279334797234f5f83abd6879874b389e110920c2 by wenchen
[SPARK-32511][SQL] Add dropFields method to Column class
### What changes were proposed in this pull request?
1. Refactored `WithFields` Expression to make it more extensible (now
`UpdateFields`). 2. Added a new `dropFields` method to the `Column`
class. This method should allow users to drop a `StructField` in a
`StructType` column (with similar semantics to the `drop` method on
`Dataset`).
### Why are the changes needed?
Often Spark users have to work with deeply nested data e.g. to fix a
data quality issue with an existing `StructField`. To do this with the
existing Spark APIs, users have to rebuild the entire struct column.
For example, let's say you have the following deeply nested data
structure which has a data quality issue (`5` is missing):
``` import org.apache.spark.sql._ import
org.apache.spark.sql.functions._ import org.apache.spark.sql.types._
val data = spark.createDataFrame(sc.parallelize(
     Seq(Row(Row(Row(1, 2, 3), Row(Row(4, null, 6), Row(7, 8, 9),
Row(10, 11, 12)), Row(13, 14, 15))))),
     StructType(Seq(
       StructField("a", StructType(Seq(
         StructField("a", StructType(Seq(
           StructField("a", IntegerType),
           StructField("b", IntegerType),
           StructField("c", IntegerType)))),
         StructField("b", StructType(Seq(
           StructField("a", StructType(Seq(
             StructField("a", IntegerType),
             StructField("b", IntegerType),
             StructField("c", IntegerType)))),
           StructField("b", StructType(Seq(
             StructField("a", IntegerType),
             StructField("b", IntegerType),
             StructField("c", IntegerType)))),
           StructField("c", StructType(Seq(
             StructField("a", IntegerType),
             StructField("b", IntegerType),
             StructField("c", IntegerType))))
         ))),
         StructField("c", StructType(Seq(
           StructField("a", IntegerType),
           StructField("b", IntegerType),
           StructField("c", IntegerType))))
       )))))).cache
data.show(false)
+---------------------------------+
|a                                |
+---------------------------------+
|[[1, 2, 3], [[4,, 6], [7, 8, 9]]]|
+---------------------------------+
``` Currently, to drop the missing value users would have to do
something like this:
``` val result = data.withColumn("a",
struct(
   $"a.a",
   struct(
     struct(
       $"a.b.a.a",
       $"a.b.a.c"
     ).as("a"),
     $"a.b.b",
     $"a.b.c"
   ).as("b"),
   $"a.c"
))
result.show(false)
+---------------------------------------------------------------+
|a                                                              |
+---------------------------------------------------------------+
|[[1, 2, 3], [[4, 6], [7, 8, 9], [10, 11, 12]], [13, 14, 15]]|
+---------------------------------------------------------------+
``` As you can see above, with the existing methods users must call the
`struct` function and list all fields, including fields they don't want
to change. This is not ideal as:
>this leads to complex, fragile code that cannot survive schema
evolution.
[SPARK-16483](https://issues.apache.org/jira/browse/SPARK-16483)
In contrast, with the method added in this PR, a user could simply do
something like this to get the same result:
``` val result = data.withColumn("a", 'a.dropFields("b.a.b"))
result.show(false)
+---------------------------------------------------------------+
|a                                                              |
+---------------------------------------------------------------+
|[[1, 2, 3], [[4, 6], [7, 8, 9], [10, 11, 12]], [13, 14, 15]]|
+---------------------------------------------------------------+
```
This is the second of maybe 3 methods that could be added to the
`Column` class to make it easier to manipulate nested data. Other
methods under discussion in
[SPARK-22231](https://issues.apache.org/jira/browse/SPARK-22231) include
`withFieldRenamed`. However, this should be added in a separate PR.
### Does this PR introduce _any_ user-facing change?
The documentation for `Column.withField` method has changed to include
an additional note about how to write optimized queries when adding
multiple nested Column directly.
### How was this patch tested?
New unit tests were added. Jenkins must pass them.
### Related JIRAs: More discussion on this topic can be found here:
- https://issues.apache.org/jira/browse/SPARK-22231
- https://issues.apache.org/jira/browse/SPARK-16483
Closes #29795 from fqaiser94/SPARK-32511-dropFields-second-try.
Authored-by: fqaiser94@gmail.com <fqaiser94@gmail.com> Signed-off-by:
Wenchen Fan <wenchen@databricks.com>
(commit: 2793347)
The file was addedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UpdateFields.scala
The file was addedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CombineUpdateFieldsSuite.scala
The file was modifiedsql/core/src/main/scala/org/apache/spark/sql/Column.scala (diff)
The file was removedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CombineWithFieldsSuite.scala
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ComplexTypes.scala (diff)
The file was modifiedsql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/complexTypesSuite.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala (diff)
The file was removedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/WithFields.scala
The file was addedsql/core/benchmarks/UpdateFieldsBenchmark-results.txt
The file was addedsql/core/src/test/scala/org/apache/spark/sql/UpdateFieldsBenchmark.scala
The file was modifiedsql/core/src/test/scala/org/apache/spark/sql/ColumnExpressionSuite.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala (diff)
Commit ddc7012b3d4cd05c6695378989c9d1a78102bbbd by wenchen
[SPARK-32243][SQL] HiveSessionCatalog call super.makeFunctionExpression
should throw earlier when got Spark UDAF Invalid arguments number error
### What changes were proposed in this pull request? When we create a
UDAF function use class extended `UserDefinedAggregeteFunction`,  when
we call the function,  in support hive mode, in HiveSessionCatalog, it
will call super.makeFunctionExpression, 
but it will catch error  such as the function need 2 parameter and we
only give 1, throw exception only show 
``` No handler for UDF/UDAF/UDTF xxxxxxxx
``` This is confused for develop , we should show error thrown by super
method too,
For this pr's UT : Before change, throw Exception like
``` No handler for UDF/UDAF/UDTF
'org.apache.spark.sql.hive.execution.LongProductSum'; line 1 pos 7
``` After this pr, throw exception
``` Spark UDAF Error: Invalid number of arguments for function
longProductSum. Expected: 2; Found: 1; Hive UDF/UDAF/UDTF Error: No
handler for UDF/UDAF/UDTF
'org.apache.spark.sql.hive.execution.LongProductSum'; line 1 pos 7
```
### Why are the changes needed? Show more detail error message when
define UDAF
### Does this PR introduce _any_ user-facing change? People will see
more detail error message when use spark sql's UDAF  in hive support
Mode
### How was this patch tested? Added UT
Closes #29054 from AngersZhuuuu/SPARK-32243.
Authored-by: angerszhu <angers.zhu@gmail.com> Signed-off-by: Wenchen Fan
<wenchen@databricks.com>
(commit: ddc7012)
The file was modifiedsql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDAFSuite.scala (diff)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala (diff)
The file was addedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InvalidUDFClassException.scala
The file was modifiedsql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala (diff)
Commit 0812d6c17cc4876bb87a9d1fec35ec8c7b2365f0 by gurwls223
[SPARK-33073][PYTHON] Improve error handling on Pandas to Arrow
conversion failures
### What changes were proposed in this pull request?
This improves error handling when a failure in conversion from Pandas to
Arrow occurs. And fixes tests to be compatible with upcoming Arrow 2.0.0
release.
### Why are the changes needed?
Current tests will fail with Arrow 2.0.0 because of a change in error
message when the schema is invalid. For these cases, the current error
message also includes information on disabling safe conversion config,
which is mainly meant for floating point truncation and overflow. The
tests have been updated to use a message that is show for past Arrow
versions, and upcoming.
If the user enters an invalid schema, the error produced by pyarrow is
not consistent and either `TypeError` or `ArrowInvalid`, with the latter
being caught, and raised as a `RuntimeError` with the extra info.
The error handling is improved by:
- narrowing the exception type to `TypeError`s, which `ArrowInvalid` is
a subclass and what is raised on safe conversion failures.
- The exception is only raised with additional information on disabling
"spark.sql.execution.pandas.convertToArrowArraySafely" if it is enabled
in the first place.
- The original exception is chained to better show it to the user.
### Does this PR introduce _any_ user-facing change?
Yes, the error re-raised changes from a RuntimeError to a ValueError,
which better categorizes this type of error and in-line with the
original Arrow error.
### How was this patch tested?
Existing tests, using pyarrow 1.0.1 and 2.0.0-snapshot
Closes #29951 from
BryanCutler/arrow-better-handle-pandas-errors-SPARK-33073.
Authored-by: Bryan Cutler <cutlerb@gmail.com> Signed-off-by: HyukjinKwon
<gurwls223@apache.org>
(commit: 0812d6c)
The file was modifiedpython/pyspark/sql/tests/test_arrow.py (diff)
The file was modifiedpython/pyspark/sql/pandas/serializers.py (diff)
The file was modifiedpython/pyspark/sql/tests/test_pandas_grouped_map.py (diff)
Commit b5e4b8c73e10743eef4d35b6e82053a5a065b2ed by srowen
[SPARK-27428][CORE][TEST] Increase receive buffer size used in
StatsdSinkSuite
### What changes were proposed in this pull request?
Increase size of socket receive buffer in these tests.
### Why are the changes needed?
The socket receive buffer size set in this test was too small for the
StatsdSinkSuite tests to run reliably on some systems. For a test in
this suite to run reliably the buffer needs to be large enough to hold
all the data in the packets being sent in a test along with any
additional kernel or protocol overhead. The amount of kernel overhead
per packet can vary from system to system but is typically far higher
than the protocol overhead.
If the receive buffer is too small and fills up then packets are
silently dropped. This leads to the test failing with a timeout.
If the socket defaults to a larger receive buffer (normally true) then
we should keep that size.
As well as increasing the minimum buffer size I've also decoupled the
datagram packet buffer size from the receive buffer size. The receive
buffer should in general be far larger to account for the fact that
multiple packets might be buffered, as well as the aforementioned
overhead. Any truncated data in individual packets will be picked up by
the tests.
### Does this PR introduce _any_ user-facing change?
No, this only affects the tests.
### How was this patch tested? Existing tests on IBM Z and x86.
Closes #29819 from mundaym/fix-statsd.
Authored-by: Michael Munday <mike.munday@ibm.com> Signed-off-by: Sean
Owen <srowen@gmail.com>
(commit: b5e4b8c)
The file was modifiedcore/src/test/scala/org/apache/spark/metrics/sink/StatsdSinkSuite.scala (diff)
Commit ec6fccb922f721e5a44d89c93f711f44ce9d6592 by wenchen
[SPARK-32243][SQL][FOLLOWUP] Fix compilation in HiveSessionCatalog
Fix a mistake when merging https://github.com/apache/spark/pull/29054
Closes #29955 from cloud-fan/hot-fix.
Authored-by: Wenchen Fan <wenchen@databricks.com> Signed-off-by: Wenchen
Fan <wenchen@databricks.com>
(commit: ec6fccb)
The file was modifiedsql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala (diff)
Commit 17d309dfacd4bdebbcd9609dd24a9e65a1a2b4f5 by wenchen
[SPARK-32963][SQL] empty string should be consistent for schema name in
SparkGetSchemasOperation
### What changes were proposed in this pull request? This PR makes the
empty string for schema name pattern match the global temp view as same
as it works for other databases.
This PR also add new tests to covering different kinds of wildcards to
verify the SparkGetSchemasOperation
### Why are the changes needed?
When the schema name is empty string, it is considered as ".*" and can
match all databases in the catalog. But when it can not match the global
temp view as it is not converted to ".*"
### Does this PR introduce _any_ user-facing change?
yes , JDBC operation like
`statement.getConnection.getMetaData..getSchemas(null, "")` now also
provides the global temp view in the result set.
### How was this patch tested?
new tests
Closes #29834 from yaooqinn/SPARK-32963.
Authored-by: Kent Yao <yaooqinn@hotmail.com> Signed-off-by: Wenchen Fan
<wenchen@databricks.com>
(commit: 17d309d)
The file was modifiedsql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/SparkMetadataOperationSuite.scala (diff)
The file was modifiedsql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkGetSchemasOperation.scala (diff)
Commit 3b2a38d73578e8760dbd6c34e427896a8cde00dd by dhyun
[SPARK-32511][SQL][FOLLOWUP] Fix the broken build for Scala 2.13 with
Maven
### What changes were proposed in this pull request?
This PR fixes the broken build for Scala 2.13 with Maven.
https://github.com/apache/spark/pull/29913/checks?check_run_id=1187826966
#29795 was merged though it doesn't successfully finish the build for
Scala 2.13
### Why are the changes needed?
To fix the build.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
`build/mvn -Pscala-2.13 -Phive -Phive-thriftserver -DskipTests package`
Closes #29954 from sarutak/hotfix-seq.
Authored-by: Kousuke Saruta <sarutak@oss.nttdata.com> Signed-off-by:
Dongjoon Hyun <dhyun@apple.com>
(commit: 3b2a38d)
The file was modifiedsql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala (diff)