iceberg-1.3.1 cannot compatible with hive-1.1.0? #6438
Answered
by
pan3793
davidyuan1223
asked this question in
Q&A
-
[Version] [Spark conf]
[iceberg create SQL]
[error info]
|
Beta Was this translation helpful? Give feedback.
Answered by
pan3793
May 31, 2024
Replies: 1 comment 1 reply
-
AFAIK, Iceberg supports HMS 2.1 ~ 2.3 and 3.0~3.1 when Spark built-in Hive version is 2.3.9. |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
davidyuan1223
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
spark.sql.hive.metastore.version=1.1.0
only affects Spark built-in HMS client, while Iceberg always uses the Hive jars under$SPARK_HOME/jars
to construct HMS client.AFAIK, Iceberg supports HMS 2.1 ~ 2.3 and 3.0~3.1 when Spark built-in Hive version is 2.3.9.