From 4e50c95f90eb86f2ab46ae487ba27b1f54da9ab6 Mon Sep 17 00:00:00 2001 From: kbuilder Date: Mon, 7 Aug 2023 08:53:40 -0700 Subject: [PATCH] Release 0.32.2. --- CHANGES.md | 2 +- README.md | 36 ++++++++++++++++++------------------ 2 files changed, 19 insertions(+), 19 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index ef8159d0f..b5d96b16c 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -1,6 +1,6 @@ # Release Notes -## Next +## 0.32.2 - 2023-08-07 * CVE-2023-34462: Upgrading netty to verision 4.1.96.Final diff --git a/README.md b/README.md index 0530886c9..f4afb42a4 100644 --- a/README.md +++ b/README.md @@ -57,12 +57,12 @@ The latest version of the connector is publicly available in the following links | version | Link | |------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| Spark 3.3 | `gs://spark-lib/bigquery/spark-3.3-bigquery-0.32.1.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-3.3-bigquery-0.32.1.jar)) | -| Spark 3.2 | `gs://spark-lib/bigquery/spark-3.2-bigquery-0.32.1.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-3.2-bigquery-0.32.1.jar)) | -| Spark 3.1 | `gs://spark-lib/bigquery/spark-3.1-bigquery-0.32.1.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-3.1-bigquery-0.32.1.jar)) | -| Spark 2.4 | `gs://spark-lib/bigquery/spark-2.4-bigquery-0.32.1.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-2.4-bigquery-0.32.1.jar)) | -| Scala 2.13 | `gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.13-0.32.1.jar` ([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-bigquery-with-dependencies_2.13-0.32.1.jar)) | -| Scala 2.12 | `gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.12-0.32.1.jar` ([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-bigquery-with-dependencies_2.12-0.32.1.jar)) | +| Spark 3.3 | `gs://spark-lib/bigquery/spark-3.3-bigquery-0.32.2.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-3.3-bigquery-0.32.2.jar)) | +| Spark 3.2 | `gs://spark-lib/bigquery/spark-3.2-bigquery-0.32.2.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-3.2-bigquery-0.32.2.jar)) | +| Spark 3.1 | `gs://spark-lib/bigquery/spark-3.1-bigquery-0.32.2.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-3.1-bigquery-0.32.2.jar)) | +| Spark 2.4 | `gs://spark-lib/bigquery/spark-2.4-bigquery-0.32.2.jar`([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-2.4-bigquery-0.32.2.jar)) | +| Scala 2.13 | `gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.13-0.32.2.jar` ([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-bigquery-with-dependencies_2.13-0.32.2.jar)) | +| Scala 2.12 | `gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.12-0.32.2.jar` ([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-bigquery-with-dependencies_2.12-0.32.2.jar)) | | Scala 2.11 | `gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.11-0.29.0.jar` ([HTTP link](https://storage.googleapis.com/spark-lib/bigquery/spark-bigquery-with-dependencies_2.11-0.29.0.jar)) | The first four versions are Java based connectors targeting Spark 2.4/3.1/3.2/3.3 of all Scala versions built on the new @@ -101,12 +101,12 @@ repository. It can be used using the `--packages` option or the | version | Connector Artifact | |------------|------------------------------------------------------------------------------------| -| Spark 3.3 | `com.google.cloud.spark:spark-3.3-bigquery:0.32.1` | -| Spark 3.2 | `com.google.cloud.spark:spark-3.2-bigquery:0.32.1` | -| Spark 3.1 | `com.google.cloud.spark:spark-3.1-bigquery:0.32.1` | -| Spark 2.4 | `com.google.cloud.spark:spark-2.4-bigquery:0.32.1` | -| Scala 2.13 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.13:0.32.1` | -| Scala 2.12 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.32.1` | +| Spark 3.3 | `com.google.cloud.spark:spark-3.3-bigquery:0.32.2` | +| Spark 3.2 | `com.google.cloud.spark:spark-3.2-bigquery:0.32.2` | +| Spark 3.1 | `com.google.cloud.spark:spark-3.1-bigquery:0.32.2` | +| Spark 2.4 | `com.google.cloud.spark:spark-2.4-bigquery:0.32.2` | +| Scala 2.13 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.13:0.32.2` | +| Scala 2.12 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.32.2` | | Scala 2.11 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.29.0` | ## Hello World Example @@ -117,7 +117,7 @@ You can run a simple PySpark wordcount against the API without compilation by ru ``` gcloud dataproc jobs submit pyspark --cluster "$MY_CLUSTER" \ - --jars gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.12-0.32.1.jar \ + --jars gs://spark-lib/bigquery/spark-bigquery-with-dependencies_2.12-0.32.2.jar \ examples/python/shakespeare.py ``` @@ -1087,7 +1087,7 @@ using the following code: ```python from pyspark.sql import SparkSession spark = SparkSession.builder - .config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.32.1") + .config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.32.2") .getOrCreate() df = spark.read.format("bigquery") .load("dataset.table") @@ -1096,7 +1096,7 @@ df = spark.read.format("bigquery") **Scala:** ```python val spark = SparkSession.builder -.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.32.1") +.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.32.2") .getOrCreate() val df = spark.read.format("bigquery") .load("dataset.table") @@ -1104,7 +1104,7 @@ val df = spark.read.format("bigquery") In case Spark cluster is using Scala 2.12 (it's optional for Spark 2.4.x, mandatory in 3.0.x), then the relevant package is -com.google.cloud.spark:spark-bigquery-with-dependencies_**2.12**:0.32.1. In +com.google.cloud.spark:spark-bigquery-with-dependencies_**2.12**:0.32.2. In order to know which Scala version is used, please run the following code: **Python:** @@ -1128,14 +1128,14 @@ To include the connector in your project: com.google.cloud.spark spark-bigquery-with-dependencies_${scala.version} - 0.32.1 + 0.32.2 ``` ### SBT ```sbt -libraryDependencies += "com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.32.1" +libraryDependencies += "com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.32.2" ``` ## FAQ