Skip to content

Commit

Permalink
Prearing 0.14.0-beta release
Browse files Browse the repository at this point in the history
  • Loading branch information
davidrabinowitz committed Mar 31, 2020
1 parent 4ac4ac2 commit 375e617
Show file tree
Hide file tree
Showing 3 changed files with 16 additions and 10 deletions.
10 changes: 8 additions & 2 deletions CHANGES.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,17 @@
# Release Notes

## 0.14.0-beta - xxxx-xx-xx
## 0.14.0-beta - 2020-03-31
* Issue #96: Added Arrow as a supported format for reading from BigQuery
* Issue #130 Adding the field description to the schema metadata
* Issue #124: Fixing null values in ArrayType
* Issue #143: Allowing the setting of `SchemaUpdateOption`s When writing to BigQuery
* PR #148: Add support for writing clustered tables
* Upgrade version of google-cloud-bigquery library to 1.110.0
* Upgrade version of google-cloud-bigquerystorage library to 0.126.0-beta


## 0.13.1-beta - 2020-02-14
* The BigQuery Storage API was reverted to v1beta2. The v1beta2 API has not been
* The BigQuery Storage API was reverted to v1beta1. The v1beta2 API has not been
fully integrated with custom IAM roles, which can cause issues to customers using
those. The v1beta1 doesn't have this problem. Once the integration is complete,
the API will be upgraded again.
Expand Down
14 changes: 7 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,8 +76,8 @@ repository. It can be used using the `--packages` option or the

| Scala version | Connector Artifact |
| --- | --- |
| Scala 2.11 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.13.1-beta` |
| Scala 2.12 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.13.1-beta` |
| Scala 2.11 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.14.0-beta` |
| Scala 2.12 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.14.0-beta` |

## Hello World Example

Expand Down Expand Up @@ -533,7 +533,7 @@ using the following code:
```python
from pyspark.sql import SparkSession
spark = SparkSession.builder\
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.13.1-beta")\
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.14.0-beta")\
.getOrCreate()
df = spark.read.format("bigquery")\
.option("table","dataset.table")\
Expand All @@ -543,7 +543,7 @@ df = spark.read.format("bigquery")\
**Scala:**
```python
val spark = SparkSession.builder
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.13.1-beta")
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.14.0-beta")
.getOrCreate()
val df = spark.read.format("bigquery")
.option("table","dataset.table")
Expand All @@ -552,7 +552,7 @@ val df = spark.read.format("bigquery")

In case Spark cluster is using Scala 2.12 (it's optional for Spark 2.4.x,
mandatory in 3.0.x), then the relevant package is
com.google.cloud.spark:spark-bigquery-with-dependencies_**2.12**:0.13.1-beta. In
com.google.cloud.spark:spark-bigquery-with-dependencies_**2.12**:0.14.0-beta. In
order to know which Scala version is used, please run the following code:

**Python:**
Expand All @@ -576,14 +576,14 @@ To include the connector in your project:
<dependency>
<groupId>com.google.cloud.spark</groupId>
<artifactId>spark-bigquery-with-dependencies_${scala.version}</artifactId>
<version>0.13.1-beta</version>
<version>0.14.0-beta</version>
</dependency>
```

### SBT

```sbt
libraryDependencies += "com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.13.1-beta"
libraryDependencies += "com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.14.0-beta"
```

## Building the Connector
Expand Down
2 changes: 1 addition & 1 deletion build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ lazy val sparkVersion = "2.4.0"

lazy val commonSettings = Seq(
organization := "com.google.cloud.spark",
version := "0.13.2-beta-SNAPSHOT",
version := "0.14.0-beta",
scalaVersion := scala211Version,
crossScalaVersions := Seq(scala211Version, scala212Version)
)
Expand Down

0 comments on commit 375e617

Please sign in to comment.