[Feedback] docs/components/spark-operator/user-guide/gcp.md

[nrawal47]

The specified image does not exist.

[andreyvelich]

/assign @ChenYi015 @yuchaoran2011 @vara-bonthu @jacobsalway

[jacobsalway]

This is referring to gcr.io/ynli-k8s/spark:v2.3.0-gcs right?

[ChenYi015]

The GCP related documentation have not been updated for years, I have no idea whether it is still applicable now.

[andreyvelich]

I would suggest to remove this documentation page if that doesn't work now.

[nrawal47]

To be clear, this is the jar that works for us:

jars:
        - "local:///opt/spark/jobs/lib/gcs-connector-3.0.2-shaded.jar"

relevant hadoopConf:

fs.AbstractFileSystem.gs.impl: "com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS"
fs.gs.impl: "com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem" # testing
fs.gs.auth.service.account.enable: "false"
fs.gs.auth.type: "UNAUTHENTICATED"