Streaming JSON data to Spark or Google Cloud Dataproc.
-
Updated
May 8, 2023 - Python
#
google-cloud-dataproc
Here are 12 public repositories matching this topic...
Sua missão será criar um ecossistema de Big Data usando o Google Cloud Platform (GCP). Para isso, o expert te ensinará a configurar o Google Cloud Dataproc, um Hadoop totalmente gerenciado, usando seus créditos gratuitos da GCP.
-
Updated
Sep 15, 2021 - Python
Projeto do Curso "Criando um Ecossistema Hadoop Totalmente Gerenciado com Google Cloud Dataproc" do Bootcamp Data Engineer da Digital Innovation One
-
Updated
Aug 21, 2021 - Shell
A sample demo to check latest spark, big query connector and scala 2.12
-
Updated
May 26, 2021 - Scala
-
Updated
May 27, 2022 - Python
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
-
Updated
Nov 6, 2024 - Java
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
-
Updated
Oct 30, 2024 - Java
Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
-
Updated
Nov 11, 2024 - Shell
[DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
kubernetes
operator
apache-beam
apache-flink
kubernetes-operator
google-cloud-dataproc
flink-operator
-
Updated
Sep 2, 2022 - Go
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
kubernetes
spark
apache-spark
kubernetes-operator
kubernetes-controller
kubernetes-crd
google-cloud-dataproc
-
Updated
Nov 11, 2024 - Go
Improve this page
Add a description, image, and links to the google-cloud-dataproc topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the google-cloud-dataproc topic, visit your repo's landing page and select "manage topics."