Skip to content

jasontanx/gsheet-to-bq-ingestion

Repository files navigation

gsheet-to-bq-ingestion

This repo is be part of the gsheet to Google BigQuery mini project

Project Overview

Description: Personal project (Gsheet ingestion)

Source: Google Spreadsheet

Apache Airflow (Orchestration Tool) : Not Involved in this project*

Destination: GCP Google BigQuery

Language: python

Main Tools Involved:

  1. Python (IDE - Visual Studio Code)
  2. Google Cloud Platform account (For ingesting data into BigQuery)

Workflow:

  • Determine credentials for permission to view the spreadsheet.

  • Write ‘Extract-Load’ (EL) pipeline code to extract data from source and load into Google BigQuery.

  • Data successfully ingested into Google BigQuery.

git_10_gsheet-to-bq

Outcome

Data successfully ingested to BQ

git_11_gsheet_bq

Useful Reference

  1. Connect Google Sheets & BigQuery - Connected Sheets --> Video 1

  2. Google Sheets - Python API, Read & Write Data --> Video 2

About

Data ingestion from Google Sheet to BigQuery

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages