Data Engineering Using Google Could Platform and Mage
-
Updated
Feb 18, 2025
Data Engineering Using Google Could Platform and Mage
Python package for approximate leave-one-out cross-validation (LOO-CV) and Pareto smoothed importance sampling (PSIS) for Bayesian Modeling
Bitcoin Navigator: A data-driven dashboard designed to analyze Bitcoin trends, empowering investors to refine their strategies and identify optimal investment opportunities.
📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.
This project demonstrates a data pipeline designed to transport shot data from the 2023/2024 Premier League season into a dashboard, where players and teams can be compared using key metrics such as xG (expected goals), xGOT (expected goals on target) and SGA (shooting goals added).
Folder for Data Analytics projects, including SQL and Python Scripts.
A speedy LookML parser & serializer implemented in pure Python.
Deploying ETL pipeline on cloud, analyzing on BigQuery, dashboarding on Looker Studio
A tool to help deploy objects from one Looker instance to another
Projeto Final da Certificação Google Cloud Data Analytics
This project demonstrates real-time train ticket booking customer data ingestion and transformation using Pub/Sub, Dataflow, BigQuery, and visualization with Looker. It enables efficient data processing, storage, and analysis for customer insights.
In this project, I built a data pipeline using Mage.ai for ETL, GCP for storage, BigQuery for querying, and Looker Studio for analytics. This project helped me learn how to process, store, and visualize data effectively using modern tools.
a case study for business improvment
Bitcoin Navigator: A data-driven dashboard designed to analyze Bitcoin trends, empowering investors to refine their strategies and identify optimal investment opportunities.
A continuous integration tool for Looker and LookML.
The goal of this project is to perform comprehensive data analytics on Uber trip data using a modern data engineering stack on Google Cloud Platform (GCP).
Add a description, image, and links to the looker topic page so that developers can more easily learn about it.
To associate your repository with the looker topic, visit your repo's landing page and select "manage topics."