A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset
-
Updated
Nov 9, 2024 - Dockerfile
#
mage-ai
Here are 27 public repositories matching this topic...
End-to-end data engineering project
-
Updated
Jul 19, 2023 - Jupyter Notebook
This end-to-end data pipeline project processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.
python
bigquery
data
automation
cloud
sql
database
docker-compose
virtual-machine
excel
gcp
mariadb
orchestration
data-engineering
maintenance
database-schema
compute-engine
work-orders
visualization-dashboard
mage-ai
-
Updated
Nov 5, 2024 - Jupyter Notebook
Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio
-
Updated
Sep 19, 2023 - Jupyter Notebook
A data engineering project built around Smogon's Stats API.
-
Updated
Apr 2, 2024 - Python
Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.
python
docker
workflow
data-science
database
etl
docker-compose
orchestration
datascience
data-engineering
data-analysis
etl-pipeline
de-zoomcamp
mage-ai
-
Updated
Mar 4, 2024 - Jupyter Notebook
-
Updated
Jan 8, 2024 - Python
mlops zoomcamp capstone project
-
Updated
Jun 25, 2024 - Jupyter Notebook
In this project, I demonstrate creating a data pipeline from NYC Taxi data using Mage.ai for ETL, GCP for storage and BigQuery, and Looker Studio for analytics.
-
Updated
Oct 4, 2024
An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.
-
Updated
Aug 12, 2023 - Jupyter Notebook
Performed data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.
-
Updated
Oct 5, 2023 - Jupyter Notebook
A quick analysis of Yellow Taxi cabs riding in New York 2022
-
Updated
Jun 11, 2023 - Jupyter Notebook
Developed an interactive dashboard utilizing Google Looker Studio to analyze Uber usage patterns in NYC. Designed a robust data model and implemented an efficient data pipeline using Mage AI on GCP's VM infrastructure. Utilized Google BigQuery for in-depth analytics and leveraged Google Cloud Platform for data processing.
bigquery
google-cloud-storage
data-engineering
data-analytics
google-cloud-platform
etl-pipeline
data-modelling
gcp-vm
looker-studio
compute-instance
mage-ai
-
Updated
Feb 2, 2024 - Jupyter Notebook
Data Engineering on GCP and Mage AI
google-cloud-storage
fact-table
big-query
sales-analytics
dimensional-modeling
looker-studio
mage-ai
-
Updated
Mar 25, 2024 - Jupyter Notebook
Project MLOps
flask
aws
streaming
monitoring
mongodb
model
grafana
orchestration
batch-processing
prefect
mlops
mlflow
mage-ai
-
Updated
Sep 28, 2024 - Jupyter Notebook
Engineered a robust data pipeline using Google Cloud Platform (GCP) services like Cloud Storage, Compute Engine, BigQuery, resulting in a 30% decrease in data processing and analysis time of the San Francisco Crime dataset.Designed an interactive dashboard using Looker Studio, empowering stakeholders to explore crime data visually.
-
Updated
Sep 21, 2023 - Jupyter Notebook
Personal project for Data Engineering Zoomcamp
-
Updated
Apr 13, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the mage-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mage-ai topic, visit your repo's landing page and select "manage topics."