Cloud-native, data onboarding architecture for Google Cloud Datasets
-
Updated
Oct 25, 2024 - Python
Cloud-native, data onboarding architecture for Google Cloud Datasets
Codebase for CCAO data infrastructure construction and management
A fictional page of a great data structure and flow, with pipelines and data stores.
A collection of sample code and tutorials focused on Docker, Kubernetes, IaC, and more, designed for mastering modern infrastructure and data engineering. Aligned with DataCraft Backbone content to provide hands-on learning for developers and engineers.
Working demo of an exciting new DataOps tool called SQLMesh, built on top of a dbt project
The website is now described as an educational resource for data management, with the objective of educating, engaging, guiding, and providing resources.
This repository is to communicate and promote the Dragon1 Open Standard for Architecture Modeling, with the Dragon1 Modeling Language. This repository will specify the modeling language and interchange file format, provide 100 example models and diagrams to help architects and designers with their tasks. https://www.dragon1.com
This project is aimed at overhauling a university's data infrastructure to improve efficiency, security, and scalability, resulting in the successful creation of a unified data management solution.
Dragon1 is an Enterprise Architecture Software Tool to design, analyze and generate maps, diagrams, visualizations with views, reports and animated scenarios (data driven) - UML, BPMN, ArchiMate, TOGAF and BizBok supported. https://www.dragon1.com
Data Engineering Digest
Project to evaluate the performance of databases in the Data Architecture postgraduate discipline "Relational and Non-Relational Databases"
Formula1 Load, Ingestion, Transformation and analysis pipeline
Data Architect course repo
Global Cycling Company Data Warehouse! We gather data from AdventureWorks 2016, utilize tools like SSMS for efficient storage and retrieval, and employ ETL processes for seamless integration and analysis. 🚴♂️🛠️
A Data Engineering repository where I will focus on applying concepts such as data modeling, ETL, proper code documentations, and unit testing.
Udacity Nanodegree Data Architect Projects
Follow along with materials in the book "Modern Data Architectures with Python: A practical guide to building and deploying data pipelines, data warehouses and data lakes" (Lipp, 2023)
DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
My collection of projects and codes
Add a description, image, and links to the data-architecture topic page so that developers can more easily learn about it.
To associate your repository with the data-architecture topic, visit your repo's landing page and select "manage topics."