Skip to content
#

aws-data-engineering-project

Star

Here is 1 public repository matching this topic...

waqarg2001 / Youtube-Data-Pipeline-AWS

Star 0

Leveraging AWS Cloud Services, an ETL pipeline transforms YouTube video statistics data. Data is downloaded from Kaggle, uploaded to an S3 bucket, and cataloged using AWS Glue for querying with Athena. AWS Lambda and Glue converts to Parquet format and stores it in a cleansed S3 bucket. AWS QuickSight then visualizes the materialised data.

python aws spark aws-lambda etl aws-s3 pandas pyspark data-engineering aws-iam aws-cloudwatch data-pipeline etl-pipeline aws-glue data-engineering-workflows data-engineering-pipeline aws-lambda-layers aws-data-engineering-project data-engineering-project
  • Updated May 30, 2024
  • Python

Improve this page

Add a description, image, and links to the aws-data-engineering-project topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the aws-data-engineering-project topic, visit your repo's landing page and select "manage topics."

Learn more