Developed an ETL pipeline for real-time ingestion of stock market data from the stock-market-data-manage.onrender.com API. Engineered the system to store data in Parquet format for optimized query processing and incorporated data quality checks to ensure accuracy prior to visualization.

Creates dashboards and a notification endpoint on AWS managed Grafana

Terraform module to deploy Grafana on ECS.