Welcome to the official site for the AWS Native Cross-account Observability Dashboard.
This project provides A comprehensive observability solution for AWS environments, meticulously designed following the AWS Well-Architected Framework. (SEC01-BP01: a multi-account strategy, SEC04-BP01: centralizing logs, etc.)1
- AWS Native Cross-account Observability Dashboard
- 🪩 Table of Contents
- 🪩 Overview
- 🪩 Key Features
- 🪩 More Screenshots
- 🚀AWS Configuration Management
- 🚀AWS Serverless Overview
- ✰ ☁️Centralized Observability Metrics (🔴API-Gateway)
- ✰ ☁️Centralized Observability Metrics (🟠Lambda)
- ✰ ☁️Centralized Observability Metrics (🔵DynamoDB)
- ✰ ☁️Centralized Observability Metrics (🔴EventBridge(Bus))
- ✰ ☁️Centralized Observability Metrics (🔴SQS)
- ✰ ☁️Centralized Observability Metrics (🔴Cognito)
- ✰ ☁️Centralized Observability Metrics (🔴CloudWatch Logs)
- 🚀AWS Serverless Observability Monitoring👀
- 🪩 Getting Started
- 🪩 License
We know there is no perfect dashboard for everyone. Because their purpose is different. But hoping this dashboard is for starting point of your dashboard. It’s because to craft dashboard from zero is super-doper hard.🫠
The AWS Native Cross-account Observability Dashboard is composed of three parts and integrates seamlessly with the AWS Management Console (🔴CloudWatch Logs Insights / 🔴CloudTrail / 🔵X-Ray).
- The 🚀AWS Configuration Management provides deep insights into Identity and Access Management within a complex AWS environment using a multi-account strategy.
- Centralized Monitoring for AWS Services:
- The 🚀AWS Serverless Overview / 🚀AWS Serverless Observability Monitoring👀 offer deep insights into the AWS Serverless World, based on the principles of Cloud Native Observability theory (Logs, Metrics (The Four Golden Signals, RED patterns), Traces, Service maps, Percentiles, etc.).2
This project, as part of the #AWSAlwaysFreeChallenge, is dedicated to driving innovation through no-cost(Pay-As-You-Go), open-source solutions.
By leveraging advanced techniques and open-source tools, we aim to provide alternatives that match or even surpass the functionality of expensive AWS premium services (often costing $4-5 digits per month)3🥲, such as Amazon OpenSearch, Amazon Athena, and Managed Grafana.
Our goal is to empower companies and developers with high-performance, cost-efficient solutions that deliver robust cloud observability without the financial burden of premium pricing.
| ✅ Features | ☀️Grafana's download site |
|---|---|
| 🟢Cost and Usage Tracking: | Visualize your AWS Free Tier usage and associated costs to manage your cloud expenditure effectively. |
| 🔴AWS Organizations Insights: | Monitor organizational units, accounts, policies, and access reports, enabling you to manage your AWS environment efficiently. |
| 🔴AWS Identity Center Dashboard: | Visualize workforce user assignments, permission sets, and identity store details. |
| 🔴IAM of Multi-Account AWS Environment: | Gain detailed insights into IAM roles, policies, and user activities from all accounts to enhance security and compliance. |
| Centralized 🔴CloudWatch and 🔴CloudTrail Logs: | Monitor and filter the latest AWS CloudTrail requests, including details from AWS Organizations, Identity Center, and IAM. |
🫶🏻 This dashboard is designed following the RED Pattern (Rate, Errors, Duration) and the Four Golden Signals (Latency, Traffic, Errors, and Saturation), ensuring comprehensive observability and monitoring of your AWS Serverless architecture.
| ✅ Features | ☀️Grafana's download site |
|---|---|
| 🔵AWS X-Ray Trace Statistics: | - High Level Overall: This helps you to get your system health across all accounts in your Organization. |
| 🔴API Gateway Performance Monitoring: | - Request Total (RPM): Monitor total API requests with counts for each endpoint to see traffic trends and request patterns. - Response Time (Max): Analyze maximum response times to identify potential bottlenecks in API performance. - Integration Response Time: Track time taken to integrate with back-end services, helping diagnose slow integrations. - 4xx and 5xx Error Analysis: View paths with the highest errors, along with HTTP methods and IP addresses, for effective troubleshooting. - Most Popular API Paths: Highlight frequently accessed API paths to assist in optimizing performance and resource allocation. |
| 🟠AWS Lambda Performance Insights: | - Request Total (RPM): Track Lambda invocations per function(synchronous and asynchronous) to gauge usage and monitor spikes. - Duration Metrics with Percentiles: View average and maximum execution durations, with percentiles (average, p75, p90, p95, p99) for deeper insights into response variability. This help us identify extreme outliers, which's the worst customer experiences. - Concurrency Metrics: Observe concurrent executions to ensure Lambda scaling aligns with demand. - Error and Throttle Tracking: Track errors and throttled invocations, ensuring smoother operations and faster troubleshooting. |
| 🔵DynamoDB Performance Monitoring: | - Request Latency: Track successful request latencies for both read and write operations to optimize DynamoDB performance. - Capacity Utilization: Monitor consumed capacity units for reads and writes to ensure you stay within provisioned limits and avoid throttling. - Error Tracking: Watch for system errors like ConditionalCheckFailedRequests to ensure data consistency and transactional integrity.- Throttle Events: Stay informed about any throttled requests and adjust provisioned capacity to maintain performance. |
| 🔴EventBridge Performance Monitoring: | - Request Total (RPM): Track total EventBridge requests to monitor event flow across services. - Invocation Latency: View latency metrics for each event-driven invocation, helping optimize event handling speed. - Dead Letter Invocations and Throttled Rules: Monitor failed invocations and throttling to improve event reliability. |
| 🔴SQS Performance Monitoring: | - Requests (Sent/Received RPM): Track messages sent and received by SQS queues to understand queue activity. - Age of Oldest Message: Monitor the oldest message age in the queue to ensure timely processing. - Delayed Messages: View delayed messages to optimize queue configuration and performance. |
| 🔴Cognito Performance Monitoring | - Sign-in and Sign-up Success Tracking: View real-time sign-in and sign-up successes to monitor authentication performance. - Challenge Requests: Track the number of authentication challenges triggered in Cognito, helping monitor suspicious or failed attempts. |
| 🔴CloudWatch Logs Insights: | - Incoming Log Events and Bytes: Visualize the rate of log events and data volume (bytes/sec) from AWS services such as API Gateway, Lambda, and DynamoDB. - Error and Throttle Analysis: Monitor delivery errors, log forwarding, and throttling for effective troubleshooting of log data flow. - Real-Time Monitoring: Ensure smooth, real-time logging for various services to stay ahead of potential performance issues. |
| ✅ Features | ☀️Grafana's download site |
|---|---|
| 🔴API Gateway Request and Error Monitoring: | - Track Recent API Gateway Requests: View the latest 300 API Gateway requests with detailed metadata, including IP addresses, request methods, and response statuses. - Error Analytics: Spot errors (4xx and 5xx) instantly, with the ability to drill down into error details for troubleshooting. |
| 🟠AWS Lambda Deep Insights: | - Track Recent Lambda Executions: Examine detailed logs for the most recent Lambda invocations, including execution status, request ID, and X-Ray trace information. - Enhanced Lambda Debugging: Easily filter and find Lambda execution logs tied to specific API requests using correlation IDs from API Gateway and trace IDs. |
| 🔵AWS X-Ray Trace Monitoring: | - Real-time Trace Visualization: Get a complete visual breakdown of API Gateway requests and Lambda invocations using X-Ray traces. Trace the path of a request as it moves through API Gateway, Lambda, and DynamoDB using Service Map.- Detailed Latency Breakdown: Understand the latency of each service involved in a transaction, helping you identify performance bottlenecks at a glance with the Distributed tracing. |
| Centralized 🔴CloudTrail Logs: | - Cross-Service Correlation: Track recent AWS API requests. Easily identify and troubleshoot issues across multiple services, including who called the API and from where. |
Here are some examples of the dashboards you can create with this project. (Also Our limited Demo-site is here🙃)
Role Customer Managed Policies Users - AccountID
- Arn
- AssumeRolePolicyDocument
- AttachedManagedPolicies
- CreateDate
- InstanceProfileList
- Path
- PermissionsBoundary
- RoleId
- RoleLastUsed
- RoleName
- RolePolicyList
- Tags- AccountID
- Arn
- AttachmentCount
- CreateDate
- DefaultVersionId
- IsAttachable
- Path
- PermissionsBoundaryUsageCount
- PolicyId
- PolicyName
- PolicyVersionList
- UpdateDate- AccountID
- Arn
- AttachedManagedPolicies
- CreateDate
- GroupList
- Path
- PermissionsBoundary
- Tags
- UserId
- UserName
CloudTrail - Event Time
- 🌐Region
- Event Source
- Event Name
- Event Type
- 👤User Ident. Type
- 👥Invoked By
- 🐾From
- 🐾User Agent
- ➡️👤Recipient Account ID
- Event ID
- Request ID
- 👀Details
- Event Version
- @logStream
 |
 |
👀 More detail of it
| Service Map | Distributed tracing |
|---|---|
 |
 |
To get started with the AWS Native Cross-account Observability Dashboard:
- Set up the necessary data sources using our AWS Native Observability Exporters repository. (Only for the 🚀AWS Configuration Management)
- Clone the repository (or just download the Dashboard source files.) and follow the installation instructions.
This project is licensed under the MIT License. See the LICENSE file for more information.
Thank you for using the AWS Native Cross-account Observability Dashboard.
We are committed to helping you maintain robust, secure, and cost-efficient AWS environments as part of the #AWSAlwaysFreeChallenge.🙃
💡 Note:
- Amazon OpenSearch Service Pricing
- Amazon Athena Pricing
- Amazon Managed Grafana pricing
- Amazon CloudWatch Pricing
- AWS CloudTrail pricing
- AWS X-Ray Pricing