Skip to content

liangruibupt/aws-is-how

Repository files navigation

aws-is-how

Architecture Design

AI/ML

ML Study

ML入门的知识,以及ML项目中的一些经验总结分享

SageMaker

Jupyter Notebooks

Compute vision

ChatGPT and AIGC

NLP

Translate and Audio

Forecasting

Fraud Detection

Recommandation

Labeling

Federated ML

Prediction Maintenance

Using AWS IoT and Amazon SageMaker to do IoT Devices Predictive Maintenance

IoT Time-series Forecasting for Predictive Maintenance

ML Hardware

Cost

Cost Explorer

Network cost

Tagging

Sustainablity

Computing

EC2

Load Balancer

System Manager

aws ssm get-parameters-by-path --path /aws/service/global-infrastructure/regions --output json --profile us-east-1 --region us-east-1 | jq '.Parameters[].Name'

aws ssm get-parameters-by-path --path /aws/service/global-infrastructure/regions --output json --profile us-east-1 --region us-east-1 | jq '.Parameters[].Name' | wc -l

HPC

Analytics

High Level Data Engineering and Data Analytics

Data integration service: Glue

Analysis: EMR

Data On EKS

Stream - Flink and Spark Streaming

Stream - Kinesis

Stream - Kafka

Ad-hoc and Interactive query: Athena

Data Warehouse: Redshfit

Search and analytics: Elasticsearch Service

Governance

BI

Delta Lake

-[DataBricks]

IOT

IoT Core

IoT Timeseries

OEE

IoT anaytics

Edge

OTA

AIOT

Security

Encryption - KMS

Credential - Secret Manager

Certificate - Certificate Manager

Asset Management and Compliance

AuthN and AuthZ

Sentitive Data

Threat detection - GuardDuty

WAF

Permission - IAM Policy, S3 Policy, RAM Policy

Multi accounts structure

SIEM and SOC

Vulnerability Assessment - Inspector and Alternative

Network

Test Performance/Latency

VPC

Keep private - VPC Endpoint and PrivateLink

NAT and proxy

Load balancers

Cross data center and cloud Leasing Line - Direct Connect and VPN

Cross board transfer

Cross accounts and Cross VPCs - TGW

Acceleration network

Edge

Network Secuirty

DNS

Route 53

HTTPDNS

DNS hijacked using http dns bypass

Serverless

Serverless Workshop

Function as Service - Lambda

API Gateway

Step function

Build the serverless - SAM, Chalice, Serverless framwork, CDK

Serverless with AI/ML

Migration

Journey to Adopt Cloud-Native Architecture

Active Directory

Database

Data migration tool - DMS

Data migration tool - 3rd party tool

Cross Cloud Migration

File migration

Storage

S3 cross region or cross cloud OSS

S3

EBS

Storage Gatewway

EFS and FSx or other shared file system

Database

RDS

RDS usage

RDS Cross region, cross account, data replication and backup

RDS upgrade

RDS Security

RDS Performance

-Amazon Aurora 压力测试

Graph Database

ElastiCache

Key-Value and Document

DynamoDB

MongoDB and DocumentDB

Time series

Container

EKS

Serverless or Kubernetes on AWS

EKS networking

EKS practice

DevOps on EKS

ECS

Fargate

Istio, Envoy, App Mesh, Service discovery

ECR

DevOps

Management

[AWS Well-Architected]

[Organizing Your AWS Environment Using Multiple Accounts]

CI/CD

Serverless CICD

Container CICD

Monitoring and Tracing

Quota Monitor on AWS

Logging

Change configuration

Developer

Infra as Code

Integration

Quque, notification

Call Center

MQ

Email

Media

Video on Demand

Video Streaming

Mobile

Moible app development

GraphQL - AppSync

Business continuity

Backup

DR

RDS HA/DR

Resilience

Game

GameLift

SAP

HA/DR

Office and business application

Workspaces - VDI

Metaverse

Automotive

HealthCare and Life Science