- aws-is-how
- 常见故障排除及支持手册
- AWS Skill builder
- freeCodeCamp
- Architecture Design
- AI/ML
- Cost
- Computing
- Analytics
- High Level Data Engineering and Data Analytics
- Data integration service: Glue
- Analysis: EMR
- Data On EKS
- Stream - Flink and Spark Streaming
- Stream - Kinesis
- Stream - Kafka
- Ad-hoc and Interactive query: Athena
- Data Warehouse: Redshfit
- Search and analytics: Elasticsearch Service
- Governance
- BI
- Delta Lake
- IOT
- Security
- Encryption - KMS
- Credential - Secret Manager
- Certificate - Certificate Manager
- Asset Management and Compliance
- AuthN and AuthZ
- Sentitive Data
- Threat detection - GuardDuty
- WAF
- Permission - IAM Policy, S3 Policy, RAM Policy
- Multi accounts structure
- SIEM and SOC
- Vulnerability Assessment - Inspector and Alternative
- Network
- DNS
- Serverless
- Migration
- Storage
- Database
- Container
- DevOps
- Integration
- Media
- Mobile
- Business continuity
- Game
- SAP
- Office and business application
- Metaverse
- Automotive
- HealthCare and Life Science
-
Install External Libraries and Kernels in SageMaker Notebook Instances
-
CloudFormation to launch SageMaker Notebook on Glue Dev Endpoint
-
Save costs by automatically shutting down idle resources within Amazon SageMaker Studio
-
Scale YOLOv5 inference with Amazon SageMaker endpoints and AWS Lambda
-
How to improve user engagement with real-time AR effects using BytePlus Effects and Amazon IVS
-
[GenAI Overview]
- 一文读懂AIGC
- 跨模态深度学习模型CLIP(Contrastive Language-Image Pre-Training)
- “对抗生成网络”GAN(Generative Adverserial Network)
- Diffusion模型
- Token, Embeding, Self-Attention, Transformer, Vector, Encoding output 101
- ChatGPT Overview
- AIGC workshop
- 三类场景赋能行业创新
- A guide to making your AI vision a reality
- understand The tokenize
- 一文读懂AIGC
-
[Stable Diffsusion]
- stable-diffusion-webui self hosted on g4dn.xlarge with Ubuntu 22.04 LTS
- Remember run
sudo apt-get update
beforesudo apt install wget git python3 python3-venv
. - Run
ssh -L 7862:localhost:7862 ubuntu@xxxx.xxx.xx.xxx
orbash stable-diffusion-webui/webui.sh --share
- Install Nvida Cuda
- create-your-own-stable-diffusion-ui-on-aws
- sagemaker-stablediffusion-quick-kit
- Stabule Diffusion on EKS
- Stable Diffusion Quick Kit 动手实践 – 基础篇
- Stable Diffusion Extention hosting on AWS
- SageMaker Notebook 机器学习服务轻松托管 Stable Diffusion WebUI
- Stable Diffusion on Amazon SageMaker Workshop
- inpaint-images-with-stable-diffusion-using-amazon-sagemaker-jumpstart
- Remember run
- stable-diffusion-webui self hosted on g4dn.xlarge with Ubuntu 22.04 LTS
-
[Industry focus]
-
[Vector database]
-
[LLM]
- LangChain for LLM Application Development
- Baichuan on Sagemaker
- ChatGLM on SageMaker
- ChatYuan on SageMaker
- ColossalAI for LLM quick training
- 基于亚马逊云科技 AI 服务打造多模态智能化内容审核
- Reduce container startup time on Amazon EKS with Bottlerocket data volume
- Patterns for Building Generative AI Applications on Amazon Bedrock
- 使用 Amazon SageMaker 和 Bedrock 构建营销场景端到端应用
- 构建端到端生成式 AI 应用
- Amazon Bedrock Workshop
- Amazon Bedrock Claude3 Workshop
- 莉莉丝项目组在 GenAI 的技术实践
- 莉莉丝项目组在大模型多模态上的实践
- 使用 Amazon Bedrock,Claude3 和 CrewAI 构建应用商城用户评论分析工具
- Bedrock 赋能猛兽派对内部飞书创新智能问答
- open_artifacts_for_bedrock
- Claude Artifacts workshop
- Fine-tune Anthropic’s Claude 3 Haiku in Amazon Bedrock to boost model accuracy and quality
- Use Llama 3.1 405B for synthetic data generation and distillation to fine-tune smaller models
- streaming response from Amazon Bedrock with FastAPI on AWS Lambda
- 为生成式 AI 产品打造持续的卓越用户体验——跨区域高可用弹性解决方案
- Use AWS PrivateLink to set up private access to Amazon Bedrock
-
[RAG - retrieval-augmented generation. It solves inherent knowledge limitations of FMs by integrating with data that are not part of the model’s training]
- 基于智能搜索的大语言模型增强方案
- 基于智能搜索的大语言模型增强方案2
- 基于智能搜索和大模型打造企业下一代知识库
- 基于智能搜索和大模型打造企业下一代知识库 之 制造/金融/教育/医疗行业实战场景
- 基于 RDS 和 Confluence 数据源构建端到端的RAG
- 基于大语言模型和推荐系统构建电商智能导购机器人
- 基于大语言模型知识问答应用落地实践 – 知识召回调优
- 基于LLM 和 Amazon Opensearch 或 Amazon Kendra 打造企业私有知识库
- 基于Amazon Open Search+大语言模型的智能问答系统
- AI Powered Chatbot
- Building a serverless document chat with AWS Lambda and Amazon Bedrock
- GenAI Data Foundation Workshop - Healthcare RAG chatbot
- RAGChecker for RAG health check
- 基于 AWS 服务实现具备专词映射能力的大语言模型翻译
- Implementing advanced prompt engineering with Amazon Bedrock
- Evaluating prompts at scale with Prompt Management and Prompt Flows for Amazon Bedrock
- Enhance performance of generative language models with self-consistency prompting
-
[Promote-Engineering]
-
[Text2SQL]
-
[Video and Audio]
-
[Code Generation]
-
[Agent and workflow]
- NLP and Text Classification by using blazing text
- Use AWS SageMaker BlazingText to process un-balance data for text multiple classification The git repo
- Chinese-BERT
- 使用 Amazon SageMaker Ground Truth 标记 3D 点云 and guide
- [CV Labeling]
Using AWS IoT and Amazon SageMaker to do IoT Devices Predictive Maintenance
IoT Time-series Forecasting for Predictive Maintenance
-
[Tagging when instance and object created]
-
[Linux Daily usage]
-
[Performance]
-
[Windows Daily usage]
-
[GPU Daily usage]
-
[Network of EC2]
-
[Graviton]
-
[Operation]
- What does :-1 mean in python
- Change EC2 Time-Zone
- How can I set up a CloudWatch alarm to automatically recover my EC2 instance?
- Move EC2 instance to other AZ
- Best practices for handling EC2 Spot Instance interruptions
- How to share the EC2 AMI
- Copy AMI from global to China
- How to handle EC2 detected degradation
- Check if a reboot is required after installing Linux updates
aws ssm get-parameters-by-path --path /aws/service/global-infrastructure/regions --output json --profile us-east-1 --region us-east-1 | jq '.Parameters[].Name'
aws ssm get-parameters-by-path --path /aws/service/global-infrastructure/regions --output json --profile us-east-1 --region us-east-1 | jq '.Parameters[].Name' | wc -l
-
Orchestrating high performance computing with AWS Step Functions and AWS Batch
-
[NICE DCV]
- NICE DCV Guide
- NICE DCV Connection Gateway - enables users to access a fleet of NICE DCV servers through a single access point to a LAN or VPC
- NICE DCV Session Manager - the Agents, a Broker and API that makes it easy to build front-end applications that programmatically create and manage the lifecycle of NICE DCV sessions across a fleet of NICE DCV servers
-
SOCA
-
Harness the power of your data with AWS Analytics with Lake House
-
Volkswagen streamlined access to data across multiple data lakes using Amazon DataZone
-
[ETL]
-
[Glue Crawler]
-
[Workflow]
-
[Catalogs]
-
[Delta Lake]
-
[Develop Code]
- EMR Notebooks and SageMaker Use EMR notebooks to prepare data for machine learning and call SageMaker from the notebook to train and deploy a machine learning model.
- Submit EMR Job remotely
-
[Workflow]
-
[Install and Delopyment]
-
[Performance and HA]
-
[Security]
- EMR on EKS Best Practice Guide
- EMR on EKS workshop
- Mobileye: Spark on EKS migration
- Tool to convert spark-submit to StartJobRun EMR on EKS API
- Orchestrate an Amazon EMR on Amazon EKS Spark job with AWS Step Functions
- data-on-eks
- EMR on EKS 与 Apache Kyuubi 的数据驱动之旅
- [Flink on EMR]
- 基于 Hudi + Flink多流拼接(大宽表)最佳实践
- ClickStream workshop
- Clickstream Analytics on AWS
- 多库多表场景下使用Amazon EMR CDC实时入湖
- How to do analysis and virtulization DynamoDB
- AWS Kinesis Workshop
- Sending Data to an Amazon Kinesis Data Firehose Delivery Stream
- lambda as a consumer for kinesis
-
[Connection]
-
[Reliability]
-
[Performance & Cost]
-
How to use the Athena to create the complex embeded table and query the table
-
[Athena Perfomrance]
-
Use CTAS statements with Amazon Athena to reduce cost and improve performance
-
[Usage]
-
[Redshift performance]
-
[CDC to Redshift]
-
[ClickHouse and S3]
-
[Streaming datawarehouse]
-
[Lake Formation]
-
[Data Quality with Deequ]
-
[Data Quality with Great Expectations]
-
- Configure ADFS Identity Federation with Amazon QuickSight
- Enabling Amazon QuickSight federation with Azure AD
- Manage users and group memberships on Amazon QuickSight using SCIM events generated in IAM Identity Center with Azure AD
- AWS Managed Microsoft AD to authenticate users in QuickSight
- QuickSight deployment models for cross-account and cross-Region access to Redshift and RDS
-
Integrate Power BI with Amazon Redshift for insights and analytics
-[DataBricks]
- AWS Security Hands on Lab - URL need whitelist
- AWS Security Hands on Lab2
- Public Access Consideration
- Curated list of links, references, books videos, tutorials, Exploit, CTFs, Hacking Practices etc. which are related to AWS Security
- An AWS Pentesting tool that lets you use one-liner commands to backdoor an AWS account's resources
- Top 2022 AWS data protection service and cryptography tool
- BMW automation compliance-at-scale
- Automated Security Response on AWS
- Share-CMK-across-multiple-AWS-accounts
- Using-SM-Key-Algorithm-in-China
- Demystifying KMS keys operations, bring your own key (BYOK), custom key store, and ciphertext portability
- bring your own key to AWS KMS
- Multi-Region keys in AWS KMS
-
How to build a CA hierarchy across multiple AWS accounts and Regions for global organization
-
[Validate the ACM certificate]
-
Summary the Single-Sign-On cases
- Enabling Federation to AWS console using Windows Active Directory, ADFS, and SAML 2.0
- Using IAM federation and Switch role to implement the Single Sign On multiple AWS Accounts
- Okta-OpenID-AWS-in-the-Browser
- Enabling custom identity broker access to the AWS console
- Grant my Active Directory users access to the API or AWS CLI with AD FS
- Using-temporary-credentials-with-AWS-resources
- Okta - AWS China multi-account console integration
- Keycloak on aws
- Keycloak with Okta OpenID Connect Provider
- Managing temporary elevated access just-in-time access to your AWS environment
- Using global region SSO service to federate China region console
- How to solve private ip exhaustion with private nat solution
- How do I troubleshoot network performance issues between EC2 and on-premises host over the internet gateway
- How do I modify the IPv4 CIDR block of my Amazon VPC
-
Why can’t I connect to an S3 bucket using a gateway VPC endpoint?
-
How do I configure cross-Region Amazon VPC interface endpoints to access AWS PrivateLink resources?
-
Amazon Direct Connect inter-region routing for public access resources
-
Direct Connect and AWS Local Zones interoperability patterns
- Cross region EC2 to EC2 transfering speed testing
- cross-border-data-synchronization with data transfer hub
-
Using Amazon Global Accelerator to improve cross board request improvement
-
Measuring AWS Global Accelerator performance and analyzing results
-
Optimizing performance for users in China with Amazon Route 53 and Amazon CloudFront
-
[Traffic Mirror]
DNS hijacked using http dns bypass
-
Lambda integration
- Using AWS Lambda with Amazon Kinesis
- How to put the S3 event to Kafka using lambda
- Demo how to send the Lambda logs to S3 and ElasticSearch by using Kiensis Firehose
- Run the serverless wordpress with AWS Lambda and AWS EFS
- AWS 告警通知到微信
- Lambda write PostgreSQL
- Lambda sent email
- 使用 Lambda 函数URL + CloudFront 实现S3镜像回源
-
Lambda usage
- Schedule-Invoke-Lambda
- AWS Lambda Custom Runtime for PHP
- How to clean up the elastic network interface created by Lambda in VPC mode
- How to get the lambda public IP address
- How to retrieve the System Manager Parameter Store from lambda
- Understanding the Different Ways to Invoke Lambda Functions
- Run web applications on AWS Lambda without changing code
- Disney use the open source and serverless
- Liftshift web app to serverless - part1
- Liftshift web app to serverless - part2
- lambda extensions
-
Lambda cost
-
Lambda performance
- #1 – Preparing your Applications for Hypergrowth
- #2 – Maximizing System Throughput
- #3 – Improved Resilience and Standardized Observability
- #4 – Governing Security at Scale and IAM Baselining
- #5 – Enhancing Threat Detection, Data Protection, and Incident Response
-
Migrating SQL Server to Amazon RDS using native backup and restore
-
Best practices for migrating PostgreSQL databases to Amazon RDS and Amazon Aurora
-
Aurora launches instances in at least 3 AZ even if less are specified
- Migration-Data-From-AliCloud
- [XData])migration/DataMigration/XData.md
- Flink CDC Database Data
- Migrate from AliCoud workshop
- Assess secure Windows Servers for TCO analysis using Migration Evaluator
-
How to sync S3 bucket data between global region and China region
-
Synchronize S3 bucket contents with Amazon S3 Batch Replication
-
Uploading to Amazon S3 directly from a web or mobile application
-
S3 disale TLS1.1 access or enforce TLS1.2 for in-transit encryption
-
How Trend Micro uses Amazon S3 Object Lambda to help keep sensitive data secure
-
通过 STS Session Tags 来对 AWS 资源进行更灵活的权限控制 - 但是需要一个认证机制去确保userid可信的
-
Hosting Internal HTTPS Static Websites with ALB, S3, and PrivateLink
- storage-gateway-demo and performance testing
- How can I troubleshoot an S3AccessDenied error from my file gateway
- How can I set up a private network connection between a file gateway and Amazon S3
- Resolve an internal error when activating my Storage Gateway
-
Amazon FSx for Lustre or Amazon FSx for Windows File Server Workshop
-
Amazon FSx for Windows File Server file share on an Amazon EC2 Linux instance You can mount an Amazon FSx for Windows File Server file share on an Amazon EC2 Linux instance that is either joined to your Active Directory or not joined.
-
Deploying IPFS Cluster using AWS Fargate and Amazon EFS One Zone
-
Amazon Aurora MySQL Database Quick Start Reference Deployment
-
Use Proxysql for RDS for MySQL or Aurora databases connection pool and Read/Write Split
-
[PostgreSQL Logging]
-
rds-postgresql ERROR: <module/extension> must be loaded via shared_preload_libraries
-
[MySQL 手工分库分表]
-
Achieving minimum downtime for major version upgrades in Amazon RDS PostgreSQL
-
How to Migrate from Amazon RDS Aurora or MySQL to Amazon Aurora Serverless
-
Moving to Graviton2 for Amazon RDS and Amazon Aurora databases
-
How to use the Neptune to Build Your First Graph Application
-
Diagram-as-code using generative AI to build a data model for Amazon Neptune
-
[Migration and Replication]
- 如何将我的 DynamoDB 表从一个 AWS 账户迁移到另一个账户
- Streaming Amazon DynamoDB data into a centralized data lake
- 中国区与 Global 区域 DynamoDB 表双向同步
- aws-dynamodb-cross-region-replication
- DynamoDB table initial migration from global to China
- 使用 Lambda 订阅Amazon DynamoDB 变更数据,并传输到Amazon OpenSearch,实现全文检索
- Understanding Amazon DynamoDB latency
- 大规模 DynamoDB 表数据跨账号迁移指南
-
[Security]
-
[Performance]
Serverless or Kubernetes on AWS
-
Exposing Kubernetes Applications via service and ingress resource
-
How do I expose the Kubernetes services running on my Amazon EKS cluster
-
[How do I use multiple CIDR ranges with Amazon EKS]
-
[EKS Managed Group]
- Overview
- Quotas
- Official doc
- Cluster autoscaler Managed node groups are managed using Amazon EC2 Auto Scaling groups, and are compatible with the Cluster Autoscaler. You can deploy the Cluster Autoscaler to your Amazon EKS cluster and configure it to modify your Amazon EC2 Auto Scaling groups.
- Vertical Pod Autoscaler
- Horizontal Pod Autoscaler
-
Install SSM Agent on Amazon EKS worker nodes by using Kubernetes DaemonSet
-
How can I check, scale, delete, or drain my worker nodes on EKS
-
Application first delivery on Kubernetes with Open Application Model
-
[Karpenter]
-
ECR Sync up from global from China and ECS Service Discovery
-
How can I create an Application Load Balancer and then register Amazon ECS tasks automatically
-
[Amazon ECS firelens]
-
Running microservices in Amazon EKS with AWS App Mesh and Kong
-
[EKS and CloudMap]
[AWS Well-Architected]
[Organizing Your AWS Environment Using Multiple Accounts]
-
Monitor using Prometheus and Grafana Here is how to deploy Grafana on EKS
-
Set up cross-region metrics collection for Amazon Managed Service for Prometheus workspaces
-
Create cross-account, custom Amazon Managed Grafana dashboards for Amazon Redshift
-
[Grafana and CloudWatch integration]
-
[Log Hub]
-
Collecting AWS networking information in large multi-account environments
-
Find Public IPs of Resources – Use AWS Config for Vulnerability Assessment
-
service-screener - evaluate their AWS service configurations
- AmazonMQ-Workshop
- Automate RabbitMQ configuration in Amazon MQ
- consumer_timeout Amazon RabbitMQ 不支持修改
- [Jenkins 与 RabbitMQ集成]
-
Understand resiliency patterns and trade-offs to architect efficiently in the cloud
-
[Building a disaster recovery site on AWS for workloads on Google Cloud]
- [unreal engine game server]
-
[Software Define Vechile - SDV]
- soafee aws iotfleetwise demo
- 在AWS上构建基于SOAFEE的云原生软件定义汽车实践
- A Cloud-Native Environment for Distributed Automotive Software Development
- Simulating Automotive E/E Architectures in AWS – Part 1: Accelerating the V-Model
- Simulating Automotive E/E Architectures in AWS Part 2: Solution in Action
- Automotive Demo Lab
- 揭秘安卓 AOSP 系统构建提速 50%
- 车载以太网为什么要用SOME/IP?
-
[Autonomous Driving]
- ADDF is a collection of modules, deployed using the SeedFarmer orchestration tool. ADDF modules enable users to quickly bootstrap environments
- Develop and deploy a customized workflow using Autonomous Driving Data Framework (ADDF) on AWS
- 详解智能驾驶的功能与场景体系
- Deploy and Visualize ROS Bag Data on AWS
- 在中国区部署 SIMPHERA Architecture
- 理想汽车过去一年发表的16篇智驾及AI应用相关论文
-
[Vechile Data Plantform - VDP]
-
[Connected Mobility Services - CMS]