Terraform AWS MWAA

Tutorial for Amazon Managed Workflows for Apache Airflow (MWAA) with Terraform. This is a word for word translation of the official AWS quick start (with CloudFormation).

Prerequisites

1. Install Terraform v1.0.10.
2. Update the Terraform S3 backend in providers.tf (only for production).
3. Create a terraform.tfvars file in the root directory. Example below.

Variables

Below is an example terraform.tfvars file that you can use in your deployments:

aws_access_key = "AKICGY7QD2Z74EXAMPLE"
aws_secret_key = "fVSlK+df5htRFRqxP7AFGsLy6K19pEOa7example"
# aws_session_token is optional
aws_session_token = "your_aws_session_token"
region   = "ap-southeast-2"
prefix   = "airflow"
vpc_id = "vpc-01c8a77ac9example"
private_subnet_ids = [
  "subnet-b46032ec",
  "subnet-a46032fc"
]
max_workers = 2

DAGs

There's a test DAG file inside the local dags directory, which was taken from the official tutorial for Apache Airflow v1.10.12. You can place as many DAG files inside that directory as you want and Terraform will pick them up and upload them to S3.

Usage

terraform init
terraform fmt
terraform validate
terraform plan
terraform apply

Make sure to keep the terraform state files safe, as they contain your access keys to the S3 bucket.