Brief Tutorial on AWS Step Functions
Watch Walkthrough on O'Reilly
The overall idea is to chain AWS Lambda functions together where the input of one feeds into another function.
aws stepfunctions list-state-machines
aws stepfunctions start-execution --state-machine-arn "arn:aws:states:us-east-1:561744971673:stateMachine:Demo-Customer-Service-System" --input "{\"phrase\" : \"Today is a beautiful day\"}"
This invokes the step function remotely which is a powerful way to do serverless Data Engineering.
aws lambda list-functions