Random increase in deploy time for dag-only deploys

[sakethsomaraju]

Describe the bug

When multiple dag-only deploys were triggered in a small time frame, a few of them completed in ~5 seconds, and a few took ~10 minutes duration for deployment.

What CLI Version did you experience this bug?

Astro CLI Version: 1.31.0

This CLI bug is related to which Astronomer Platform?

• [Y] Astro
• Software
• None/Unknown

What Operating System is the above CLI installed on?

MAC OS

🪜 Steps To Reproduce

1. create a deployment
2. Create few dag files in ( dags/ ) directory ( ~20 files) (bundle size less than 2mb)
3. Perform initial image deployment.
4. Run the following bash script to trigger multiple dag-only deploys.

#!/bin/bash


COMMAND="sudo astro deploy DEPLOY_ID --dags"

TIME_LOG="time_log.txt"

> "$TIME_LOG"

for i in {1..40}
do
  START_TIME=$(date +%s) 
  $COMMAND                  
  END_TIME=$(date +%s)  
  
  ELAPSED_TIME=$((END_TIME - START_TIME))
  
  echo "Execution $i: ${ELAPSED_TIME} seconds" >> "$TIME_LOG"
done

echo "Execution times logged in $TIME_LOG"

Sample timings observed:

Execution 1: 6 seconds
Execution 2: 5 seconds
Execution 3: 5 seconds
Execution 4: 543 seconds
Execution 5: 12 seconds
Execution 6: 161 seconds
Execution 7: 7 seconds
Execution 8: 318 seconds
Execution 9: 17 seconds
Execution 10: 4 seconds
Execution 11: 4 seconds
Execution 12: 5 seconds
Execution 13: 4 seconds
Execution 14: 4 seconds
Execution 15: 552 seconds
Execution 16: 40 seconds
Execution 17: 4 seconds
Execution 18: 5 seconds
Execution 19: 423 seconds
Execution 20: 68 seconds
Execution 21: 5 seconds
Execution 22: 4 seconds
Execution 23: 5 seconds
Execution 24: 5 seconds
Execution 25: 4 seconds
Execution 26: 5 seconds
Execution 27: 5 seconds
Execution 28: 4 seconds
Execution 29: 4 seconds
Execution 30: 5 seconds
Execution 31: 4 seconds
Execution 32: 5 seconds
Execution 33: 130 seconds
Execution 34: 6 seconds
Execution 35: 4 seconds
Execution 36: 4 seconds
Execution 37: 5 seconds
Execution 38: 4 seconds
Execution 39: 4 seconds
Execution 40: 4 seconds