Skip to content

Commit b956492

Browse files
authored
feat(glue-alpha): support Glue Version 5.1 (#36223)
### Issue # (if applicable) N/A ### Reason for this change AWS Glue now supports ver Glue 5.1. Ref:https://aws.amazon.com/about-aws/whats-new/2025/11/aws-glue-5-1/ ### Description of changes Add an enum. ### Describe any new or updated permissions being added N/A ### Description of how you validated changes Add an enum and an integ test. ### Checklist - [x] My code adheres to the [CONTRIBUTING GUIDE](https://github.com/aws/aws-cdk/blob/main/CONTRIBUTING.md) and [DESIGN GUIDELINES](https://github.com/aws/aws-cdk/blob/main/docs/DESIGN_GUIDELINES.md) ---- *By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
1 parent eee3ae6 commit b956492

File tree

11 files changed

+630
-399
lines changed

11 files changed

+630
-399
lines changed

packages/@aws-cdk/aws-glue-alpha/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -113,7 +113,7 @@ new glue.PySparkEtlJob(stack, 'PySparkETLJob', {
113113
description: 'This is a description',
114114
role,
115115
script,
116-
glueVersion: glue.GlueVersion.V3_0,
116+
glueVersion: glue.GlueVersion.V5_1,
117117
continuousLogging: { enabled: false },
118118
workerType: glue.WorkerType.G_2X,
119119
maxConcurrentRuns: 100,
@@ -169,7 +169,7 @@ new glue.PySparkStreamingJob(stack, 'PySparkStreamingJob', {
169169
description: 'This is a description',
170170
role,
171171
script,
172-
glueVersion: glue.GlueVersion.V3_0,
172+
glueVersion: glue.GlueVersion.V5_1,
173173
continuousLogging: { enabled: false },
174174
workerType: glue.WorkerType.G_2X,
175175
maxConcurrentRuns: 100,
@@ -222,7 +222,7 @@ new glue.PySparkEtlJob(stack, 'pySparkEtlJob', {
222222
description: 'This is a description',
223223
role,
224224
script,
225-
glueVersion: glue.GlueVersion.V3_0,
225+
glueVersion: glue.GlueVersion.V5_1,
226226
continuousLogging: { enabled: false },
227227
workerType: glue.WorkerType.G_2X,
228228
maxConcurrentRuns: 100,

packages/@aws-cdk/aws-glue-alpha/lib/constants.ts

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -211,10 +211,14 @@ export enum GlueVersion {
211211
V4_0 = '4.0',
212212

213213
/**
214-
* Glue version using Spark 3.5.2 and Python 3.11
214+
* Glue version using Spark 3.5.4, Python 3.11, and Scala 2.12.18
215215
*/
216216
V5_0 = '5.0',
217217

218+
/**
219+
* Glue version using Spark 3.5.6, Python 3.11, and Scala 2.12.18
220+
*/
221+
V5_1 = '5.1',
218222
}
219223

220224
/**

packages/@aws-cdk/aws-glue-alpha/test/constants.test.ts

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,10 @@ describe('Glue Version', () => {
5454
test('V3_0 should set Glue Version correctly', () => expect(glue.GlueVersion.V3_0).toEqual('3.0'));
5555

5656
test('V4_0 should set Glue Version correctly', () => expect(glue.GlueVersion.V4_0).toEqual('4.0'));
57+
58+
test('V5_0 should set Glue Version correctly', () => expect(glue.GlueVersion.V5_0).toEqual('5.0'));
59+
60+
test('V5_1 should set Glue Version correctly', () => expect(glue.GlueVersion.V5_1).toEqual('5.1'));
5761
});
5862

5963
describe('Job Language', () => {

packages/@aws-cdk/aws-glue-alpha/test/integ.job-pyspark-etl.js.snapshot/aws-glue-job-pyspark-etl.assets.json

Lines changed: 7 additions & 5 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

packages/@aws-cdk/aws-glue-alpha/test/integ.job-pyspark-etl.js.snapshot/aws-glue-job-pyspark-etl.template.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -153,7 +153,7 @@
153153
"arg2": "value2"
154154
},
155155
"Description": "Optional Override PySpark ETL Job",
156-
"GlueVersion": "3.0",
156+
"GlueVersion": "5.1",
157157
"JobRunQueuingEnabled": true,
158158
"MaxRetries": 0,
159159
"Name": "Optional Override PySpark ETL Job",

packages/@aws-cdk/aws-glue-alpha/test/integ.job-pyspark-etl.js.snapshot/awsgluejobpysparketlintegtestDefaultTestDeployAssertED1ACE14.assets.json

Lines changed: 3 additions & 2 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

packages/@aws-cdk/aws-glue-alpha/test/integ.job-pyspark-etl.js.snapshot/cdk.out

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

packages/@aws-cdk/aws-glue-alpha/test/integ.job-pyspark-etl.js.snapshot/integ.json

Lines changed: 3 additions & 2 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)