Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(streaming-kafka-api): Reuse existing service token on MSK Kafka API #731

Merged
merged 14 commits into from
Sep 13, 2024

Conversation

armaseg
Copy link
Contributor

@armaseg armaseg commented Sep 10, 2024

When deploying multiple stacks with the KafkaAPI, if there is an already existing service token deployed for the custom resource, you can reuse it to reduce the number of resource created.

This will additionally reduce the numbers of IP assigned to the Lambdas (custom resources)

Description of changes:

Checklist

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Copy link
Contributor

@lmouhib lmouhib left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you expose the service token both in the MSK Serverless and provisioned? make it a cloudformation output.

Copy link
Contributor

@lmouhib lmouhib left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also add what props are required when using the service token? Can you maybe add check? Example we do not need Iam Role.

@lmouhib lmouhib force-pushed the feat/kafka-api-byo-service-token branch from e179cdd to 68756bb Compare September 10, 2024 13:12
@lmouhib lmouhib force-pushed the feat/kafka-api-byo-service-token branch from 699f11f to 4d1f3b3 Compare September 10, 2024 15:13
@lmouhib lmouhib changed the title feat: Reuse existing service token on MSK Kafka API feat(streaming-msk): Reuse existing service token on MSK Kafka API Sep 10, 2024
@lmouhib lmouhib changed the title feat(streaming-msk): Reuse existing service token on MSK Kafka API feat(streaming-kafka-api): Reuse existing service token on MSK Kafka API Sep 10, 2024
@lmouhib lmouhib added the e2e-ready This PR is ready to be E2E-tested label Sep 11, 2024
@github-actions github-actions bot added e2e-testing This PR is currently being E2E-tested and removed e2e-ready This PR is ready to be E2E-tested labels Sep 11, 2024
@github-actions github-actions bot added e2e-completed The E2E tests have completed on this PR and removed e2e-testing This PR is currently being E2E-tested labels Sep 11, 2024
framework/src/streaming/README.md Outdated Show resolved Hide resolved
framework/src/streaming/lib/msk/kafka-api.ts Outdated Show resolved Hide resolved
framework/src/streaming/lib/msk/kafka-api.ts Outdated Show resolved Hide resolved
@lmouhib lmouhib merged commit b842fdc into main Sep 13, 2024
3 checks passed
@lmouhib lmouhib deleted the feat/kafka-api-byo-service-token branch September 13, 2024 08:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
e2e-completed The E2E tests have completed on this PR
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants