Skip to content
This repository was archived by the owner on Mar 26, 2025. It is now read-only.

Kraft fix broker context for setting inter.broker.listener.name #1093

Closed
wants to merge 69 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
69 commits
Select commit Hold shift + click to select a range
aa859a1
Exclude controller-only nodes from all CC operations
panyuenlau Jul 30, 2023
28a4a75
Add processRoles label key for Kafka pods in KRaft mode; export consts
panyuenlau Jul 30, 2023
eb441d8
Add nil pointer check before validating annotations to avoid nil poin…
panyuenlau Jul 31, 2023
4329189
feat(rollingupgrade): allow concurrent broker restarts within same br…
ctrlaltluc Aug 4, 2023
956d251
add(api/kafkauser_types): description for SecretName (#1030)
matewolf Aug 15, 2023
17bcda4
feat(k8s-csr): explicit put ca cert into kafkausers' secret when cert…
LuciferInLove Aug 18, 2023
6bdb3db
Replace the mockgen to uber fork + do a package cleanup (#1044)
szykes Aug 21, 2023
7edcd84
Readd golang/mock due to dependecy packages in go.sum (#1046)
szykes Aug 22, 2023
4b4ea64
refactor(Helm): move crds to a dedicated folder (#1047)
rappizs Aug 23, 2023
9c2ac52
fix: inconsistent imagePullSecrets inputs (#1045)
rappizs Aug 23, 2023
f695856
Eliminate hardcoded values + move them at the beginning of file (#1043)
szykes Aug 25, 2023
da8a72b
Fix e2e test module component versions (#1032)
mihaialexandrescu Aug 25, 2023
6cf4c4e
Fix some consts visibility in kafkacluster_types.go (#1053)
szykes Aug 28, 2023
f8086b5
Unexport default values (#1055)
szykes Aug 30, 2023
4285032
lint tests/e2e ; fix linter issues in tests/e2e ; annotate Makefile (…
mihaialexandrescu Aug 30, 2023
aa018ad
Use api/v0.28.8 package (#1056)
szykes Aug 30, 2023
2feac63
fix(e2e): not using up to date koperator image for e2e test (#1052)
bartam1 Aug 31, 2023
a6f7678
Add liveness and readiness probes to koperator's manager pod (#1050)
matewolf Aug 31, 2023
158c5bb
merge(#1049): add file integrity checks to CI workflow
rappizs Aug 31, 2023
6b2b109
add: multiarch docker image build (#1059)
akatona84 Oct 10, 2023
4390500
Update README.md with doc url (#1069)
fekete-robert Oct 27, 2023
9b59b31
Fix broken link in README.md (#1070)
fekete-robert Nov 1, 2023
d2b8021
[INTERNAL] Update helm for adobe builds (#52)
alungu Feb 7, 2023
a5ea111
[INTERNAL] Use local replacement for sub-modules (#54)
aguzovatii Apr 6, 2023
c1173d0
[INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and …
amuraru Apr 11, 2020
e5152f7
[INTERNAL] make manifests should be called manually, if needed (#25)
amuraru Jul 28, 2021
fe9adaf
[INTERNAL] Allow Kafka to use External DNS for inter-broker protocol …
amuraru May 17, 2021
8ca9d51
[INTERNAL] Allow external listeners to be used for inner communicatio…
amuraru May 17, 2021
4335c20
[INTERNAL] Ensure external listerners are always the first the advert…
alungu Sep 2, 2021
685da4e
[INTERNAL] Generate CRDs resources
amuraru Sep 2, 2021
84345fc
[INTERNAL] Build kafka 3.4.1 using Oracle OpenJDK
amuraru Sep 21, 2021
9b060e2
Enable envoy idleTimeout and TCP keep-alive for connections to kafka …
amuraru Oct 7, 2021
450ebe7
Enable envoy tls termination (#41)
dobrerazvan Mar 17, 2022
eea16ab
Envoy config generated by the operator is invalid in envoy 1.22
amuraru Jun 23, 2022
ecf3223
Added TaintedBrokersSelector to kafkaClusterSpec (#48)
azun Aug 11, 2022
a40d5fe
Remove disk feature (#53)
amuraru May 15, 2023
f023d28
Handle async response from CC /state endpoint (#56)
aguzovatii May 16, 2023
514fa07
Allow concurrent broker restarts from same AZ (broker rack) (#62)
amuraru Jun 10, 2023
16a9fc2
Fix flaky test by deleting nodeports explicitly (#67)
ctrlaltluc Jun 13, 2023
cdfb6b9
Allow dashes when parsing broker rack (#68)
ctrlaltluc Jun 28, 2023
18e7253
Upgrade Kafka to 3.6.0 (#69)
ctrlaltluc Oct 11, 2023
edb7ebf
Upgrade dependencies
amuraru Dec 12, 2023
5f78c06
Fix wrong port on expectEnvoyWithConfigAz2Tls test (#70)
dobrerazvan Dec 19, 2023
7383921
Upgrade Kafka to 3.6.1 (#71)
cristianpetrache Dec 22, 2023
2da23a0
working kraft
dobrerazvan Jan 23, 2024
57d22ec
Merge origin/master
dobrerazvan Jan 29, 2024
51fb7d6
Fixing go.mod
dobrerazvan Feb 7, 2024
bea02f8
Fixing tests post merge
dobrerazvan Feb 7, 2024
7b70fa6
Merge remote-tracking branch 'origin/master' into kraft
dobrerazvan Feb 7, 2024
46cf1a8
Fix tests
dobrerazvan Feb 7, 2024
168340e
Fix tests
dobrerazvan Feb 13, 2024
f205723
Fix unnecessary append
dobrerazvan Feb 13, 2024
2bb6c76
Fix go.mod
dobrerazvan Feb 13, 2024
58aa672
Update CRD
dobrerazvan Feb 13, 2024
112173c
Update go.mod for e2e
dobrerazvan Feb 13, 2024
c927063
Update go.mod
dobrerazvan Feb 13, 2024
b64f2ed
More fixes
dobrerazvan Feb 13, 2024
8172c6e
Upgrade Kafka image to use Java v21 (#72)
amuraru Feb 16, 2024
2fe3531
Merge branch 'master' into kraft
dobrerazvan Feb 19, 2024
20be375
Remove jbod cc tests
dobrerazvan Feb 20, 2024
50c2b07
Merging Master to Kraft and Reverting Rack Removal (#89)
dvaseekara Dec 9, 2024
15f6634
Trigger E2E Test
Dec 9, 2024
b55b1f7
End to end testing with KRaft cluster (#92)
dvaseekara Dec 11, 2024
1b56507
[CORE-119212] - Add/fix pdb for controllers (#94)
hvan Jan 10, 2025
c96e846
Ensure externallisteners are listed first (#97)
hvan Jan 23, 2025
55b625a
Exclude controllers from external ingress (e.g. envoy) (#95)
hvan Jan 24, 2025
5c5dbe7
adding new check for broker level readOnlyConfig (#96)
hvan Jan 27, 2025
9978dfa
Zk kraft migration (#100)
hvan Feb 21, 2025
147c13b
adding fix for koperator to add interBrokerListenerName one at a time
Feb 26, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 0 additions & 2 deletions .github/CODEOWNERS

This file was deleted.

13 changes: 11 additions & 2 deletions .github/actions/kind-create/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ inputs: # adding these parameters to make this reusable later on
kind_k8s_version:
description: 'The k8s version to use'
required: true
default: 'v1.24.15'
default: 'v1.27.3'
kind_config:
description: 'Path to the kind config to use'
required: true
Expand All @@ -23,7 +23,7 @@ runs:

steps:
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
uses: docker/setup-buildx-action@v3
- uses: engineerd/setup-kind@v0.5.0
with:
name: ${{ inputs.kind_cluster_name }}
Expand All @@ -45,3 +45,12 @@ runs:
chmod 600 $kubeconfig_path
echo "kubeconfig=$(echo $kubeconfig_path)" >> $GITHUB_OUTPUT
shell: bash

- name: Install cloud-provider-kind
id: cloud-provider-kind
run: |
echo "Install cloud-provider-kind"
go install sigs.k8s.io/cloud-provider-kind@latest
kubectl label node e2e-kind-control-plane node.kubernetes.io/exclude-from-external-load-balancers-
~/go/bin/cloud-provider-kind &
shell: bash
26 changes: 26 additions & 0 deletions .github/workflows/build-push-docker.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
name: build-publish-docker-image

on:
push:
tags:
- '*'

jobs:
build:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
- name: Get tag name
id: vars
run: echo ::set-output name=tag::${GITHUB_REF:10}
- uses: docker/build-push-action@v1
if: ${{ !startsWith( steps.vars.outputs.tag, 'kafka-' ) }}
with:
dockerfile: Dockerfile
build_args: VERSION=${{ steps.vars.outputs.tag }},GIT_SHA=${{ github.sha }}
username: ${{ secrets.DOCKER_USERNAME }}
password: ${{ secrets.DOCKER_PASSWORD }}
repository: adobe/kafka-operator
tag_with_ref: true
push: ${{ startsWith(github.ref, 'refs/tags/') }}
add_git_labels: true
47 changes: 47 additions & 0 deletions .github/workflows/build-push-kafka-docker.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
name: build-publish-kafka-docker-image

on:
push:
tags:
- 'kafka-*'

jobs:
build:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
- name: Prepare
id: prep
run: |
DOCKER_IMAGE=adobe/kafka
VERSION=latest
if [[ $GITHUB_REF == refs/tags/kafka-* ]]; then
VERSION=${GITHUB_REF#refs/tags/kafka-}
elif [[ $GITHUB_REF == refs/heads/* ]]; then
VERSION=$(echo ${GITHUB_REF#refs/heads/} | sed -r 's#/+#-#g')
fi
TAGS="${DOCKER_IMAGE}:${VERSION}"
echo ::set-output name=version::${VERSION}
echo ::set-output name=tags::${TAGS}
echo ::set-output name=created::$(date -u +'%Y-%m-%dT%H:%M:%SZ')
- name: Set up QEMU
uses: docker/setup-qemu-action@v3
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3
- name: Login to DockerHub
if: startsWith(github.ref, 'refs/tags/')
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKER_USERNAME }}
password: ${{ secrets.DOCKER_PASSWORD }}
- name: Build and push
uses: docker/build-push-action@v5
with:
context: docker/kafka
platforms: linux/amd64,linux/arm64
push: ${{ startsWith(github.ref, 'refs/tags/') }}
tags: ${{ steps.prep.outputs.tags }}
labels: |
org.opencontainers.image.source=${{ github.event.repository.html_url }}
org.opencontainers.image.created=${{ steps.prep.outputs.created }}
org.opencontainers.image.revision=${{ github.sha }}
45 changes: 41 additions & 4 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,17 +7,54 @@ on:
pull_request:

jobs:
check-integrity:
name: Check integrity
runs-on: ubuntu-22.04

steps:
- name: Set up Go
uses: actions/setup-go@v4
with:
go-version: 1.21

- name: Checkout code
uses: actions/checkout@v4

- name: Check Go modules dependency file integrity
run: |
find . -type f -name go.mod | while read module_file; do
module=$(dirname "$module_file")
pushd "$module" > /dev/null
go mod tidy
if [ "$(git status --porcelain)" != "" ]; then
printf >&2 '\n`go mod tidy` in module `%s` results in a dirty state, Go mod files are not in sync with the source code files, differences:\n\n%s\n\n' "$module" "$(git diff)"
git reset --hard
exit 1
fi
popd > /dev/null
done

- name: Check generated file integrity
run: |
make generate manifests
if [ "$(git status --porcelain)" != "" ]; then
printf >&2 '\ngenerating code files and manifests results in a dirty state, generated files are not in sync with the source code files, differences:\n\n%s\n\n' "$(git diff)"
git reset --hard
exit 1
fi

build:
runs-on: ubuntu-latest
name: Build
runs-on: ubuntu-22.04

steps:
- name: Set up Go
uses: actions/setup-go@v3
uses: actions/setup-go@v4
with:
go-version: 1.19
go-version: 1.21

- name: Checkout code
uses: actions/checkout@v3
uses: actions/checkout@v4

- name: License cache
uses: actions/cache@v3
Expand Down
71 changes: 71 additions & 0 deletions .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
# For most projects, this workflow file will not need changing; you simply need
# to commit it to your repository.
#
# You may wish to alter this file to override the set of languages analyzed,
# or to provide custom queries or build logic.
#
# ******** NOTE ********
# We have attempted to detect the languages in your repository. Please check
# the `language` matrix defined below to confirm you have the correct set of
# supported CodeQL languages.
#
name: "CodeQL"

on:
push:
branches: [ master ]
pull_request:
# The branches below must be a subset of the branches above
branches: [ master ]
schedule:
- cron: '34 23 * * 4'

jobs:
analyze:
name: Analyze
runs-on: ubuntu-latest
permissions:
actions: read
contents: read
security-events: write

strategy:
fail-fast: false
matrix:
language: [ 'go' ]
# CodeQL supports [ 'cpp', 'csharp', 'go', 'java', 'javascript', 'python' ]
# Learn more:
# https://docs.github.com/en/free-pro-team@latest/github/finding-security-vulnerabilities-and-errors-in-your-code/configuring-code-scanning#changing-the-languages-that-are-analyzed

steps:
- name: Checkout repository
uses: actions/checkout@v2

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
with:
languages: ${{ matrix.language }}
# If you wish to specify custom queries, you can do so here or in a config file.
# By default, queries listed here will override any specified in a config file.
# Prefix the list here with "+" to use these queries and those in the config file.
# queries: ./path/to/local/query, your-org/your-repo/queries@main

# Autobuild attempts to build any compiled languages (C/C++, C#, or Java).
# If this step fails, then you should remove it and run the build manually (see below)
- name: Autobuild
uses: github/codeql-action/autobuild@v2

# ℹ️ Command-line programs to run using the OS shell.
# 📚 https://git.io/JvXDl

# ✏️ If the Autobuild fails above, remove it and uncomment the following three lines
# and modify them (or add more) to build your code if your project
# uses a compiled language

#- run: |
# make bootstrap
# make release

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
56 changes: 0 additions & 56 deletions .github/workflows/docker.yml

This file was deleted.

64 changes: 0 additions & 64 deletions .github/workflows/docker_perf_test_load.yml

This file was deleted.

Loading