Releases: redpanda-data/kminion
Releases · redpanda-data/kminion
2.2.10 / 2024-08-30
Changelog
- 59f5c1e: goreleaser - replace deprecated --rm-dist flag with --clean (@gavinheavyside)
- 51af7e8: Merge pull request #272 from redpanda-data/gavinheavyside/update-goreleaser-flags (@gavinheavyside)
Docker Image
Use the following command to pull this release's Docker image:
docker pull redpandadata/kminion:v2.2.10
2.2.8 / 2024-04-05
Changelog
- 2e792e6: update franz-go to latest version (@weeco)
- 569fa82: update go v1.22 (@weeco)
- a50eaf7: make init phase more robust if cluster is offline (@weeco)
- 2bc1ad7: lower log level for expired/lost messages (@weeco)
- 2d34cf1: use TryProduce instead of blocking Produce if buffer is full (@weeco)
- 1f1fe71: fix disabling consumergroup or topic collection (@weeco)
Docker Image
Use the following command to pull this release's Docker image:
docker pull redpandadata/kminion:v2.2.8
2.2.7 / 2024-03-04
Changelog
- 406d198: Update image tag in Readme (@weeco)
- 4fa1a11: Add support for SASL/OAUTHBEARER (#230) (@bachmanity1)
- 9ff13ad: update docker pull image with latest (@andrewhsu)
- 5bcd78f: Merge pull request #228 from andrewhsu/docker-pull (@andrewhsu)
- 4c40fee: removes snyk cli scan - this project will now use scm integration (#241) (@wreet)
- 5a57069: chore: remove kics workflow (#242) (@weeco)
- 88dae5c: updating golang and various libs to fix security vulns (#249) (@rmb938)
Docker Image
Use the following command to pull this release's Docker image:
docker pull redpandadata/kminion:v2.2.7
2.2.6 / 2023-11-08
Changelog
- d15078f: helm: Package chart v0.11.3 (@sbocinec)
- fc3d500: build: fix .gitignore to not ignore kminion helm chart (@sbocinec)
- 83fafe3: Update README.md (@vikumar-ciena)
- f3ce983: Make kminion helm chart compatible with K8s >= 1.25 (@panyuenlau)
- 18986e8: chore: release chart v0.12.0 (@weeco)
- 752ba52: helm: allowPrivilegeEscalation=false (@simon0191)
- 2f841e3: Merge pull request #218 from redpanda-data/ss/no-proviledged-access (@simon0191)
- cde80c2: Bump appVersion (@gavinheavyside)
- b492a8c: Merge pull request #226 from redpanda-data/gavinheavyside/bump-alpine-base-image (@gavinheavyside)
- ffd4487: Revert "Bump appVersion" (@gavinheavyside)
- a4b9854: Use latest tag at time of writing in README (@gavinheavyside)
- 0c90d43: Merge pull request #227 from redpanda-data/revert-226-gavinheavyside/bump-alpine-base-image (@gavinheavyside)
Docker Image
Use the following command to pull this release's Docker image:
docker pull redpandadata/kminion:v2.2.6
2.2.5 / 2023-06-14
Changelog
- a7d4bd8: build: use the same alpine OS version in Dockerfile (@sbocinec)
- 3391840: build: run OS pkg update on image build (@sbocinec)
- 291a8ee: Merge pull request #211 from redpanda-data/st/docker-image-sync-up (@sbocinec)
Docker Image
Use the following command to pull this release's Docker image:
docker pull redpandadata/kminion:v2.2.5
2.2.4 / 2023-05-11
Changelog
- d24d713: Update all dependencies (#194) (@weeco)
- d7c838e: fix: support ingress for clusters >= 1.22 (#195) (@TheMeier)
- 764017c: Release new chart version (#197) (@weeco)
- 295efc2: fix: set apiVersion for PodDisruptionBudget depending on capabilities (#198) (@TheMeier)
- a80e807: publish kminion-0.11.1 (@joejulian)
- 22c95d6: Merge pull request #199 from redpanda-data/publish_latest (@joejulian)
- bebfda8: Add user to docker image to avoid running as root (@simon0191)
- 1b7366c: Merge pull request #202 from redpanda-data/ss/sec-add-user-to-docker-image (@simon0191)
- 2810e7d: Update default docker repository (#201) (@weeco)
- eb48b5d: helm: Package chart v0.11.2 (#204) (@weeco)
- f0a6e37: build: update docker repo in release notes (@weeco)
- 4b7bfc8: build: update go version to v1.20 (@weeco)
- 3c7e7cc: build: disable CGO when building (@weeco)
- e652142: chore: update dependencies (@weeco)
Docker Image
Use the following command to pull this release's Docker image:
docker pull redpandadata/kminion:v2.2.4
2.2.3 / 2023-03-29
Changelog
- 85993ab: Add graceful shutdown to HTTP server (@hhromic)
- 91d89fb: update franz-go to v1.10.4 (@)
- e6ed3be: Merge pull request #180 from redpanda-data/update-franz-go (@weeco)
- 7db0042: Simplify signal handling logic (@hhromic)
- 5d28b6d: Merge pull request #178 from hhromic/http-graceful-shutdown (@weeco)
- ba7d561: add extraPorts for extraContainers (@cruwe)
- 1be4f8f: Merge pull request #176 from cruwe/add-extraPorts-for-extraContainers (@weeco)
- 10ca7ea: adds snyk scanning (@wreet)
- c515483: Merge pull request #183 from redpanda-data/snyk-scanning (@weeco)
- cf800d6: adds cron for snyk scans (#184) (@wreet)
- 66777ff: build: also push docker image to redpandadata (#186) (@andrewhsu)
- 7367a4a: updates kics (#192) (@wreet)
- 89c2276: fix: unmarshal ca, privateKey, cert as string instead of byte slice (#193) (@TheMeier)
Docker Image
Use the following command to pull this release's Docker image:
docker pull vectorized/kminion:v2.2.3
2.2.2 / 2023-03-29
Changelog
- 85993ab: Add graceful shutdown to HTTP server (@hhromic)
- 91d89fb: update franz-go to v1.10.4 (@)
- e6ed3be: Merge pull request #180 from redpanda-data/update-franz-go (@weeco)
- 7db0042: Simplify signal handling logic (@hhromic)
- 5d28b6d: Merge pull request #178 from hhromic/http-graceful-shutdown (@weeco)
- ba7d561: add extraPorts for extraContainers (@cruwe)
- 1be4f8f: Merge pull request #176 from cruwe/add-extraPorts-for-extraContainers (@weeco)
- 10ca7ea: adds snyk scanning (@wreet)
- c515483: Merge pull request #183 from redpanda-data/snyk-scanning (@weeco)
- cf800d6: adds cron for snyk scans (#184) (@wreet)
- 66777ff: build: also push docker image to redpandadata (#186) (@andrewhsu)
- 7367a4a: updates kics (#192) (@wreet)
- 89c2276: fix: unmarshal ca, privateKey, cert as string instead of byte slice (#193) (@TheMeier)
Docker Image
Use the following command to pull this release's Docker image:
docker pull vectorized/kminion:v2.2.2
2.2.1 / 2022-11-24
Changelog
- 2f5e2cd: Update Helm chart with v2.2.0 image tag (@BitProcessor)
- 352c8dd: Merge pull request #134 from BitProcessor/master (@weeco)
- 3e70557: [Auto Commit] Package helm chart (@weeco)
- ddac75e: Fix the prom annotations sample (are not labels) (@BitProcessor)
- bb3014e: Fix the prom annotations sample (are not labels) (@BitProcessor)
- 8ff3a2d: Revert "Fix the prom annotations sample (are not labels)" (@BitProcessor)
- 05a03ed: Merge pull request #135 from BitProcessor/master (@weeco)
- cab4595: Upgrade franz-go to v1.4.1 (@alexander-falca)
- 2a62a9d: Merge pull request #140 from alexander-falca/franz-go-upgrade (@weeco)
- a4cbed2: Increase membersWithEmptyAssignment when MemberAssignment is empty (@Sh1ftry)
- 4fbec9a: Merge pull request #142 from Sh1ftry/empty-members-assignment (@weeco)
- a066b27: config: add possibility to specify tls as bytes (@alenkacz)
- ea8dbba: Merge pull request #147 from alenkacz/av/ca-cert-key (@weeco)
- ee700c2: Update CodeQL to latest versions (@weeco)
- 802bdab: Update Docker base image to Go v1.18 (@weeco)
- f848ea9: do not use logger.Fatal when testing connection (@alenkacz)
- d068e97: Use build flags for version and meta information instead of env variables (@weeco)
- b71e21f: Use single GH actions workflow to build Docker image and update used actions to the latest versions (@weeco)
- 52a26f9: Update GoReleaser config and build for multi arch binaries (@weeco)
- 2f6ccdf: Merge pull request #148 from alenkacz/av/no-logger-fatal (@weeco)
- f00573c: Use docker registry vectorized (@weeco)
- 72fe3ed: do not log as info from testConnection func (@alenkacz)
- 3712fd3: Merge pull request #149 from alenkacz/av/no-info-log (@weeco)
- e8181ad: Run GoReleaser only on new tags (@weeco)
- c68ad10: Create binaries on release for arm64 and amd64 (@weeco)
- 46a33d5: Update all dependencies and require Go 1.18 (@weeco)
- 125519c: Add multi-platform docker builds (@weeco)
- f97e56e: Install qemu action for multi-platform builds (@weeco)
- 9d17857: Remove logging on info level from kafka service (@alenkacz)
- 18bc1ad: Merge pull request #150 from alenkacz/av/log-info-remove (@weeco)
- f81b6c9: remove unused import (@alenkacz)
- 5425c62: Merge pull request #151 from alenkacz/av/unused-import (@weeco)
- a69839c: Replace Discord link with Slack link (@weeco)
- c3d9ae6: Add support to set Deployment annotations (@amuraru)
- 3eb190a: Merge pull request #158 from amuraru/pr (@weeco)
- 630b419: Release v0.9.0 (@weeco)
- 5a5c788: [Auto Commit] Package helm chart (@weeco)
- 7ac093a: feat: allow retry on init failure (@Scandiravian)
- 020e30e: Merge pull request #166 from Scandiravian/allow-no-crash-on-initial-connect-failure (@weeco)
- 6362e85: Add support for more features in helm chart (@antvick)
- cb9763e: Bump helm chart release version (@antvick)
- 845f8fa: Fix emptyDir volume (@antvick)
- f1ea127: Add support for any extra volume type not just emptyDir (@antvick)
- a2f1401: Update example values.yaml (@antvick)
- 37424c1: Add deployment labels (@antvick)
- 9918d41: Revert customlabels variable (@antvick)
- 58684d4: Revert deployment annotations change (@antvick)
- 60d41ec: add ignore exit fail for results (@)
- 4ededa9: add kics scanning (@)
- 71512ba: fix action-specfic issues (@)
- 0ef4ca2: Merge pull request #171 from redpanda-data/iac-scanning (@wreet)
- 71b0ac2: Revert move empty line in custom labels (@antvick)
- ebf004b: Optional readiness probe (@antvick)
- 3806868: Merge pull request #170 from nutmegdevelopment/task/extra-deployment-containers (@weeco)
- 2ddba52: Update all dependencies including runtime image (Alpine) (@weeco)
- 190dcfb: Merge pull request #172 from redpanda-data/update-dependencies (@weeco)
- 2e66a4d: Fix Go releaser config (@weeco)
- 3025881: Merge pull request #173 from redpanda-data/fix-goreleaser-cfg (@weeco)
- 1cb8f11: build: Fix condition for semver docker tag (@weeco)
- cdd8e59: Merge pull request #175 from redpanda-data/fix-docker-tag-condition-in-build-pipeline (@weeco)
Docker Image
Use the following command to pull this release's Docker image:
docker pull vectorized/kminion:v2.2.1
2.2.0 / 2021-12-17
Changelog
- d0d9e9d Make E2E service accept a prometheus registerer
- 2b50411 use right nil type to fix partition reassignments
- 236d68c Validate number of specified brokers
- 49300f0 Order imports
- 63d501b Handle other protocolTypes than consumer properly
- 461321b Lower produce request timeout to 3s
- 5fdb775 Eagerly initialize failed metrics
- ffa4211 Fix race condition in message tracker
- a082b4e Fix typo in enum variable name
- 059131a [Auto Commit] Package helm chart
- 5adc178 Release v0.8.2
- 8e169a7 Fix indenting
- 0236e2e [Auto Commit] Package helm chart
- 114cdb8 Release v0.8.1
- 7ccca22 Fix broken format
- f94e25b [Auto Commit] Package helm chart
- d6a8030 Bump chart version
- 41127e4 Add readiness probe for newer KMinion versions
- fcd8c0c Only add consume config for appropriate scrapeMode
- c1e922e Move comment into switch cases
- fb5f4d4 Remove line break to improve readability
- 62b1b51 Fix error handling for topic metadata response
- 9960755 Merge pull request #129 from Scandiravian/handle_UnknownTopicOrPartition_error
- 776cc2d Use typed error
- c0f7ac6 Create topic instead of panic, when error is UnknownTopicOrPartition
- 9162d2f Consider errors in metadata response for topic check
- 26b2314 Merge pull request #128 from alenkacz/av/send-msg-immediately
- 7c2e82e Send first e2e init message immediately
- 21e8a6b Update to franz-go v1.2.2
- d2b9046 Merge pull request #127 from alenkacz/av/helm-install
- 357f8e5 Drop --name in helm install readme
- 64d41d5 Merge pull request #124 from amuraru/pod-target-labels
- d3016f8 Propage kminion pod custom labels as metrics labels
- 8a393eb [Auto Commit] Package helm chart
- 2ed9d5a Release version 0.7.0
- e0d6dc5 Merge pull request #122 from stoader/metric_relabeling
- a09adb0 Default value for serviceMonitor.relabelings
- 0223754 Support metric relabeling
- f5c6af4 [Auto Commit] Package helm chart
- 877e893 Release chart version 0.6.0
- 1dd4368 Merge pull request #119 from mrandreyeff/add_daemonset
- 1dd0306 Merge pull request #105 from amuraru/issue-103
- ed79c19 update according to changes in values
- 4518838 change daemonset values structure
- 3f84442 Merge pull request #120 from rashid4lyf/feature/add_scrape_timeout_interval
- 89ea1c6 Merge remote-tracking branch 'origin/master' into feature/add_scrape_timeout_interval
- 430d647 update values to 10s and 15s
- af4fb49 Merge pull request #118 from mrandreyeff/add_targetLabels
- 00eb355 Extract consumer group member_count as a separate metric
- 7cbbc7d fix indent
- 66e3435 support for dynamic scrapeTimeout and interval
- caba0ad add daemonset template
- 5536165 add serviceMonitor.targetLabels
- dff9857 Merge pull request #106 from amuraru/issue-104
- 4e87969 Implemented review comments
- 320627b Export number of members and assigned partitions for each topic in a consumer group
- 30f84f5 Fixes #111
- 1e3a1d5 Introduce a state property that tracks whether a msg has been produced successfully or not
- 7b6bd7e Fix partition reassignment and creation
- a3558e0 Change default for commitSla to 5s
- c4e5e82 Move to new cache lib
- 02dbc3e Update franz-go to v0.10.2
- f10fa9e Remove unused template literal
- 01ff757 Use oneliner to access the Kafka message keys
- 6901e62 Do not try to create or modify the topic if management is disabled
- d38052f Fix offset commit metrics
- ba20914 Use named loggers everywhere
- 1545c20 Add clarifying log message during consumer init
- f6ab00e Add timeout for consumer initialization
- 6f76df2 Fix consumer initialization process for empty topics
- 020c680 Make all message metrics vectors with partition id as label
- 08dff9b Don't manage topics if not enabled
- 7e882f2 Wait for a fully initialized consumer before starting the producer
- 326337f Consume from newest offset
- f6b7b3f Add messages to messagetracker before getting produce response
- 3d59e90 Update franz-go to v0.9.1
- d452033 Add partitionID in labels
- 5e11446 Fix bug where we marked successfully received messages as lost
- 634347d Rename metrics variable names
- ded85bf Update to latest franz-go version
- 4285a76 Add timeout for producing records
- d0348bd Add timeout for producing records
- e699e83 Add counter for lost messages
- 244567c Move end to end message struct into it's own file
- a2daa17 Refactor produce methods so that it is no longer sequential
- 778e87c Remove TODO in regards to a metric tracking the failed produces
- 1c46b56 Add metrics for produced messages
- c0b7922 [Auto Commit] Package helm chart
- 2d3d03f Release version 0.5.0
- 01843a9 Add PodDisruptionBudget resource
- 7381f6b Merge pull request #98 from amuraru/hlm
- ec2c5de Tidy go mod
- 52bb5f2 Merge pull request #109 from amuraru/update-deps
- eddb2b8 Use consistent naming convention for log fields
- d6048fd Update franz-go library to 0.9.0
- aeb3b12 [helm-chart] Append customLabels to all resources if defined
- a234a98 Document ensureCompatibility method
- 5a7a20a Merge pull request #101 from amuraru/cached-groups
- f96bc3a Introduce /ready endpoint that can be used in a readiness or startup probe
- b6b6b4c Use cached consumer groups when listing offsets via Admin API
- 63cba76 Merge pull request #97 from amuraru/moretopicconfigs
- 032d501 Update minion/config_topic_config.go
- a8a95ac Update minion/config_topic_config.go
- 4cbfe01 Update minion/config_topic_config.go
- 77249c3 Allow to export configurable set of topic configuration keys
- 1a777bf Refactor some end-to-end functionality
- 8157df5 Update to franz-go v0.8.0
- 1ffd02b Print aggregated error summary
- 3c7cfad Add partitions per broker default of 1
- 01bedfc Fix reference config and change some e2e defaults
- ec31cfd Merge branch 'master' of https://github.com/cloudhut/kminion
- ce0423c update reference config
- b435183 update reference config
- 20bd38d Clarify what validateManagementTopic() does
- 8d8c683 Use key from generated kmsg instead of comparing key name
- 423e1c0 Merge branch 'endtoend'
- 17ec4dd Update franz-go to v0.8.0
- 0c33e52 Merge pull request #95 from Trackunit/feature/document-scrapemode
- be3686c Also mention the increase in CPU usage when using scrapemode=offsetsTopic
- 4305998 Document the difference between scrapemodes
- 4948761 Fix formatting of e2e monitoring metrics
- 5982e2c Fix some typos and reword a few things
- ea47f26 Merge branch 'master' of https://github.com/cloudhut/kminion
- 23a4d9a Update franz-go to v0.7.9
- 10ed356 add e2e feature documentation, updated readme with link
- ec428c0 fix issues when with logging string pointers
- 390cf6f multiple changes: - remove rebalancingProtocol config, since there will never be any rebalancing in kminions consumer groups (since every kminion instance has exactly one, unique, consumer group that it uses) - change type of 'requiredAcks' from int to string (now takes 'all' or 'leader') - lots of functions have been refactored to use "early return" and/or split into logical steps so there aren't any huge functions - 'createEndToEndRecord' doesn't return an error anymore and instead panics. if serialization fails, there must be an issue that prevents kminion from running anyway - actually set 'ProduceRequestTimeout' to 'ackSla' config property - topic.go: complete rewrite: properly validate partition count, partition assignments, replication factor; considering potentially changing broker/partition count and replicationFactor; also now error checking for all potential errors in kafka responses (including nested errors, that are for example local to only one partition)
- e262749 Merge pull request #90 from JoschaLaubach/fix-link-in-charts-docs
- 405dbc5 docs: Fix link in Helm chart readme
- 192bf30 message tracker, better comments, use time.Now() everywhere (no point in dealing with millis)
- 3754be9 custom partitioner to send messages to predetermined partitions
- 716f3e3 rename metric 'messages_commited_total' to 'commits_total' (since we're not comitting messages, but our "read offsets" per partition)
- 0546a23 use hooks to track which broker sent a response to our offset commit
- 6f7eb6d use new error reporting pattern in Produce after franz-go update, report broker_id instead of address in metrics
- 9db7976 update packages, update to latest franz-go version, fix breaking changes
- c2df9de rename "image-on-push" to "image-on-push-to-master", and create a new workflow that only builds images for pushes to any other (non-master) branch and tagging the image as "branchName-gitSha"
- e1a8788 put deleting old consumer groups into its own file (group_tracker.go)
- e36eb71 each kminion instance uses its own consumer group for end-to-end now so the instances don't "steal" messages from each other
- d5a116c remove bytesSent/Received metrics from end to end
- b4a08c5 more refactoring, seperate client hooks for each package
- 1349666 move end-to-end into its own package called e2e
- cc9a4e9 - remove SLA gauge metrics, they can be inferred from the 'inifinite' bucket in the latency histograms - methods to handle metric events (onAck, onRoundtrip, onOffsetCommit); will also soon be used to extract e2e into its own package - add _total and _seconds suffixes to metrics for best practices
- a1ca198 update e2e topic config
- 9813ad2 remove old methods; extract 'processMessage' for a small cleanup
- c8e360a many changes: - new metrics (in 3 groups): low level, SLA indicators, latency histograms - don't put metrics results in a cache, instead directly increment/observe/set on promauto objects - only generate minionID once, don't create a new one for every message - actually check minionID to filter messages from other kminion instances - check timestamp to discard old messages and establish roundtrip latency - keep track of last received message timestamp, so we can detect/skip cases where we receive older messages for whatever reason - don't call storage.markRecordConsumed since that's only for offset_consumer
- 4ae6088 log which partitions are lagging
- b8c324d update franz-go to v0.6.14
- be77e13 gitignore __de...