Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce performance measurement example #162

Conversation

jeroenvandisseldorp
Copy link
Contributor

No description provided.

jeroenvandisseldorp and others added 30 commits August 30, 2024 15:14
- Generate example data for byte manipulation example
- Have byte manipulation example read from alternative topic
# Conflicts:
#	ksml-data-avro/NOTICE.txt
#	ksml-query/NOTICE.txt
#	ksml-reporting/NOTICE.txt
#	ksml-runner/NOTICE.txt
#	ksml-runner/src/main/java/io/axual/ksml/runner/KSMLRunner.java
#	ksml/NOTICE.txt
#	pom.xml
* DataObject interface extended with Printer enum, used to consistently print data object schema and/or value
* Updated all DataObject implementing classes to implement the new toString() method
* Make calls to toString() explicitly use a Printer type
* Add batchSize option to KSML config
* Rework producer logic to allow producing messages in batches per interval
* Pretty print ksml-language-spec.json for easier future diffs
Fix docker compose producer version and depends_on statements
* Split up example message generator into a normal one (interval), a binary one (intended to run example 12) and a batch one (intended for performance measurements)
* Introduce example 19 to perform generic performance measurements on any KSML pipeline
* Remove reading back from binary topic in example 1 to allow running all examples in parallel (ie no conflict with example 12)
* Remove dead code from TopologyGenerator
* Improve error message in UserTypeParser
- Generate example data for byte manipulation example
- Have byte manipulation example read from alternative topic
# Conflicts:
#	ksml-runner/src/main/java/io/axual/ksml/runner/KSMLRunner.java
#	ksml-runner/src/main/java/io/axual/ksml/runner/config/KSMLRunnerConfig.java
# Conflicts:
#	docker-compose.yml
#	examples/ksml-data-generator.yaml
#	examples/ksml-runner.yaml
#	ksml-data-avro/NOTICE.txt
#	ksml-data-avro/pom.xml
#	ksml-query/NOTICE.txt
#	ksml-reporting/NOTICE.txt
#	ksml-runner/NOTICE.txt
#	ksml-runner/src/main/java/io/axual/ksml/runner/KSMLRunner.java
#	ksml-runner/src/main/java/io/axual/ksml/runner/config/ErrorHandlingConfig.java
#	ksml-runner/src/main/java/io/axual/ksml/runner/config/KSMLConfig.java
#	ksml-runner/src/main/java/io/axual/ksml/runner/config/KSMLRunnerConfig.java
#	ksml-runner/src/main/java/io/axual/ksml/runner/config/NotationConfig.java
#	ksml-runner/src/main/java/io/axual/ksml/runner/producer/ExecutableProducer.java
#	ksml/NOTICE.txt
#	ksml/src/main/java/io/axual/ksml/parser/UserTypeParser.java
#	pom.xml
# Conflicts:
#	pom.xml
- Generate example data for byte manipulation example
- Have byte manipulation example read from alternative topic

# Conflicts:
#	examples/00-example-generate-sensordata.yaml
# Conflicts:
#	examples/ksml-data-generator.yaml
#	examples/ksml-runner.yaml
# Conflicts:
#	pom.xml
* Split up example message generator into a normal one (interval), a binary one (intended to run example 12) and a batch one (intended for performance measurements)
* Introduce example 19 to perform generic performance measurements on any KSML pipeline
* Remove reading back from binary topic in example 1 to allow running all examples in parallel (ie no conflict with example 12)
* Remove dead code from TopologyGenerator
* Improve error message in UserTypeParser
# Conflicts:
#	ksml-runner/src/main/java/io/axual/ksml/runner/KSMLRunner.java
# Conflicts:
#	pom.xml
@jeroenvandisseldorp jeroenvandisseldorp merged commit dc72ef4 into Axual:main Nov 13, 2024
1 check passed
@jeroenvandisseldorp jeroenvandisseldorp deleted the introduce-performance-measurement-example branch November 22, 2024 14:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants