Skip to content

feature/38-feature-jmh-benchmark-suite #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
Splatcrafter merged 11 commits into from
Jan 31, 2026
Merged

feature/38-feature-jmh-benchmark-suite #62

Splatcrafter merged 11 commits into from
Jan 31, 2026

Conversation

@Splatcrafter
Copy link
Member

@Splatcrafter Splatcrafter commented Jan 31, 2026

Summary

This PR adds benchmark tests for the upcomming 1.0.0 release.

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Refactoring
  • Documentation
  • Build / CI

Related Issues

Closes #38 - [Feature]: JMH Benchmark Suite

Changes

-added benchmarks module using JMH for benchmarking

Verification

  • Unit tests added/updated
  • Existing tests pass
  • Manual verification performed (if applicable)

Breaking Changes

No breaking changes with this PR.

Checklist

  • Code follows project conventions
  • Public APIs are documented
  • Tests cover new behavior
  • No unnecessary dependencies added

@Splatcrafter
Update .gitignore to exclude current-ticket.md
36260ce
@Splatcrafter
Add benchmarking utilities and JMH tests for Aether Datafixers
1d1d203 
- Introduce `BenchmarkBootstrap` to provide pre-configured `DataFixer` instances.
- Add `BenchmarkDataGenerator` for creating diverse test data payloads.
- Implement `BenchmarkRunner` as a main entry point for executing JMH benchmarks.
- Include `CollectionCodecBenchmark` for measuring encoding/decoding performance of collections.
- Add `ConcurrentMigrationBenchmark` to analyze multithreaded data migration performance.
@Splatcrafter
Expand SingleFixBenchmark with additional benchmark methods, improv…
ffe1316 
…ed Javadoc, and structured state management.
@Splatcrafter
Remove expected performance notes from SingleFixBenchmark Javadoc f…
ccb0fb9 
…or cleaner documentation.
@Splatcrafter
Merge branch 'develop' into feature/38-feature-jmh-benchmark-suite
8150e05 
# Conflicts:
#	pom.xml
@Splatcrafter
Enhance MultiFixChainBenchmark and SchemaLookupBenchmark with detaile…
99e73e3 
…d documentation and improved parameterization for better performance insights
@Splatcrafter
Update copyright year to 2026 in benchmark files
58d5f6c
@Splatcrafter
Add concurrent benchmarking utilities and comprehensive Javadoc for `…
28dc758 
…ConcurrentMigrationBenchmark` to enhance multithreaded performance analysis.
@Splatcrafter
Add JMH benchmark package-info files for codec, format, util, and cor…
a10fc92 
…e categories with detailed documentation and configuration examples. Expand `CollectionCodecBenchmark` with enhanced documentation and parameterized benchmarks.
@Splatcrafter
Mark benchmark classes as final to enforce immutability and improve…
0196f6d 
… clarity.
@Splatcrafter
Make benchmark classes non-final and introduce consistent use of `@Nu…
2096a61 
…llable` annotations for improved flexibility and clarity. Add a fixed timestamp for reproducible benchmarks in `BenchmarkDataGenerator`.
@Splatcrafter Splatcrafter requested a review from a team as a code owner January 31, 2026 16:37
@Splatcrafter Splatcrafter requested a review from a team January 31, 2026 16:37
@Splatcrafter Splatcrafter self-assigned this Jan 31, 2026
@Splatcrafter Splatcrafter added enhancement New feature or request performance Performance problems or opportunities (runtime, memory, allocations, IO, startup) labels Jan 31, 2026
@github-actions
Copy link

github-actions bot commented Jan 31, 2026

⚠️ Deprecation Warning: The deny-licenses option is deprecated for possible removal in the next major release. For more information, see issue 997.

Dependency Review

The following issues were found:
  • ✅ 0 vulnerable package(s)
  • ✅ 0 package(s) with incompatible licenses
  • ✅ 0 package(s) with invalid SPDX license definitions
  • ⚠️ 2 package(s) with unknown licenses.
  • ⚠️ 1 packages with OpenSSF Scorecard issues.
See the Details below.

License Issues

aether-datafixers-benchmarks/pom.xml

PackageVersionLicenseIssue Type
com.fasterxml.jackson.dataformat:jackson-dataformat-tomlNullUnknown License
com.fasterxml.jackson.dataformat:jackson-dataformat-yamlNullUnknown License
Denied Licenses: GPL-3.0-only, GPL-3.0-or-later, AGPL-3.0-only, AGPL-3.0-or-later

OpenSSF Scorecard

Scorecard details
PackageVersionScoreDetails
maven/com.fasterxml.jackson.core:jackson-databind UnknownUnknown
maven/com.fasterxml.jackson.dataformat:jackson-dataformat-toml UnknownUnknown
maven/com.fasterxml.jackson.dataformat:jackson-dataformat-xml UnknownUnknown
maven/com.fasterxml.jackson.dataformat:jackson-dataformat-yaml UnknownUnknown
maven/com.google.code.gson:gson 🟢 9.5
Details
CheckScoreReason
Dependency-Update-Tool🟢 10update tool detected
Packaging⚠️ -1packaging workflow not detected
Code-Review🟢 10all changesets reviewed
Maintained🟢 1023 commit(s) and 5 issue activity found in the last 90 days -- score normalized to 10
Binary-Artifacts🟢 10no binaries found in the repo
Pinned-Dependencies🟢 7dependency not pinned by hash detected -- score normalized to 7
Token-Permissions🟢 10GitHub workflow tokens follow principle of least privilege
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
SAST🟢 10SAST tool is run on all commits
Fuzzing🟢 10project is fuzzed
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Security-Policy🟢 10security policy file detected
Vulnerabilities🟢 100 existing vulnerabilities detected
CI-Tests🟢 1030 out of 30 merged PRs checked by a CI test -- score normalized to 10
Contributors🟢 10project has 11 contributing companies or organizations
maven/com.google.guava:guava 🟢 8.8
Details
CheckScoreReason
Code-Review⚠️ 1Found 3/30 approved changesets -- score normalized to 1
Maintained🟢 1030 commit(s) and 17 issue activity found in the last 90 days -- score normalized to 10
Dependency-Update-Tool🟢 10update tool detected
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Packaging⚠️ -1packaging workflow not detected
Token-Permissions🟢 10GitHub workflow tokens follow principle of least privilege
Binary-Artifacts🟢 9binaries present in source code
Pinned-Dependencies🟢 10all dependencies are pinned
CII-Best-Practices⚠️ 2badge detected: InProgress
Signed-Releases⚠️ -1no releases found
SAST🟢 9SAST tool is not run on all commits -- score normalized to 9
License🟢 10license file detected
Fuzzing🟢 10project is fuzzed
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Security-Policy🟢 10security policy file detected
CI-Tests🟢 926 out of 27 merged PRs checked by a CI test -- score normalized to 9
Vulnerabilities🟢 100 existing vulnerabilities detected
Contributors🟢 10project has 11 contributing companies or organizations
maven/de.splatgames.aether.datafixers:aether-datafixers-api UnknownUnknown
maven/de.splatgames.aether.datafixers:aether-datafixers-codec UnknownUnknown
maven/de.splatgames.aether.datafixers:aether-datafixers-core UnknownUnknown
maven/de.splatgames.aether.datafixers:aether-datafixers-testkit UnknownUnknown
maven/org.apache.maven.plugins:maven-compiler-plugin 🟢 5.7
Details
CheckScoreReason
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Maintained🟢 1017 commit(s) and 1 issue activity found in the last 90 days -- score normalized to 10
Code-Review🟢 7Found 12/17 approved changesets -- score normalized to 7
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Packaging⚠️ -1packaging workflow not detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Fuzzing⚠️ 0project is not fuzzed
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
Binary-Artifacts🟢 10no binaries found in the repo
Security-Policy🟢 10security policy file detected
Vulnerabilities🟢 55 existing vulnerabilities detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
maven/org.apache.maven.plugins:maven-enforcer-plugin UnknownUnknown
maven/org.apache.maven.plugins:maven-shade-plugin 🟢 4.6
Details
CheckScoreReason
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Maintained🟢 1012 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
Code-Review🟢 3Found 7/18 approved changesets -- score normalized to 3
Binary-Artifacts🟢 8binaries present in source code
Packaging⚠️ -1packaging workflow not detected
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
Fuzzing⚠️ 0project is not fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Security-Policy🟢 10security policy file detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
Vulnerabilities⚠️ 049 existing vulnerabilities detected
maven/org.codehaus.mojo:exec-maven-plugin 3.1.0 UnknownUnknown
maven/org.jetbrains:annotations ⚠️ 2.3
Details
CheckScoreReason
Dangerous-Workflow⚠️ -1no workflows found
Code-Review🟢 3Found 8/21 approved changesets -- score normalized to 3
Token-Permissions⚠️ -1No tokens found
Maintained⚠️ 22 commit(s) and 1 issue activity found in the last 90 days -- score normalized to 2
Binary-Artifacts🟢 9binaries present in source code
Packaging⚠️ -1packaging workflow not detected
Pinned-Dependencies⚠️ -1no dependencies found
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Fuzzing⚠️ 0project is not fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ 0branch protection not enabled on development/release branches
Security-Policy⚠️ 0security policy file not detected
Vulnerabilities⚠️ 014 existing vulnerabilities detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
maven/org.openjdk.jmh:jmh-core 🟢 4.3
Details
CheckScoreReason
Packaging⚠️ -1packaging workflow not detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Code-Review⚠️ 0Found 1/30 approved changesets -- score normalized to 0
Maintained⚠️ 00 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Binary-Artifacts🟢 10no binaries found in the repo
Security-Policy⚠️ 0security policy file not detected
Fuzzing🟢 10project is fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Vulnerabilities🟢 82 existing vulnerabilities detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
maven/org.openjdk.jmh:jmh-generator-annprocess 🟢 4.3
Details
CheckScoreReason
Packaging⚠️ -1packaging workflow not detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Code-Review⚠️ 0Found 1/30 approved changesets -- score normalized to 0
Maintained⚠️ 00 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Binary-Artifacts🟢 10no binaries found in the repo
Security-Policy⚠️ 0security policy file not detected
Fuzzing🟢 10project is fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Vulnerabilities🟢 82 existing vulnerabilities detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
maven/org.yaml:snakeyaml UnknownUnknown
maven/org.openjdk.jmh:jmh-core 1.37 🟢 4.3
Details
CheckScoreReason
Packaging⚠️ -1packaging workflow not detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Code-Review⚠️ 0Found 1/30 approved changesets -- score normalized to 0
Maintained⚠️ 00 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Binary-Artifacts🟢 10no binaries found in the repo
Security-Policy⚠️ 0security policy file not detected
Fuzzing🟢 10project is fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Vulnerabilities🟢 82 existing vulnerabilities detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
maven/org.openjdk.jmh:jmh-generator-annprocess 1.37 🟢 4.3
Details
CheckScoreReason
Packaging⚠️ -1packaging workflow not detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Code-Review⚠️ 0Found 1/30 approved changesets -- score normalized to 0
Maintained⚠️ 00 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Binary-Artifacts🟢 10no binaries found in the repo
Security-Policy⚠️ 0security policy file not detected
Fuzzing🟢 10project is fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
Vulnerabilities🟢 82 existing vulnerabilities detected
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0

Scanned Files

  • aether-datafixers-benchmarks/pom.xml
  • pom.xml

@Splatcrafter Splatcrafter added this to the v1.0.0 milestone Jan 31, 2026
@Splatcrafter Splatcrafter merged commit e0ea953 into develop Jan 31, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@Splatcrafter Splatcrafter

Labels

enhancement New feature or request performance Performance problems or opportunities (runtime, memory, allocations, IO, startup)

Projects

None yet

Milestone

v1.0.0

Development

Successfully merging this pull request may close these issues.

1 participant

@Splatcrafter