v2.12.0-alpha

What's Changed

• Pyroscope has finally been added to LDIO in #712
• Due to issues with JSON-LD contexts in Jena 4, it has been updated to Jena 5 in #729
• Bump cucumber.version from 7.15.0 to 7.20.1 #731

Full Changelog: v2.11.0...v2.12.0-alpha

v2.11.0

What's Changed

🩹 Missing processor declaration

The JsonToLdProcessor was not declared in the NiFi services file, which has been fixed now

❓ NiFi SPARQL ASK processor

A new NiFi processor has been added, namely the SparqlAskProcessor

🧒 Client asks for gzip content

The client has been updated so that it asks for gzip content, which should increase performance

🧹 Cleanup of the properties in the NiFi LdesClientProcessor

The properties are restructured, so now some properties are only visible when really needed

🥇 General LDES client improvements

It was not possible to restart the client when an endpoint was unreachable, which has been fixed, together with the client now gracefully shutting down, or in other words it waits when the read data is equal to the written data

🚧 NiFi SPARQL Construct was broken when creating multiple flow files

When the NiFi SparqlConstructProcessor created more than one flow file, the processor crashed, which is now fixed

😫 Better error handling for the LDES client

When the LDIO LDES client experienced errors, the pipeline goes now to a HALTED status

Dependencies

chore(deps): bump webrick from 1.8.1 to 1.8.2 in /docs (#708)

Full Changelog: v2.9.0...v2.11.0

v2.10.0-alpha

What's Changed

👀 LDES Client now fetches the required event stream properties

From now on, the config properties timestamp-path and materialisation.version-of-path can be omitted, since the
client will now fetch those properties self from the event stream.

✍️ New Components: Ldio:HttpSparqlOut and Ldio:SkolemisationTransformer

There has been a property added to send members to a triple store: Ldio:HttpSparqlOut. This component will post a
SPARQL insert query, combined with a delete query if enabled, so that the triples will be replaced instead of appended
in the triples store. Ldio:SkolemisationTransformer will skolemize all blank nodes in the RDF model. In addition, this
component is also built in into the Ldio:HttpSparqlOut component.

🩹 Fixes

• The LDES client statuses used a different mime-type than the statuses of the LDIO pipelines. This has been fixed
  in #686
• When the LDES client reached the end of an LDES, the pipeline was already down before all the data was processed. This
  has been fixed in #687

📈 Dependencies

• build(deps): bump org.apache.maven.plugins:maven-source-plugin from 3.2.1 to 3.3.1 by @dependabot
  in #574
• chore(deps): bump org.testcontainers:postgresql from 1.19.0 to 1.20.2 by @dependabot
  in #690
• chore(deps): bump org.jacoco:jacoco-maven-plugin from 0.8.10 to 0.8.12 by @dependabot
  in #694
• chore(deps): bump org.apache.maven.plugins:maven-jar-plugin from 3.3.0 to 3.4.2 by @dependabot
  in #695

➡️ Full Changelog: v2.9.0...v2.10.0-alpha

📬 We eagerly await your feedback!

v2.9.0

What's Changed

📘 Ldio:RepositoryMaterialiser ➡️ Ldio:RepositorySink

Due to the reposink not actually materialising the object passed through it, the name was very confusing.
This has been updated.
For more details, check out the documentation.

📈 Performance tweaks

• We fixed a memory issue inside the RepoSink. This should normally result in a smoother experience
• Additionally, we tweaked the LDES Client database interactions. This results in an overall 15% performance increase.

Change Notes

• chore: restructure ldio application by @Yalz in #659
• fix: #660: Repository Sink: performance degradation by @Yalz in #666
• docs: Add note for exactly once filter by @MPParsley in #665
• feat: RepoSink: delete skolem uris by @Yalz in #670
• chore: improve ci pipeline by @jobulcke in #672
• fix: optimize ldes client by @jobulcke in #681
• ci: finalise 2.9.0 by @Yalz in #683

New Contributors

• @MPParsley made their first contribution in #665

Full Changelog: v2.5.1...v2.9.0

📬 We eagerly await your feedback!

v2.8.0-alpha

What's Changed

• Feat: ldes client status by @Yalz in #654
• Feat: create version object processor accepts list of member types by @pj-cegeka in #656
• Fix: expand empty check on member types by @pj-cegeka in #657

Full Changelog: v2.7.0-alpha...v2.8.0-alpha

v2.7.0-alpha

What's Changed

Features

• A NiFi processor has been added, that makes it possible to make RML mappings in NiFi in #636
• The LdioLdesClient can now better handle LDES'es that has ended in #645
• Javadoc has been added to most of the codebase, which should make this open source code more accessible in #643 and #646

Fixes

• non-string datatype literals were converted to their fully quallified name instead of the containing value in the RDF4JRepositoryMaterialiser, which has been fixed in #644

Full Changelog: v2.6.0-alpha...v2.7.0-alpha

v2.6.0-alpha

What's Changed

Features

Latest State Filter
A new filter is added into the Ldes Client that keeps track whether a member is a representation of the latest state or not
Change Detection Filter
A new transformer component is added that acts like a filter that keeps track whether the state of a state object has changed or not

Fixes

RML mapper concurrency issues
There were some issues detected resulting in two members transformed through the RML mapper were sent twice and others not al all. This has been fixed now
NiFi property names streamlined
Some of the NiFi property names were not consistent, or some were incorrect duplicates. This has been fixed now

Full Changelog: v2.5.1...v2.6.0-alpha

v2.5.1

What's Changed

A bug was detected when a pipeline was deleted that was not using Ldio:LdesClientConnector as input, a NullPointerException was thrown, which is resolved via a hotfix in #604

What's Changed

• ci: finalise 2.1.0 release by @Yalz in #520
• Feat/graphdb performance inc by @jobulcke in #508
• fix: unexpected behaviour when no url list was provided for the LdesClient by @jobulcke in #518
• feat: LDIO noop by @Yalz in #512
• fix: blocked client connector by @Yalz in #523
• fix: unexpected empty url list behavior by @jobulcke in #522
• fix: remove file based retention for client by @Tomvbe in #519
• feat: binary ldes client by @jobulcke in #529
• fix: remove body from delete request by @Tomvbe in #533
• fix: unexpected behavior when no adapter was configured by @jobulcke in #535
• fix: make memory state consistent by @Tomvbe in #528
• fix: gh 501 by @jobulcke in #536
• ci: finalise release 2.2.0 by @jobulcke in #537
• Feat: use exactly once filter by @pj-cegeka in #532
• fix: #473: support Json-LD 1.1 framing + create LdiRdfWriter once per pipeline. by @Yalz in #541
• feat: Add swagger to the management API by @Tomvbe in #544
• fix: Json-To-JsonLD Adapter: support context objects by @Yalz in #547
• Fix: client tests by @pj-cegeka in #543
• fix: document how to config swagger by @Tomvbe in #550
• feat: improve client performance by @Tomvbe in #548
• fix: materialiser not starting by @Tomvbe in #553
• fix: support arrays in FlattenDeserializer by @Tomvbe in #554
• fix: fix broken link by @jeflaenen in #555
• Develop by @Tomvbe in #556
• fix: #539 #540: Pick up failing Request Executor IT + fixed. by @Yalz in #558
• fix: repository materialiser deletion bugs by @jobulcke in #557
• fix: #539 #540 : pick up ITs + fix broken Request Executor IT by @Yalz in #560
• fix: repo materialiser lang tag bug by @jobulcke in #559
• fix: improve logging of HttpPoller by @Tomvbe in #564
• feat: implement redirect logic by @Tomvbe in #563
• fix: make example less strict to deal with invalid source data by @Tomvbe in #567
• fix: use generic example in docs by @Tomvbe in #568
• fix: separate ldio status from triggers by @Tomvbe in #569
• fix: broken pipeline status event handler by @jobulcke in #570
• fix: deletion outside named graph by @jobulcke in #571
• fix: change default format to support relative uris by default by @jobulcke in #572
• fea: java 21 upgrade by @jobulcke in #573
• fix: error message by @pj-cegeka in #575
• fix ldes discoverer bad error logging by @jobulcke in #576
• fix: add missing tests by @Tomvbe in #577
• Feat: expand status docs by @pj-cegeka in #578
• chore: update codeowners by @jobulcke in #579
• feat: upgrade NiFi base image by @jobulcke in #583
• ci: finalize release 2.4.0 by @jobulcke in #581
• ci: prepare release 2.5.0 by @jobulcke in #584
• fix: improve log messages when statements cannot be found in model by @ferre-vaes in #587
• chore: retire LDIO File-In, File Out, Azure Blob Out components by @Yalz in #585
• feat: extend the functionality of the request executor in the discoverer by @jobulcke in #586
• feat: VSDSPUB-1296: document how to start up LDIO container by @ferre-vaes in #592
• fix: clean up ldi inputs ctors by @jobulcke in #590
• docs: embed ldio-core pages + merge ldi-core pages with ldio by @Yalz in #594
• fix: LDIO Adapter: Use InputStream to support protobuf by @Yalz in #596
• docs: VSDSPUB-1293 - LDIO LDES Client Config by @jeflaenen in #589
• Docs: VSDSPUB-1299 - Update LDIO Adapters by @jeflaenen in #593
• feat: nar bundle by @jobulcke in #597
• ci: finalize release 2.5.0 by @ferre-vaes in #598
• hotfix: nullpointer exception on pipeline deletion by @jobulcke in #604
• [ci] Promote snapshot 2.5.1 by @github-actions in #611

Full Changelog: v2.0.0...v2.5.1

v2.5.0-alpha

What's Changed

Features

• feat: extend the functionality of the request executor in the discoverer in #586
• feat: VSDSPUB-1296: document how to start up LDIO container in #592
• feat: nar bundle in #597

Fixes

• fix: improve log messages when statements cannot be found in model in #587
• fix: clean up ldi inputs ctors in #590
• fix: LDIO Adapter: Use InputStream to support protobuf in #596

Documentation

• docs: embed ldio-core pages + merge ldi-core pages with ldio in #594
• docs: VSDSPUB-1293 - LDIO LDES Client Config in #589
• docs: VSDSPUB-1299 - Update LDIO Adapters in #593

Others

• chore: retire LDIO File-In, File Out, Azure Blob Out components in #585

New Contributors

• @ferre-vaes made their first contribution in #587

Full Changelog: v2.4.0-alpha...v2.5.0-alpha

v2.4.0-alpha

In this release, no new features are implemented, but only bug fixes are provided and stability has been increased.

What's Changed

Repository materialiser bugs

• fix: repository materialiser deletion bugs by @jobulcke in #557
• fix: repo materialiser lang tag bug by @jobulcke in #559
• fix: deletion outside named graph by @jobulcke in #571

Testing bugs and improvements

• fix: pick up ITs + fix broken Request Executor IT by @Yalz in #558 and #560
• fix: add missing tests by @Tomvbe in #577

Logging improvements

• fix: improve logging of HttpPoller by @Tomvbe in #564
• fix ldes discoverer bad error logging by @jobulcke in #576
• fix: error message by @pj-cegeka in #575

Documentation improvements

• fix: make example less strict to deal with invalid source data by @Tomvbe in #567
• fix: use generic example in docs by @Tomvbe in #568
• fix: expand status docs by @pj-cegeka in #578

Others
*feat: implement redirect logic by @Tomvbe in #563

• fix: separate ldio status from triggers by @Tomvbe in #569
• fix: broken pipeline status event handler by @jobulcke in #570
• fix: change default format to support relative uris by default by @jobulcke in #572
• chore: java 21 upgrade by @jobulcke in #573

Full Changelog: v2.3.0-alpha...v2.4.0-alpha