Interoperability between Rucio and DestinE data management

[backeb]

Short Description of the issue

In our workflow, output from DT Flood Early Warning and DT Flood Climate Impacts is written to Rucio.

Here we discuss interoperability requirements and impacts related to integration of interTwin core modules with DestinE.

[WOTrompDeltares]

The equivalent technology for Rucio in the DestinE projects would be the Polytope API for fetching the DT Extremes and DT Climate data, and the DestinE HDA. Incorporating these technologies into our workflows is part of the DestinE 370a work. How to integrate those technologies with Rucio is something that should be discussed with the Rucio team

[backeb]

notes from meeting with Thomas

• action to figure out how rucio can talk to polytope and / or HDA
• action to understand how dcache fits into this ecosystem

[backeb]

notes from meeting with Andrea

• polytope reads data from datalake

• HDA is interface to datalake (will store everything, single interface towards all available data, incl e.g. CDS)

• need to integrate with both for the DT

• approach from DestinE is to offer an interface to existing repositories (HDA)

• chat to EODC (Christoph Reimer) who are contributing to both interTwin and DestinE datalake devs