Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use the polytype python API to read input data for models #4

Open
backeb opened this issue Mar 18, 2024 · 3 comments
Open

Use the polytype python API to read input data for models #4

backeb opened this issue Mar 18, 2024 · 3 comments

Comments

@backeb
Copy link
Collaborator

backeb commented Mar 18, 2024

Short Description of the issue

The polytope API can be used to read input data needed to run the models for DT Flood Early Warning and DT Flood Climate Impacts.

Here we explore using the API in our workflow.

@WOTrompDeltares
Copy link
Collaborator

The Polytope API is being integrated with our workflows in the DestinE 370a project. For InterTwin, Polytope would have to be integrated with Rucio (see issue #6 )

@backeb
Copy link
Collaborator Author

backeb commented Mar 28, 2024

notes from meeting with Thomas

  • could consider reading data from polytope to rucio to benefit from smart caching etc. --> action for WP5?
  • also need to think about link between DCache, rucio and polytope.

action

  • discuss with Paul / Dijana

@backeb
Copy link
Collaborator Author

backeb commented Apr 8, 2024

notes from meeting with Andrea

  • smart caching in rucio done at file level not on "loading subset of data into memory" level.

  • is the client smart enough to cache the data? When we download the data each time using polytope.

  • action could be to access data from DestinE using polytope API from interTwin resources and check speeds

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants