Support for parallel inference on multiple initial dates.

[dietervdb-meteo]

Is your feature request related to a problem? Please describe.

Running inference for a large range of dates, for hindcasting and verification purposes, can currently be done, in a parallelized way, by setting up a suitable slurm script and repeatedly srunning anemoi-inference. It could be interesting to have such functionality handled by anemoi-inference under the hood directly so it can be handled by a single anemoi-inference call. Furthermore, as the date range increases the size of the total output also increases, so it could be useful to add to anemoi-inference a feature to save all output of such a large set of forecasts in a single zarr .

Describe the solution you'd like

Enable setting a date range in the config, rather than a single date. Implement a parallel treatment of inference on such multiple dates. Add zarr as a new output type.

Describe alternatives you've considered

No response

Additional context

@cathalobrien , @b8raoult , @gmertes this is not really urgent but could be a useful feature, what do you think?

Organisation

RMI