Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pyarrow upgrade #967

Open
bguillod opened this issue Oct 30, 2024 · 1 comment
Open

Pyarrow upgrade #967

bguillod opened this issue Oct 30, 2024 · 1 comment

Comments

@bguillod
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
The conda environments with climada seem to be restricted to an old pyarrow version (12.0.1 in my case). We always get these warnings from dask: FutureWarning: Minimal version of pyarrow will soon be increased to 14.0.1. You are using 12.0.1. Please consider upgrading.

Describe the solution you'd like
An upgrade of the dependencies which constrain pyarrow to this old version, such as to take advantage of recent pyarrow versions. However, I am not sure which dependency contrains pyarrow at the moment in either climada or climada_petals.

Additional context
I'd be interested to support with an upgrade satisfying the above requirements, however I am not sure where to start so I would welcome input as to:

  1. Where to look first.
  2. Is there any knowledge already as to what exactly needs to be done or do we need to investigate first.
@emanuel-schmid
Copy link
Collaborator

@bguillod thanks for the notification.
pyarrow doesn't look like it's going to be updated for python 3.9 anymore.
With python 3.11 the problem is solved magically though. I think with python 3.10 too, but I'm not sure.
Since a couple of weeks the default python version for climada is 3.11 and I'm afraid, once they've increased the minimal version of pyarrow to 14, we'll abandon support for python 3.9.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants