Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove numpy as a hard dependency #1270

Merged
merged 2 commits into from
Oct 30, 2024
Merged

Remove numpy as a hard dependency #1270

merged 2 commits into from
Oct 30, 2024

Conversation

Fokko
Copy link
Contributor

@Fokko Fokko commented Oct 30, 2024

With Arrow 18.0.0 numpy is not a dependency anymore: apache/arrow#44148

I think it would be good to remove it from PyIceberg.

Closes #1259
Closes #1198

With Arrow 18.0.0 numpy is not a dependency anymore:
apache/arrow#44148

I think it would be good to also remove it from PyIceberg
@Fokko Fokko requested a review from kevinjqliu October 30, 2024 09:31
Copy link
Contributor

@kevinjqliu kevinjqliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, LGTM!
I've opened #1271 for tracking the performance regression and backporting the pyarrow range function when it becomes available. Do you mind adding it as a comment to the function?

@Fokko
Copy link
Contributor Author

Fokko commented Oct 30, 2024

@kevinjqliu That's an excellent suggestion, I only created one on the Arrow side, thanks!

Copy link
Contributor

@kevinjqliu kevinjqliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! bye numpy

@kevinjqliu kevinjqliu added this to the PyIceberg 0.8.0 release milestone Oct 30, 2024
@Fokko Fokko merged commit 7f959a2 into apache:main Oct 30, 2024
7 checks passed
@Fokko Fokko deleted the fd-remove-numpy branch October 30, 2024 20:30
@corleyma
Copy link

@kevinjqliu curious what y'all think of my comment here: #1259 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove numpy as a dependency NumPy Hardpin 1.26 issue
3 participants