Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Spark] Make delta.dataSkippingStatsColumns more lenient for nested columns #2850

Open
wants to merge 18 commits into
base: master
Choose a base branch
from
Open

[Spark] Make delta.dataSkippingStatsColumns more lenient for nested columns #2850

wants to merge 18 commits into from

Commits on Mar 29, 2024

  1. Starting

    @Kimahriman
    Kimahriman committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    a9412bc View commit details
    Browse the repository at this point in the history

  2. Remove another test

    @Kimahriman
    Kimahriman committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    a864205 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Comment out irrelevant tests

    @Kimahriman
    Kimahriman committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    975f20b View commit details
    Browse the repository at this point in the history

  2. Try to fix scalastyle

    @Kimahriman
    Kimahriman committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    6411e7a View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Add duplicate col checking back

    @Kimahriman
    Kimahriman committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    e68028d View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. Remove commented out

    @Kimahriman
    Kimahriman committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    cbb0447 View commit details
    Browse the repository at this point in the history

  2. Add test for nested complex types

    @Kimahriman
    Kimahriman committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    3759afd View commit details
    Browse the repository at this point in the history

  3. Clean up commented out code

    @Kimahriman
    Kimahriman committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    329a571 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Merge branch 'master' into lenient-stats-cols

    @Kimahriman
    Kimahriman committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    b911d6a View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. Update spark/src/main/scala/org/apache/spark/sql/delta/stats/Statisti… 

    …csCollection.scala

Co-authored-by: Thang Long Vu <107926660+longvu-db@users.noreply.github.com>
    @Kimahriman @longvu-db
    Kimahriman and longvu-db committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    0ea2fc8 View commit details
    Browse the repository at this point in the history

  2. Update variable name and add double nested struct to test

    @Kimahriman
    Kimahriman committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    81c60aa View commit details
    Browse the repository at this point in the history

  3. Fix style

    @Kimahriman
    Kimahriman committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    6068eb0 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2024

  1. Merge branch 'master' into lenient-stats-cols

    @Kimahriman
    Kimahriman committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    60978a8 View commit details
    Browse the repository at this point in the history

  2. Add more hits tests

    @Kimahriman
    Kimahriman committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    bb86d96 View commit details
    Browse the repository at this point in the history

  3. Add more valid type tests

    @Kimahriman
    Kimahriman committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    0c24d44 View commit details
    Browse the repository at this point in the history

  4. Change description

    @Kimahriman
    Kimahriman committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    9bd8159 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Add warning log

    @Kimahriman
    Kimahriman committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    86c148f View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. Merge branch 'master' into lenient-stats-cols

    @Kimahriman
    Kimahriman committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    25e6faa View commit details
    Browse the repository at this point in the history