Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Optimizer Sanity Checker, improve sortedness equivalence properties #11196

Merged
merged 34 commits into from
Jul 3, 2024
Merged

Add Optimizer Sanity Checker, improve sortedness equivalence properties #11196

merged 34 commits into from
Jul 3, 2024

Commits on Jun 9, 2024

  1. Initial optimizer sanity checker. 

    Only includes sort reqs, docs will be added.
    @yfy-
    yfy- committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    8f0c30f View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Add distro and pipeline friendly checks

    @yfy-
    yfy- committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    2538702 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Also check the plans we create are correct.

    @yfy-
    yfy- committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    aea95c6 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Add distribution test cases using global limit exec.

    @yfy-
    yfy- committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    9aef599 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. Add test for multiple children using SortMergeJoinExec.

    @yfy-
    yfy- committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    49aba4b View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. Move PipelineChecker to SanityCheckPlan

    @yfy-
    yfy- committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    d89b1c9 View commit details
    Browse the repository at this point in the history

  2. Fix some tests and add docs

    @yfy-
    yfy- committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    defebb0 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Add some test docs and fix clippy diagnostics.

    @yfy-
    yfy- committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b392cf6 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Fix some failing tests

    @mustafasrepo
    mustafasrepo committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    5bdec62 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'apache_main' into optimizer-sanity-checker

    @yfy-
    yfy- committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    46bf900 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Replace PipelineChecker with SanityChecker in .slt files.

    @yfy-
    yfy- committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    7148c07 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Initial commit

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    1e888c4 View commit details
    Browse the repository at this point in the history

  2. Slt tests pass

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    c08a92b View commit details
    Browse the repository at this point in the history

  3. Resolve linter errors

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    6d79881 View commit details
    Browse the repository at this point in the history

  4. Minor changes

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    cd49e2e View commit details
    Browse the repository at this point in the history

  5. Minor changes

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    338f451 View commit details
    Browse the repository at this point in the history

  6. Minor changes

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    1959488 View commit details
    Browse the repository at this point in the history

  7. Minor changes

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    1c5c0c0 View commit details
    Browse the repository at this point in the history

  8. Sort PreservingMerge clear per partition

    @mustafasrepo
    mustafasrepo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    24e32b6 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Minor changes

    @mustafasrepo
    mustafasrepo committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    9b77608 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'optimizer-sanity-checker' into sanity_checker_subs

    @mustafasrepo
    mustafasrepo committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    655a010 View commit details
    Browse the repository at this point in the history

  3. Update output_requirements.rs

    @berkaysynnada
    berkaysynnada committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    e93cf6e View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Address reviews

    @mustafasrepo
    mustafasrepo committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    58cbf9a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'apache_main' into optimizer-sanity-checker

    @mustafasrepo
    mustafasrepo committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6f8db29 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'optimizer-sanity-checker' into sanity_checker_subs

    @mustafasrepo
    mustafasrepo committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    0cb86b9 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Update datafusion/core/src/physical_optimizer/optimizer.rs 

    Co-authored-by: Mehmet Ozan Kabak <[email protected]>
    @mustafasrepo @ozankabak
    mustafasrepo and ozankabak authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    5a34ae0 View commit details
    Browse the repository at this point in the history

  2. Update datafusion/core/src/physical_optimizer/sanity_checker.rs 

    Co-authored-by: Mehmet Ozan Kabak <[email protected]>
    @mustafasrepo @ozankabak
    mustafasrepo and ozankabak authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    f3ac546 View commit details
    Browse the repository at this point in the history

  3. Address reviews

    @mustafasrepo
    mustafasrepo committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    0491c13 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'apache_main' into optimizer-sanity-checker

    @mustafasrepo
    mustafasrepo committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    aa075e2 View commit details
    Browse the repository at this point in the history

  5. Minor changes

    @mustafasrepo
    mustafasrepo committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    dfd219c View commit details
    Browse the repository at this point in the history

  6. Merge pull request #24 from yfy-/optimizer-sanity-checker 

    Optimizer Sanity Checker
    @mustafasrepo
    mustafasrepo authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    0c2eb45 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Apply suggestions from code review 

    Co-authored-by: Andrew Lamb <[email protected]>
    @mustafasrepo @alamb
    mustafasrepo and alamb authored Jul 3, 2024
    Configuration menu
    Copy the full SHA
    d8ebc14 View commit details
    Browse the repository at this point in the history

  2. Update comment

    @mustafasrepo
    mustafasrepo committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    747b69b View commit details
    Browse the repository at this point in the history

  3. Add map implementation

    @mustafasrepo
    mustafasrepo committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    aa1382b View commit details
    Browse the repository at this point in the history