Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DRILL-6845: Semi-Hash-Join to skip incoming build duplicates, automatically stop skipping if too few #1606

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

DRILL-6845: Semi-Hash-Join to skip incoming build duplicates, automatically stop skipping if too few #1606

wants to merge 10 commits into from

Commits on Feb 12, 2019

  1. DRILL-6845: Add option to skip inner duplicates for Semi Hash Join

    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    1d58444 View commit details
    Browse the repository at this point in the history

  2. DRILL-6845: Add heuristic to stop skipping duplicates when there are … 

    …too few
    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    63a0575 View commit details
    Browse the repository at this point in the history

  3. DRILL-6845: Adjust the memory calculator for semi-join with duplicates

    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    cb0c2f5 View commit details
    Browse the repository at this point in the history

  4. added option min_batches_in_available_memory, and Some more changes

    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    563caea View commit details
    Browse the repository at this point in the history

  5. DRILL-6845: Added option for stop skipping threshold, and reserved ou… 

    …tgoing in memory calculation
    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    668209b View commit details
    Browse the repository at this point in the history

  6. DRILL-6845: Removed parameter to shouldSpill, use post build to check… 

    … probe batches, and set num partitions
    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    e25cfc7 View commit details
    Browse the repository at this point in the history

  7. DRILL-6845: Get numPartitionsSpilled from partitionStat, and also use… 

    … probe side in calculateMemoryUsage
    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    2aeea13 View commit details
    Browse the repository at this point in the history

  8. DRILL-6845: Fixed a possible null pointer

    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    c65a9aa View commit details
    Browse the repository at this point in the history

  9. DRILL-6845: Disable skipping when num partitions is 1, and (temp) use… 

    … original num partitions calculation
    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    5b4f947 View commit details
    Browse the repository at this point in the history

  10. DRILL-6845: Fix handling Retry from put() - for empty partition

    @Ben-Zvi
    Ben-Zvi committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    552acdf View commit details
    Browse the repository at this point in the history