Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

STAR-1133: Changes from DSEDB - DO NOT MERGE #53

Draft
wants to merge 24 commits into
base: trunk
Choose a base branch
from

Commits on Feb 23, 2022

  1. STAR-564 Check only MODIFY on base when updating table with MV (#17)

    If a user has only MODIFY permission on a table and there is a
    materialized view built on the same table an insert will fail
    with the following error:
    Unauthorized: Error from server: code=2100 [Unauthorized]
    
    Only base MODIFY permission is required to update base with MV.
    
    Co-authored-by: Zhao Yang <[email protected]>
    (cherry picked from commit 55dad39)
    (cherry picked from commit f1e441e)
    (cherry picked from commit 4c7c22c)
    (cherry picked from commit 68417f7)
    jtgrabowski authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    ada0915 View commit details
    Browse the repository at this point in the history
  2. Add pytest cache and vscode folders to gitignore (#21)

    (cherry picked from commit b3bd616)
    (cherry picked from commit f2c3701)
    (cherry picked from commit ba91f9d)
    (cherry picked from commit cce73fb)
    k-rus authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    1f0a47c View commit details
    Browse the repository at this point in the history
  3. STAR-582 fix repair error on one node cluster (#20)

    Port of DB-1511, riptano/apollo-dtest#197
    
    Co-authored-by: Zhao Yang <[email protected]>
    (cherry picked from commit c7beefc)
    (cherry picked from commit a02abc6)
    (cherry picked from commit 387d688)
    (cherry picked from commit d219834)
    k-rus authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    a8be273 View commit details
    Browse the repository at this point in the history
  4. STAR-247: Allow to easily run tests against big or bti sstable format

    (cherry picked from commit 8c96801)
    (cherry picked from commit 8f68014)
    (cherry picked from commit c204342)
    (cherry picked from commit fea5074)
    (cherry picked from commit f4f6f56)
    jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    6c202f8 View commit details
    Browse the repository at this point in the history
  5. STAR-247: remove format specific parts of assertions

    in offline_tools_test.py
    
    (cherry picked from commit c318850)
    (cherry picked from commit 14050b8)
    (cherry picked from commit c733919)
    (cherry picked from commit 33f3e3f)
    (cherry picked from commit 3c72c8f)
    jtgrabowski authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    f18252c View commit details
    Browse the repository at this point in the history
  6. STAR-247: Standalone scrubber should use the same default sstable for…

    …mat as specified for the test
    
    Also made a small refactoring of dtest_config.py
    
    (cherry picked from commit 1253168)
    (cherry picked from commit 66b7cba)
    (cherry picked from commit fb9042e)
    jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    536abfd View commit details
    Browse the repository at this point in the history
  7. STAR-247: Add allowed warning for running scrub test

    The message is expected since bloom filter is not recreated when there is no index.
    
    (cherry picked from commit f7684e4)
    (cherry picked from commit 8ebfd4e)
    (cherry picked from commit 4bb4236)
    jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    d5163a8 View commit details
    Browse the repository at this point in the history
  8. STAR-14: Fix expectations to include memtable table parameter

    (cherry picked from commit 353b1f1)
    (cherry picked from commit 1cbc8d5)
    (cherry picked from commit ee9b612)
    (cherry picked from commit e3e226a)
    (cherry picked from commit b527853)
    blambov authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    a5f0edd View commit details
    Browse the repository at this point in the history
  9. STAR-254: add DateRange and Geo tests (#9)

    * STAR-254 add tests for geo and date range types
    
    (cherry picked from commit d15a708)
    (cherry picked from commit 5bd412f)
    (cherry picked from commit 3a6ba36)
    (cherry picked from commit 8a10d56)
    (cherry picked from commit 30e81dc)
    jtgrabowski authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    719f1b0 View commit details
    Browse the repository at this point in the history
  10. STAR-452: add EverywhereStrategy smoke test (#10)

    (cherry picked from commit eb3049c)
    (cherry picked from commit fe23e0b)
    (cherry picked from commit af5e094)
    (cherry picked from commit caaa548)
    (cherry picked from commit 31b6a86)
    jtgrabowski authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    e896e53 View commit details
    Browse the repository at this point in the history
  11. STAR-431: Add option to prevent any file-I/O from cqlsh

    Co-authored-by: Robert Stupp <[email protected]>
    (cherry picked from commit 33e486a)
    (cherry picked from commit 9fbd1b3)
    (cherry picked from commit c479ab3)
    (cherry picked from commit 6c74210)
    mfleming authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    0692089 View commit details
    Browse the repository at this point in the history
  12. STAR-431: Add more tests to make sure commands work without --no-file…

    …-io too
    
    (cherry picked from commit 033a492)
    (cherry picked from commit 72eedea)
    (cherry picked from commit cf7be8c)
    (cherry picked from commit 4f6d0be)
    mfleming authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    d968b49 View commit details
    Browse the repository at this point in the history
  13. STAR-432: Add tests for consistency level options (#18)

    * STAR-432: Add tests for consistency level options
    
    Co-authored-by: Robert Stupp [email protected]
    (cherry picked from commit 21c18c5)
    (cherry picked from commit e6ae1bf)
    (cherry picked from commit 05b7502)
    (cherry picked from commit b694f07)
    tlasica authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    8e58329 View commit details
    Browse the repository at this point in the history
  14. STAR-543: Port guardrail tests and changes (#19)

    Co-authored-by: Aleksandr Sorokoumov <[email protected]>
    (cherry picked from commit fd2b1c3)
    (cherry picked from commit 66e6b72)
    (cherry picked from commit 7060130)
    djatnieks authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    6b5e22e View commit details
    Browse the repository at this point in the history
  15. STAR-765: Add tests for cloud connection. (#23)

    * STAR-765: Add tests for cloud connection.
    
    It is not possible without some infrastructre or tooling effort to trully test cloud connection.
    Instead added tests focus on proper cqlsh behavior when secure connect bundle is specified:
    - proper default consistency level
    - debug information
    - reading from cqlshrc and parameters
    - skipping host / port information
    
    Testing validation is based on error msgs and debug info.
    
    (cherry picked from commit 9f8cba3)
    (cherry picked from commit 50bf851)
    (cherry picked from commit e83d99a)
    (cherry picked from commit a7ef525)
    tlasica authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    0ba7093 View commit details
    Browse the repository at this point in the history
  16. STAR-386: Add logging around failure to get timestamp info (#28)

    (cherry picked from commit 0905211)
    (cherry picked from commit 3d6068a)
    (cherry picked from commit ac5f6b4)
    djatnieks authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    d834096 View commit details
    Browse the repository at this point in the history
  17. STAR-517. Skip as it is not possible to test it reliably. (#34)

    The goal of the test is to "exercise the retry and back-off policies".
    And test is trying to achieve it by:
    - using arbitrary low write timeout
    - and loading / exporting / importing / exporting the data
    - assuming that retries and back-off will handle it.
    Unfortunately it is very sensitive...
    
    Because we need to find a perfect balance for the timeout and req/s, so that:
    - timeouts are indeed hit
    - and default COPY util not abort after 90s without succ write
    - and default COPY will not abort after 12 unsuccessull backoff attempts
    
    This change disables this test because:
    - there is no logic in the test that would check if indeed retries and backoff are exercised, so
    - it is perfectly possible that when it passes it just passes without any value
    - there are special tests for MAXATTEMPTS and for backoff policy
    
    Final note:
    mechanism of retries and backoff policy in COPY command could be improved
    by providing some backpressure mechanism to slowdown writes rather than
    doing retry or backoff exponentital (with random!).
    But this would be a new feature and COPY util is not a place we would like to invest.
    
    (cherry picked from commit 897aab7)
    (cherry picked from commit 602cf53)
    tlasica authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    01746fc View commit details
    Browse the repository at this point in the history
  18. STAR-386 Increase client timeout for test_simultaneous_bootstrap (#37)

    Improve reliability for slow/loaded test systems by using larger client timeout executing query.
    
    (cherry picked from commit 18d05f6)
    (cherry picked from commit 0bc8d67)
    djatnieks authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    089f89a View commit details
    Browse the repository at this point in the history
  19. STAR-385 Retry cluster stop after exception stopping 'gently' (#36)

    Cluster stop requests in cleanup_cluster are made with "gently=True" when Jacoco code coverage is enabled to allow the jacoco agent to record results; however, some tests leave nodes in a state where this type of shutdown does not succeed, resulting in the test being marked failed regardless of it's true completion status.
    
    This change will retry these stop requests with "gently=False" so that the test completion status will not be altered due to shutdown not completing.
    
    (cherry picked from commit f6fc3d3)
    (cherry picked from commit aff9d6e)
    djatnieks authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    437faec View commit details
    Browse the repository at this point in the history
  20. STAR-13 Run tests for UnifiedCompactionStrategy (#22)

    (cherry picked from commit 47b978d)
    (cherry picked from commit 4ecc81b)
    Gerrrr authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    2207460 View commit details
    Browse the repository at this point in the history
  21. STAR-826 Add missing import (#40)

    (cherry picked from commit 7c8489f)
    (cherry picked from commit 9196eaa)
    Gerrrr authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    0e6d4cc View commit details
    Browse the repository at this point in the history
  22. STAR-836 Fix TestCompaction_with_UnifiedCompactionStrategy.bloomfilte…

    …r_size_test (#41)
    
    Co-authored-by: Branimir Lambov <[email protected]>
    (cherry picked from commit 7777fa9)
    (cherry picked from commit d06d4c6)
    Gerrrr authored and jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    282c11e View commit details
    Browse the repository at this point in the history
  23. STAR-822: Update test_consistent_repair dtest

    In DB-4215 compaction has been separated from repairs and that separation seems to be pulled from DSE along with UCS. Therefore, checking for the repair status depending on whether compaction was run or not is nor relevant any longer.
    
    This commit updates the test_consistent_repair to the version we have in apollo-dtest.
    
    (cherry picked from commit b454087)
    jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    914a674 View commit details
    Browse the repository at this point in the history
  24. STAR-843: Update dtests for ULID based generation ID

    (cherry picked from commit fd2ebac)
    jacek-lewandowski committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    ffb1477 View commit details
    Browse the repository at this point in the history