Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Read in process Python objects like Dataframe, Numpy or dict #211

Merged
merged 26 commits into from
Jun 17, 2024
Merged

Read in process Python objects like Dataframe, Numpy or dict #211

merged 26 commits into from
Jun 17, 2024

Commits on Jun 6, 2024

  1. Fix Python ide index issue

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b085bbb View commit details
    Browse the repository at this point in the history

  2. Add simple StoragePython to fix compile flags

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    27d17ad View commit details
    Browse the repository at this point in the history

  3. Add PyReader and PyWriter ABC

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    5e917f3 View commit details
    Browse the repository at this point in the history

  4. Prototype works

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    614d392 View commit details
    Browse the repository at this point in the history

  5. GetSchema in PyReader works on dict

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    1e789dc View commit details
    Browse the repository at this point in the history

  6. Merge all convert_and_insert and getTableStructureFromData v1

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    0f58c45 View commit details
    Browse the repository at this point in the history

  7. Refactor convert_and_insert

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    209646a View commit details
    Browse the repository at this point in the history

  8. Fix prototype of PyReader.read

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b79246f View commit details
    Browse the repository at this point in the history

  9. Remove trampoline class

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    bc6603b View commit details
    Browse the repository at this point in the history

  10. Fix gc for read returned data

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    81da2aa View commit details
    Browse the repository at this point in the history

  11. Fix reader type to py::object

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    da85c29 View commit details
    Browse the repository at this point in the history

  12. Fix gil cross threads between C++ and Python

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    7461e83 View commit details
    Browse the repository at this point in the history

  13. Use inspect.current_frame and f_back to find py obj

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    623b322 View commit details
    Browse the repository at this point in the history

  14. Add append_raw in PODArray

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    68b6729 View commit details
    Browse the repository at this point in the history

  15. Add appendRawData in ColumnVectorHelper

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    656bccf View commit details
    Browse the repository at this point in the history

  16. Treat binary[pyarrow] as string

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b4923dc View commit details
    Browse the repository at this point in the history

  17. Fix pandas arrow dtype

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    f050319 View commit details
    Browse the repository at this point in the history

  18. Benchmark on clickbench data

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    451f8d0 View commit details
    Browse the repository at this point in the history

  19. Add pybind headers for ColumnPyObject

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    093d9dc View commit details
    Browse the repository at this point in the history

  20. 2x faster on Q23 with better getPyUtf8StrData

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    ce37839 View commit details
    Browse the repository at this point in the history

  21. Add PythonUtils

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    9db0a0a View commit details
    Browse the repository at this point in the history

  22. Support SQL on data objects without PyReader

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    fef6cda View commit details
    Browse the repository at this point in the history

  23. Do things with GIL in batch

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    0e53dcb View commit details
    Browse the repository at this point in the history

  24. GIL less scanDataToChunk

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    187edc4 View commit details
    Browse the repository at this point in the history

  25. Move prepareColumnCache to StoragePython

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    22c0bb8 View commit details
    Browse the repository at this point in the history

  26. Convert UTF-16 and UTF-32 without copy in FillColumnString

    @auxten
    auxten committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    4725983 View commit details
    Browse the repository at this point in the history