Skip to content

Block loading at codec level #128445

Open
Open
@martijnvg

Description

@martijnvg

Implement BlockDocValuesReader implementations that push down block loading to doc values codec level. This should be possible for our custom doc value codec that we use for logsdb and tsdb.

  • Make use of low level implementations details of the codec when loading blocks. The tsdb doc value codec is organized values / ordinals in blocks of 128 values each. Today this gets decoded into an array which gets used in intermediate calls to public doc value apis. We could chose to append all 128 values in one operation to block loader builder when possible.
  • Take another look at explicit vectorization and see whether this can be applied to value loading. Today we rely on auto vectorization, which maybe doesn't get applied all the time.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions