Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support ff range queries on json fields #2456

Merged
merged 5 commits into from
Aug 1, 2024
Merged

Conversation

PSeitz
Copy link
Contributor

@PSeitz PSeitz commented Jul 24, 2024

Support ff range queries on json fields. Supported json field types are u64, i64, f64, term and date.

Fixes date truncation issue in Term, where DateTime was truncated to seconds precision unconditionally, but we only want to apply that truncation on the inverted index.
It's a footgun that date needs to truncated when creating the Term. A proper fix depends on #2366

Changes PhrasePrefixQuery to always use the inverted index range query

TODO:

  • Add support for non fast fields

@PSeitz PSeitz force-pushed the str_fast_field_range_query2 branch from 19f4077 to a2ea1ff Compare July 24, 2024 03:14
@PSeitz PSeitz marked this pull request as draft July 29, 2024 01:32
@PSeitz PSeitz force-pushed the str_fast_field_range_query2 branch from a2ea1ff to e964e9d Compare July 29, 2024 09:26
@PSeitz PSeitz force-pushed the str_fast_field_range_query2 branch from e964e9d to ba33a2a Compare July 29, 2024 09:33
@PSeitz PSeitz marked this pull request as ready for review July 30, 2024 04:24
@PSeitz PSeitz force-pushed the str_fast_field_range_query2 branch 4 times, most recently from 6a0e9a1 to 639f67d Compare July 30, 2024 05:15
@PSeitz PSeitz force-pushed the str_fast_field_range_query2 branch from 639f67d to b943add Compare July 30, 2024 05:43
@PSeitz PSeitz requested a review from fulmicoton July 30, 2024 05:52
@PSeitz PSeitz merged commit 3d1c4b3 into main Aug 1, 2024
4 checks passed
@PSeitz PSeitz deleted the str_fast_field_range_query2 branch August 1, 2024 16:06
philippemnoel pushed a commit to paradedb/tantivy that referenced this pull request Aug 31, 2024
* support ff range queries on json fields

* fix term date truncation

* use inverted index range query for phrase prefix queries

* rename to InvertedIndexRangeQuery

* fix column filter, add mixed column test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants