-
-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(eap): Ensure reliabilities are returned more consistently #6715
fix(eap): Ensure reliabilities are returned more consistently #6715
Conversation
When extrapolating, if there's no data, we skip returning reliabilities. This is problematic as we want to line up each reliability value with the corresponding result so those arrays must be the same length. This fills it with `RELIABILITY_UNSPECIFIED`.
# This isn't quite right but all non extrapolated aggregates | ||
# are assumed to be present. | ||
not extrapolation_context.is_extrapolated |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I didn't want to change too much existing behaviour in this PR but for whatever reason, when using a non aggregate in a timeseries query, we always consider as data_present=True
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I saw this come up in discuss-sns when a user was confused about it. Seems like it might be a bug.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah, I didn't want to change too many behaviours in this one PR so I kept this behaviour for now but it does feel like a bug.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@kylemumma can you look into this and file a ticket on eap-planning to address this? I am not following what the bug is really but if either of you have an idea of the issue, we should track it and even fix it. Let's not leave this unaddressed.
❌ 1 Tests Failed:
View the top 1 failed tests by shortest run time
To view more test analytics, go to the Test Analytics Dashboard |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I liked your use of comments and your code was easy to read
# This isn't quite right but all non extrapolated aggregates | ||
# are assumed to be present. | ||
not extrapolation_context.is_extrapolated |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I saw this come up in discuss-sns when a user was confused about it. Seems like it might be a bug.
When extrapolating, if there's no data, we skip returning reliabilities. This is problematic as we want to line up each reliability value with the corresponding result so those arrays must be the same length. This fills it with
RELIABILITY_UNSPECIFIED
.