You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Each stage automatically emits the recordsProcessed metric which may lead to zero values for stages that do not do any Spark reads. Avoid the zero values to not skew the dashboard which does a mean on the values returned for a given day.
Input
The sparkRecordsRead counter.
Output
No recordsProcessed custom metric is emitted for stages that does no reads.
The text was updated successfully, but these errors were encountered:
Motivation
Each stage automatically emits the
recordsProcessed
metric which may lead to zero values for stages that do not do any Spark reads. Avoid the zero values to not skew the dashboard which does amean
on the values returned for a given day.Input
The
sparkRecordsRead
counter.Output
No
recordsProcessed
custom metric is emitted for stages that does no reads.The text was updated successfully, but these errors were encountered: