Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fragment running and present in TableFragments but not in catalog #16620

Closed
BugenZhao opened this issue May 7, 2024 · 2 comments
Closed

fragment running and present in TableFragments but not in catalog #16620

BugenZhao opened this issue May 7, 2024 · 2 comments
Assignees
Labels
component/dashboard component/meta Meta related issue. type/bug Something isn't working

Comments

@BugenZhao
Copy link
Member

image

Job 3166 with its Materialize operator in fragment 3074 keeps reporting metrics. However, the job name is "unknown".

The actor is running, as confirmed by await-tree as well.

However, cannot find the job in the dev dashboard, including the pages for catalogs, dependency graph, and fragment graph.
Can still jump into its fragment graph through the Goto form. But the Relations section does not change accordingly.

image

Only after the throughput goes to zero (likely the backfill is finished), the jobs start to appear on the dashboard correctly.

@BugenZhao BugenZhao added type/bug Something isn't working component/meta Meta related issue. component/dashboard labels May 7, 2024
@github-actions github-actions bot added this to the release-1.9 milestone May 7, 2024
@fuyufjh
Copy link
Member

fuyufjh commented May 14, 2024

It looks like a backfilling job. During backfill, the Catalog is not written yet, while the TableFragments have been written.

It would be better to persit a catalog but marking as invisible

cc. @yezizp2012

@fuyufjh fuyufjh modified the milestones: release-1.9, release-1.10 May 14, 2024
@yezizp2012 yezizp2012 removed this from the release-2.0 milestone Aug 19, 2024
@yezizp2012
Copy link
Member

Should be resolved by #19134 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/dashboard component/meta Meta related issue. type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants