Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feed cleaner has issues with blobs published to feeds #4467

Open
dkurepa opened this issue Feb 18, 2025 · 0 comments
Open

Feed cleaner has issues with blobs published to feeds #4467

dkurepa opened this issue Feb 18, 2025 · 0 comments

Comments

@dkurepa
Copy link
Member

dkurepa commented Feb 18, 2025

Context

Up until recently, the feed cleaner was running out of memory during the beginning of every run. This got resolved last week and now we're seeing a new problem: we're getting messages like Asset Microsoft.NET.Sdk.Publish.8.0.310-servicing.25106.21 from feed darc-pub-sym-dotnet-sdk-d723f1cd not found in BAR. Skipping.. After looking into it, it appears that the issue is with darc-pub-sym feeds as seen in the query which are used for blob publishing. The issue is that during publishing, these feeds are not added as locations, so we don't find them when looking for that particular asset.

Maybe we should be checking if an asset is available in the normal, non darc-pub-sym feed, and getting it like that? For example, when we're feeding the darc-pub-sym-dotnet-sdk-d723f1cd feed, we'll see a blob called Microsoft.DotNet.ApiCompat.Task, but this won't be written down in BAR. What bar will have is the darc-pub-dotnet-sdk-d723f1cd feed (it's just missing the -sym), and if we do find it, delete it from the feed

This doesn't cover all cases tho, in the example above the, the pub-sym feed has 27 packages, while the non sym feed just has 7, meaning we won't find all pub-sym packages

Goal

Make darc-pub-sym feeds cleanable

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant