Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for DLM (AIM) metric #2562

Open
saswat0 opened this issue May 25, 2024 · 1 comment
Open

Support for DLM (AIM) metric #2562

saswat0 opened this issue May 25, 2024 · 1 comment
Labels
enhancement New feature or request New metric
Milestone

Comments

@saswat0
Copy link

saswat0 commented May 25, 2024

🚀 Feature

Support for Detail Losses and additive impairments as a differentiable loss function.

Motivation

VMAF is the de-facto benchmark for assessing quality in videos and is composed of two metrics: VIF (already implemented in torchmetrics) and ADM. To compute loss in videos using this metric, it'd be great to have its implementation. This is not only important for evaluating videos but also for individual images.

Pitch

Pixel-based difference measures such as PSNR and MSE correlate poorly with the human perception. To counter this, DLM[1] is a widely used for image quality assessment that doesn't depend on such pixel-wise statistics. Since all features of DLM are differentiable and can be ported to GPU instructions, it can serve as a great metric as a loss function.

  1. Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments

Alternatives

None

Additional context

NA

Related to #1245

@saswat0 saswat0 added the enhancement New feature or request label May 25, 2024
Copy link

Hi! thanks for your contribution!, great first issue!

@SkafteNicki SkafteNicki added this to the future milestone May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request New metric
Projects
None yet
Development

No branches or pull requests

2 participants