[Feature Request] WaveForm progress bar

[FrenchGithubUser]

This is a feature that's also request on the jellyfin server itself as well to help integration with 3rd party clients.

It would be great to see a waveform progress bar, like some other players do it. Until spectral data retrieval is implemented on the jellyfin api, this could work for downloaded tracks already.

Example of how it looks in plexamp :

[Chaphasilor]

The player library we use offers support for extracting the waveform from local files: https://pub.dev/packages/just_waveform
Data is extracted in the audiowaveform format, and can be read from a existing files in the audiowaveform format (instead of audio files).
If the server could provide such audiowaveform files, similar to how lyrics, subtitles, or images are provided right now, we could easily add support for that.
Until then, we won't add support for this, because there's no appeal in only having this feature for downloaded tracks...

[FrenchGithubUser]

Okay that's interesting ! Looking forward to this when the jellyfin server will provide this feature. The waveform could also be generated when streaming for the part of the audio that's already been received. But yes this is limited

[Chaphasilor]

@FrenchGithubUser could you link the feature request for the server somewhere to that we can properly track it?

[FrenchGithubUser]

https://features.jellyfin.org/posts/432/waveform-for-audio

it seems like someone implemented it on their own fork as well

[Chaphasilor]

Thanks. That fork implements it in the web client though, which unfortunately won't help us.

[FrenchGithubUser]

I will try to implement an api endpoint for this feature in the jellyfin server. I commented on the feature request tracker

[FrenchGithubUser]

I'm currently implementing the feature server-side. Would finamp be able to read pcm files ? (https://wiki.multimedia.cx/index.php/PCM)

This is an output that ffmpeg can produce, which seems pretty close to the audiowaveform format, and that would avoid creating a new dependency to jellyfin (avoiding using the bbc lib).

[FrenchGithubUser]

Actually, it seems like having a pcm file generated is overkill. ffmpeg also allows generating monochrome png images like this : https://trac.ffmpeg.org/wiki/Waveform#Downmixed

Would this be reusable by finamp ?

btw, the feature dev discussion on the jellyfin server is here : jellyfin/jellyfin-meta#89

[Chaphasilor]

No, that image won't help at all. It's not flexible/scalable, and it can't be interacted with. Any solution incorporating a static image would be hacky.