Update: SingVisio citations and resources links #274
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
RMSnow
requested changes
Sep 19, 2024
There was a problem hiding this comment.
To update the SingVisio Doc's link
There was a problem hiding this comment.
To update the SingVisio Doc's link
yuantuo666
commented
Sep 19, 2024
| @@ -160,7 +160,7 @@ Amphion is under the [MIT License](LICENSE). It is free for both research and co | |||
| @inproceedings{amphion, | |||
| author={Zhang, Xueyao and Xue, Liumeng and Gu, Yicheng and Wang, Yuancheng and Li, Jiaqi and He, Haorui and Wang, Chaoren and Song, Ting and Chen, Xi and Fang, Zihao and Chen, Haopeng and Zhang, Junan and Tang, Tze Ying and Zou, Lexiao and Wang, Mingxuan and Han, Jun and Chen, Kai and Li, Haizhou and Wu, Zhizheng}, | |||
| title={Amphion: An Open-Source Audio, Music and Speech Generation Toolkit}, | |||
| booktitle={Proc.~of SLT}, | |||
| booktitle={{IEEE} Spoken Language Technology Workshop, {SLT} 2024}, | |||
There was a problem hiding this comment.
@RMSnow Do we need to update this citation on the Emilia README.md page? Since it was also Proc.~of SLT.
lmxue
reviewed
Sep 19, 2024
| @@ -29,13 +29,13 @@ | |||
| In addition to the specific generation tasks, Amphion includes several **vocoders** and **evaluation metrics**. A vocoder is an important module for producing high-quality audio signals, while evaluation metrics are critical for ensuring consistent metrics in generation tasks. Moreover, Amphion is dedicated to advancing audio generation in real-world applications, such as building **large-scale datasets** for speech synthesis. | |||
|
|
|||
| ## 🚀 News | |||
| - **2024/09/01**: [Amphion](https://arxiv.org/abs/2312.09911) and [Emilia](https://arxiv.org/abs/2407.05361) got accepted by IEEE SLT 2024! 🤗 | |||
| - **2024/09/01**: [Amphion](https://arxiv.org/abs/2312.09911) and [Emilia](https://arxiv.org/abs/2407.05361) got accepted by IEEE SLT 2024! [SingVisio](https://arxiv.org/abs/2402.12660) got accepted by Computers & Graphics! 🤗 | |||
| - **2024/08/28**: Welcome to join Amphion's [Discord channel](https://discord.com/invite/ZxxREr3Y) to stay connected and engage with our community! | ||
| - **2024/08/27**: *The Emilia dataset is now publicly available!* Discover the most extensive and diverse speech generation dataset with 101k hours of in-the-wild speech data now at [](https://huggingface.co/datasets/amphion/Emilia-Dataset) or [](https://opendatalab.com/Amphion/Emilia)! 👑👑👑 | ||
| - **2024/07/01**: Amphion now releases **Emilia**, the first open-source multilingual in-the-wild dataset for speech generation with over 101k hours of speech data, and the **Emilia-Pipe**, the first open-source preprocessing pipeline designed to transform in-the-wild speech data into high-quality training data with annotations for speech generation! [](https://arxiv.org/abs/2407.05361) [](https://huggingface.co/datasets/amphion/Emilia) [](https://emilia-dataset.github.io/Emilia-Demo-Page/) [](preprocessors/Emilia/README.md) | ||
| - **2024/06/17**: Amphion has a new release for its **VALL-E** model! It uses Llama as its underlying architecture and has better model performance, faster training speed, and more readable codes compared to our first version. [](egs/tts/VALLE_V2/README.md) | ||
| - **2024/03/12**: Amphion now support **NaturalSpeech3 FACodec** and release pretrained checkpoints. [](https://arxiv.org/abs/2403.03100) [](https://huggingface.co/amphion/naturalspeech3_facodec) [](https://huggingface.co/spaces/amphion/naturalspeech3_facodec) [](models/codec/ns3_codec/README.md) | ||
| - **2024/02/22**: The first Amphion visualization tool, **SingVisio**, release. [](https://arxiv.org/abs/2402.12660) [](https://openxlab.org.cn/apps/detail/Amphion/SingVisio) [](https://github.com/open-mmlab/Amphion/assets/33707885/0a6e39e8-d5f1-4288-b0f8-32da5a2d6e96) [](egs/visualization/SingVisio/README.md) | ||
| - **2024/02/22**: The first Amphion visualization tool, **SingVisio**, release. [](https://arxiv.org/abs/2402.12660) [](https://openxlab.org.cn/apps/detail/Amphion/SingVisio) [](https://speechteam.feishu.cn/wiki/KrIIwpjIVi7MhtkiCcXcjFI2nib) [](egs/visualization/SingVisio/README.md) |
| @@ -2,17 +2,19 @@ | |||
|
|
|||
| [](https://arxiv.org/abs/2402.12660) | |||
| [](https://openxlab.org.cn/apps/detail/Amphion/SingVisio) | |||
| [](https://github.com/open-mmlab/Amphion/assets/33707885/0a6e39e8-d5f1-4288-b0f8-32da5a2d6e96) | |||
| [](https://speechteam.feishu.cn/wiki/KrIIwpjIVi7MhtkiCcXcjFI2nib) | |||
| @@ -87,7 +87,7 @@ Amphion provides a comprehensive objective evaluation of the generated audio. Th | |||
|
|
|||
| Amphion provides visualization tools to interactively illustrate the internal processing mechanism of classic models. This provides an invaluable resource for educational purposes and for facilitating understandable research. | |||
|
|
|||
| Currently, Amphion supports [SingVisio](egs/visualization/SingVisio/README.md), a visualization tool of the diffusion model for singing voice conversion. [](https://arxiv.org/abs/2402.12660) [](https://openxlab.org.cn/apps/detail/Amphion/SingVisio) [](https://github.com/open-mmlab/Amphion/assets/33707885/0a6e39e8-d5f1-4288-b0f8-32da5a2d6e96) | |||
| Currently, Amphion supports [SingVisio](egs/visualization/SingVisio/README.md), a visualization tool of the diffusion model for singing voice conversion. [](https://arxiv.org/abs/2402.12660) [](https://openxlab.org.cn/apps/detail/Amphion/SingVisio) [](https://speechteam.feishu.cn/wiki/KrIIwpjIVi7MhtkiCcXcjFI2nib) | |||
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
✨ Description
Update: SingVisio citations and resources links
🚧 Related Issues
None
👨💻 Changes Proposed
🧑🤝🧑 Who Can Review?
@lmxue @RMSnow
🛠 TODO
None
✅ Checklist