Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cross-architecture distillation #46

Open
jwfanDL opened this issue Feb 17, 2025 · 1 comment
Open

Cross-architecture distillation #46

jwfanDL opened this issue Feb 17, 2025 · 1 comment

Comments

@jwfanDL
Copy link
Contributor

jwfanDL commented Feb 17, 2025

Hi Dkozlov!
Recently, several works have explored how to conduct KD between different architectures, which has become a research hotspot. How about adding a new subcaption that contains cross-architecture KD? If you are willing to do so, I am happy to provide some help.

@dkozlov
Copy link
Owner

dkozlov commented Feb 25, 2025

Hi @jwfanDL,
Sure, could you please create an MR? I don't think that we need to add a new section for these papers since we can add it to the existing "Papers" section.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants