New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Emit Batchnorm Op for Training #1208

Open

avik-pal opened this issue Jan 17, 2025 · 1 comment · May be fixed by #1236

Labels

Member

avik-pal commented Jan 17, 2025

#1142 has the code for training but we don't emit it since we need to implement the adjoint in EnzymeJAX

avik-pal added the reactant label

avik-pal linked a pull request

that will close this issue

feat: emit batch norm training op #1236

Open

3 tasks

Member Author

avik-pal commented Feb 28, 2025

I am having second thoughts about this. XLA has a pass that expands the batchnorm ops, so it might not make sense to emit them in the first place

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment