Commits on Jul 26, 2024

1. bring back torch.autograd.Function for float8 matmul …

   Summary:
   
   This is a redo of
   #316
   
   With upcoming support of scaling granularities other than tensorwise,
   we need a good way to control which gemm kernel to call and how to scale
   the input tensors in fwd and bwd. A `torch.autograd.Function` override
   is the cleanest way to do that, and in 2024 this now works with
   `torch.compile`.
   
   Test Plan:
   
   ```
   ./test/test_everything.sh
   ```
   
   Reviewers:
   
   Subscribers:
   
   Tasks:
   
   Tags:
   
   [ghstack-poisoned]

   

   vkuzo committed Jul 26, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for f5beb24
   • Browse repository at this point

   Copy the full SHA

   f5beb24 View commit details

   Browse the repository at this point in the history