Commits on Jul 25, 2024

1. update float8 integration after UX changes …

   Summary:
   
   float8_experimental landed various BC-breaking UX changes last week.
   This PR updates torchtitan to work with the version of
   float8_experimental after
   pytorch-labs/float8_experimental#332
   
   Test Plan:
   
   ```
   with-proxy CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 NGPU=8 CONFIG_FILE="./train_configs/llama3_8b.toml" ./run_llama_train.sh --training.enable_float8_linear --training.compile
   ```
   
   Reviewers:
   
   Subscribers:
   
   Tasks:
   
   Tags:

   

   vkuzo committed Jul 25, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for cffbf1e
   • Browse repository at this point

   Copy the full SHA

   cffbf1e View commit details

   Browse the repository at this point in the history