Skip to content
This repository has been archived by the owner on Aug 7, 2024. It is now read-only.

[wip] add axiswise granularity to Float8Tensor #352

Open
wants to merge 1 commit into
base: gh/vkuzo/61/base
Choose a base branch
from

Commits on Jul 29, 2024

  1. [wip] add axiswise granularity to Float8Tensor

    Summary:
    
    This PR adds the axiswise scaling granularity to `Float8Tensor` and
    ensures that basic ops like transpose and `torch._scaled_mm` work as
    expected.
    
    A future PR will add integration with `Float8Linear`.
    
    Test Plan:
    
    TODO
    
    Reviewers:
    
    Subscribers:
    
    Tasks:
    
    Tags:
    
    [ghstack-poisoned]
    vkuzo committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    6dffce9 View commit details
    Browse the repository at this point in the history