Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable custom all-reduce for ROCm. #34

Closed
wants to merge 2 commits into from
Closed

Enable custom all-reduce for ROCm. #34

wants to merge 2 commits into from

Commits on Jun 5, 2024

  1. Enable custom all-reduce for ROCm. 

    * add csrc custom_all_reduce into compilation
* add ops and pybindings
* do not disable custom all-reduce on ROCm in config
* port the custom all reduce source and test to HIP
* remove volatile signatures on ROCm
* optimized locking for ROCm
* increase default #threads and decrease #blocks after testing
    @iotamudelta
    iotamudelta committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    21b9048 View commit details
    Browse the repository at this point in the history

  2. Fix parantheses.

    @iotamudelta
    iotamudelta committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    c4fdf62 View commit details
    Browse the repository at this point in the history