Skip to content

Commit

Permalink
Fallback to 16-mixed AMP mode because of undiagnosed issue with `bf…
Browse files Browse the repository at this point in the history
…16-mixed`

Seemingly randomly, some jobs will fail with a 'TypeError: Got unsupported ScalarType BFloat16' error
  • Loading branch information
nathanpainchaud committed Jun 27, 2024
1 parent 02542a9 commit 8957e04
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ test: True

trainer:
devices: 1
precision: bf16-mixed
precision: 16-mixed

data:
batch_size: 128
Expand Down

0 comments on commit 8957e04

Please sign in to comment.