Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FP8 2D forward convolution using rocMLIR #2507

Merged
merged 128 commits into from
Dec 7, 2023
Merged
Changes from 1 commit
Commits
Show all changes
128 commits
Select commit Hold shift + click to select a range
df7f8a3
changes for the FP8 ref implementation
umangyadav Nov 9, 2023
9bc1828
cppcheck fixes
umangyadav Nov 9, 2023
155a2b1
move FNUZ as template parameter
umangyadav Nov 10, 2023
d9f11e3
Fix numeric limits
umangyadav Nov 10, 2023
4e9d51f
Working FNUZ and FN
umangyadav Nov 10, 2023
7639c28
use float equal
umangyadav Nov 10, 2023
a6372c5
add test for fp8e5m2
umangyadav Nov 10, 2023
439ea40
add test for fp8e5m2fnuz
umangyadav Nov 10, 2023
183db78
refactor add some comments
umangyadav Nov 10, 2023
ab653af
Review updates
umangyadav Nov 13, 2023
8319e01
Fix tidy
umangyadav Nov 14, 2023
9ee0418
Fix test failure
umangyadav Nov 14, 2023
355e4f6
fix isfinite
umangyadav Nov 14, 2023
ba471f4
Merge remote-tracking branch 'origin/develop' into ref_fp8
umangyadav Nov 14, 2023
6aec703
fix test for neg inf
umangyadav Nov 14, 2023
12aac37
fix warning
umangyadav Nov 14, 2023
6009232
add tests
umangyadav Nov 14, 2023
03f7139
Fix tests
umangyadav Nov 14, 2023
1e220c0
add stringstream tests
umangyadav Nov 14, 2023
a83e9dc
Remove clang diagnostics
umangyadav Nov 15, 2023
dfb35a6
Merge remote-tracking branch 'origin/develop' into ref_fp8
umangyadav Nov 15, 2023
26956f1
Remove NOLINTS
umangyadav Nov 15, 2023
269ce6d
Bugfixes and additional tests
umangyadav Nov 16, 2023
6414ee3
Fix undoing
umangyadav Nov 16, 2023
cd26ada
Handle underflow case separately to avoid sanitization errors
umangyadav Nov 16, 2023
1cf87ef
use std::min to avoid sanitization errors
umangyadav Nov 16, 2023
e7e5ba2
Merge branch 'develop' into ref_fp8
umangyadav Nov 16, 2023
98a838f
formatting
umangyadav Nov 16, 2023
61e4e1d
use 31 for min value
umangyadav Nov 16, 2023
a5c38eb
add note
umangyadav Nov 16, 2023
61775ea
Merge branch 'ref_fp8' of github.com:ROCmSoftwarePlatform/AMDMIGraphX…
umangyadav Nov 16, 2023
3806427
Merge branch 'develop' into ref_fp8
umangyadav Nov 16, 2023
017d67e
add some more comments
umangyadav Nov 17, 2023
9e6d866
Merge branch 'ref_fp8' of github.com:ROCmSoftwarePlatform/AMDMIGraphX…
umangyadav Nov 17, 2023
a9dd42f
port gpu changes
umangyadav Nov 17, 2023
d7339e8
use bit cast
umangyadav Nov 17, 2023
6094234
Make FNUZ template param and add numeric limits
umangyadav Nov 17, 2023
78ec77e
only compile for device
umangyadav Nov 17, 2023
3411649
remove non-JIT related code
umangyadav Nov 17, 2023
d2c25a0
Remove FP8_Lowest/Max
umangyadav Nov 17, 2023
5da68df
remove using for dtypes
umangyadav Nov 17, 2023
b36f72d
Update float8_impl
umangyadav Nov 17, 2023
85ba819
constructor from float works with constexpr
umangyadav Nov 17, 2023
aed1922
Remove unnecessary pragmas
umangyadav Nov 17, 2023
f975c63
Remove clang diagnostics
umangyadav Nov 17, 2023
32033d8
Add back floatequal
umangyadav Nov 17, 2023
e88d46a
disable DPP For FP8
umangyadav Nov 17, 2023
3ae93ca
Merge remote-tracking branch 'origin/develop' into gpu_fp8
umangyadav Nov 17, 2023
60dd1f4
formatting
umangyadav Nov 17, 2023
ef425d0
revert unwanted changes
umangyadav Nov 17, 2023
76f0318
Merge branch 'gpu_fp8' of https://github.com/ROCmSoftwarePlatform/AMD…
umangyadav Nov 17, 2023
bd0ae5f
add some more tests
umangyadav Nov 17, 2023
91cc9c7
Add math and reduce tests
umangyadav Nov 18, 2023
e2b0c40
Fix tidy and other errors
umangyadav Nov 18, 2023
9f50051
fixes
umangyadav Nov 18, 2023
249464c
add nolint
umangyadav Nov 18, 2023
1be9587
tidy fix
umangyadav Nov 18, 2023
13403ab
roialign, softmax, pow, acosh, atanh,pad tests are enabled now
umangyadav Nov 20, 2023
f550f81
add layernorm, remove constexpr for 1/r
umangyadav Nov 20, 2023
7e3444c
tidy fixes
umangyadav Nov 20, 2023
6155c78
use __builtin_is_constant_evaluated
umangyadav Nov 20, 2023
13ef414
add test for rsqrt and remove old-styple-cast
umangyadav Nov 20, 2023
8660572
add comment about c++20 extensions
umangyadav Nov 20, 2023
6fbd997
Remove old cast
umangyadav Nov 20, 2023
2acd265
Remove DPP
umangyadav Nov 20, 2023
836e201
Remove MIN max overloads
umangyadav Nov 20, 2023
f9542d5
Put numeric_max and numeeric lowest into float8
umangyadav Nov 20, 2023
480288f
use void for highest to match template candidates
umangyadav Nov 21, 2023
a6c5772
add float8 for tensorview
umangyadav Nov 21, 2023
3aa465f
compiles all right
umangyadav Nov 26, 2023
037205c
Works now
umangyadav Nov 26, 2023
87548b5
add ifdef to compile
umangyadav Nov 26, 2023
d473b80
add tests and fix cmake
umangyadav Nov 26, 2023
4604f2e
add tests
umangyadav Nov 26, 2023
ad9c25e
add eliminate_fp8 pass
umangyadav Nov 26, 2023
8734ffa
remove convert from lowering
umangyadav Nov 26, 2023
f014fb9
Fix eliminate_fp8 pass
umangyadav Nov 26, 2023
83ce487
Move pass before optimize module
umangyadav Nov 26, 2023
9a9e964
formatting
umangyadav Nov 26, 2023
c40a39c
fix cppcheck
umangyadav Nov 26, 2023
c4cee34
Merge branch 'develop' into rocblas_fp8
umangyadav Dec 1, 2023
f155b0e
merge changes
umangyadav Dec 1, 2023
38218ed
few changes
umangyadav Dec 1, 2023
379692f
few more cosmetic changes
umangyadav Dec 1, 2023
381b2d9
add half tests
umangyadav Dec 2, 2023
ce61ea6
add quant_dot support for fp8
umangyadav Dec 2, 2023
575fc04
mlir fp8
umangyadav Nov 26, 2023
afb55bd
add some MLIR fp8 tests for convolutions
umangyadav Nov 27, 2023
f293193
small example for fp8 fail case
umangyadav Nov 28, 2023
a8ef912
add test for conv_bn with 1e-1f
umangyadav Nov 28, 2023
32e0855
fix conv_bn eps
umangyadav Nov 28, 2023
f18418b
add pooling to unsupported ops
umangyadav Nov 28, 2023
9acd36a
update eps
umangyadav Nov 28, 2023
c314119
update eps
umangyadav Nov 28, 2023
88eb355
add conv tests supported by MLIR
umangyadav Nov 28, 2023
3f21332
remove half test and add it as template
umangyadav Dec 3, 2023
050184c
revert some changes
umangyadav Dec 3, 2023
4e07dfc
revert some changes
umangyadav Dec 3, 2023
370d18c
add quant_conv tests
umangyadav Dec 3, 2023
24c63d7
add comment for 1d convs
umangyadav Dec 3, 2023
c522d47
I dont' know why this test was disabled for the PGpu but enabling it …
umangyadav Dec 3, 2023
fe585d4
Disable FP8 tests for the non-gfx940 arches
umangyadav Dec 3, 2023
994d24b
use helper function to determine gfx940
umangyadav Dec 3, 2023
51ac4fd
fix naming
umangyadav Dec 3, 2023
d06dd8d
use generale_type
umangyadav Dec 3, 2023
40e7698
do not use brackets
umangyadav Dec 3, 2023
119a6b8
Try removing fusing converts
umangyadav Dec 3, 2023
fc093b0
formatting
umangyadav Dec 3, 2023
b6a436f
update MLIR commit hasH
umangyadav Dec 3, 2023
c60a4a4
Merge branch 'rocblas_mlir_fp8' of github.com:ROCmSoftwarePlatform/AM…
umangyadav Dec 4, 2023
5423577
use updated eliminate_fp8 pass
umangyadav Dec 4, 2023
402c66a
use eliminate_data_type pass instead of eliminate_fp8 pass
umangyadav Dec 5, 2023
8738f3b
Merge branch 'develop' into rocblas_fp8
umangyadav Dec 5, 2023
4ca90ec
remove older files
umangyadav Dec 5, 2023
b099a7d
remove header
umangyadav Dec 5, 2023
7d6e6ad
fix typo
umangyadav Dec 5, 2023
cf91c2b
add changes for the eliminate_data_type pass
umangyadav Dec 5, 2023
82f9847
add comments
umangyadav Dec 5, 2023
a9db2bf
fix typo
umangyadav Dec 5, 2023
aeaac20
remove else
umangyadav Dec 5, 2023
a196e90
disable tests that uses CK
umangyadav Dec 5, 2023
7e80f62
formatting
umangyadav Dec 5, 2023
a3d4b01
use same SHA as develop branch
umangyadav Dec 5, 2023
a98d86d
Merge branch 'rocblas_fp8' into rocblas_mlir_fp8
umangyadav Dec 5, 2023
de27b91
use angled brackets
umangyadav Dec 5, 2023
b6250a4
add comment
umangyadav Dec 6, 2023
b254223
formatting
umangyadav Dec 6, 2023
acd9bd3
Merge branch 'develop' into rocblas_mlir_fp8
umangyadav Dec 6, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/develop' into ref_fp8
umangyadav committed Nov 14, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit ba471f440553cbe4689381e1fc362c4f258b3b33

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.