Skip to content

Commit

Permalink
[GH-PAGES] Updated website
Browse files Browse the repository at this point in the history
  • Loading branch information
gh-actions-bot authored and gh-actions-bot committed Jul 16, 2024
1 parent 790f710 commit 90aea5b
Show file tree
Hide file tree
Showing 152 changed files with 412 additions and 411 deletions.
2 changes: 1 addition & 1 deletion main/.buildinfo
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 1466ed63583833c34ee1142b9ed470c5
config: fe32c7cb5b97ad0f8d9995fdc7770612
tags: 645f666f9bcd5a90fca523b33c5a78b7
Binary file modified main/.doctrees/environment.pickle
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/01-vector-add.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/02-fused-softmax.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/03-matrix-multiplication.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/04-low-memory-dropout.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/05-layer-norm.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/06-fused-attention.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/07-extern-functions.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/08-grouped-gemm.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/09-persistent-matmul.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/getting-started/tutorials/sg_execution_times.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.Config.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.autotune.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.heuristics.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.jit.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.abs.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.advance.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.arange.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.argmax.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.argmin.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.associative_scan.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_add.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_and.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_cas.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_max.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_min.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_or.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_xchg.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.atomic_xor.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.broadcast.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.broadcast_to.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.cast.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.cat.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.cdiv.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.ceil.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.clamp.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.cos.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.cumprod.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.cumsum.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.debug_barrier.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.device_assert.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.device_print.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.div_rn.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.dot.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.erf.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.exp.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.exp2.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.expand_dims.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.fdiv.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.flip.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.floor.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.fma.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.full.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.histogram.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.inline_asm_elementwise.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.interleave.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.join.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.load.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.log.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.log2.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.make_block_ptr.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.max.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.max_constancy.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.max_contiguous.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.maximum.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.min.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.minimum.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.multiple_of.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.num_programs.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.permute.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.program_id.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.rand.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.randint.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.randint4x.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.randn.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.range.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.ravel.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.reduce.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.reshape.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.rsqrt.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.sigmoid.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.sin.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.softmax.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.sort.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.split.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.sqrt.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.sqrt_rn.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.static_assert.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.static_print.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.static_range.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.store.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.sum.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.swizzle2d.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.tensor.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.trans.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.umulhi.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.view.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.where.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.xor_sum.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.zeros.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.language.zeros_like.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.testing.Benchmark.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.testing.assert_close.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.testing.do_bench.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.testing.do_bench_cudagraph.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/generated/triton.testing.perf_report.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/triton.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/triton.language.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/python-api/triton.testing.doctree
View file
Binary file not shown.
Binary file modified main/.doctrees/sg_execution_times.doctree
View file
Binary file not shown.
Binary file modified main/_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View file
Binary file not shown.
Binary file modified main/_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View file
Binary file not shown.
Binary file modified main/_images/sphx_glr_01-vector-add_001.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_01-vector-add_thumb.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_02-fused-softmax_001.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_02-fused-softmax_thumb.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_03-matrix-multiplication_001.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_03-matrix-multiplication_002.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_03-matrix-multiplication_thumb.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_05-layer-norm_001.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_05-layer-norm_thumb.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_06-fused-attention_001.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_06-fused-attention_002.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_06-fused-attention_003.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_06-fused-attention_thumb.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_08-grouped-gemm_001.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified main/_images/sphx_glr_08-grouped-gemm_thumb.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
12 changes: 6 additions & 6 deletions main/_sources/getting-started/tutorials/01-vector-add.rst.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -231,29 +231,29 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
vector-add-performance:
size Triton Torch
0 4096.0 8.000000 8.000000
1 8192.0 15.999999 19.200000
2 16384.0 38.400001 31.999999
1 8192.0 19.200000 19.200000
2 16384.0 31.999999 31.999999
3 32768.0 63.999998 63.999998
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 384.000001 384.000001
7 524288.0 614.400016 614.400016
8 1048576.0 819.200021 819.200021
9 2097152.0 1068.521715 1023.999964
10 4194304.0 1260.307736 1260.307736
11 8388608.0 1424.695621 1404.342820
10 4194304.0 1228.800031 1228.800031
11 8388608.0 1424.695621 1424.695621
12 16777216.0 1560.380965 1560.380965
13 33554432.0 1631.601649 1624.859540
14 67108864.0 1669.706983 1662.646960
15 134217728.0 1684.910539 1678.616907
15 134217728.0 1685.813499 1678.616907





.. rst-class:: sphx-glr-timing

**Total running time of the script:** (0 minutes 12.374 seconds)
**Total running time of the script:** (0 minutes 21.245 seconds)


.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:
Expand Down
198 changes: 99 additions & 99 deletions main/_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -330,104 +330,104 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
softmax-performance:
N Triton Torch
0 256.0 476.139488 696.788258
1 384.0 618.827725 827.479292
2 512.0 760.221748 933.050692
3 640.0 797.744455 964.590312
4 768.0 881.327202 1018.776646
5 896.0 931.629145 1073.534358
6 1024.0 989.121470 1115.624655
7 1152.0 1111.718456 610.957464
8 1280.0 1147.279460 665.683488
9 1408.0 1164.170094 724.584712
10 1536.0 1184.197350 780.834636
11 1664.0 1209.547564 813.845228
12 1792.0 1237.864193 858.475756
13 1920.0 1254.234428 908.944638
14 2048.0 1272.763984 959.063498
15 2176.0 1264.692131 977.239079
16 2304.0 1275.217537 1009.596217
17 2432.0 1294.768054 1056.159369
18 2560.0 1300.226170 1083.970309
19 2688.0 1312.048325 1104.527304
20 2816.0 1328.970602 1134.579440
21 2944.0 1324.895257 1169.377885
22 3072.0 1346.332719 1184.220808
23 3200.0 1350.957286 1191.658986
24 3328.0 1353.230317 1221.801758
25 3456.0 1370.634023 1249.755593
26 3584.0 1374.222742 1256.588724
27 3712.0 1378.666064 1265.859437
28 3840.0 1389.815263 1301.320415
29 3968.0 1391.592430 1313.186082
30 4096.0 1392.912426 1324.932316
31 4224.0 1331.948936 1162.355169
32 4352.0 1332.251661 1174.758168
33 4480.0 1354.332825 1183.392495
34 4608.0 1362.559726 1193.508869
35 4736.0 1361.412494 1199.610872
36 4864.0 1374.494003 1225.630352
37 4992.0 1375.903904 1233.775130
38 5120.0 1374.668680 1250.263491
39 5248.0 1372.858541 1257.322491
40 5376.0 1375.811956 1288.827038
41 5504.0 1381.364907 1298.268824
42 5632.0 1386.009236 1312.864735
43 5760.0 1391.944559 1327.558803
44 5888.0 1392.849132 1345.422003
45 6016.0 1396.644789 1351.073081
46 6144.0 1407.104309 1375.616484
47 6272.0 1418.086793 1375.157333
48 6400.0 1417.980384 1387.342354
49 6528.0 1415.249498 1391.602704
50 6656.0 1420.331310 1405.582361
51 6784.0 1417.202111 1412.663309
52 6912.0 1432.381749 1423.158102
53 7040.0 1419.793560 1431.854784
54 7168.0 1430.581340 1436.330930
55 7296.0 1429.945826 1443.592076
56 7424.0 1428.330462 1447.402937
57 7552.0 1424.607809 1455.469007
58 7680.0 1435.101889 1458.109689
59 7808.0 1431.190718 1463.371140
60 7936.0 1437.080733 1469.151768
61 8064.0 1440.554513 1475.989169
62 8192.0 1438.506525 1483.113065
63 8320.0 1388.839432 1404.856624
64 8448.0 1380.906669 1404.087829
65 8576.0 1397.216183 1394.726484
66 8704.0 1391.153016 1400.492698
67 8832.0 1385.181960 1403.439253
68 8960.0 1396.270444 1409.371359
69 9088.0 1409.370731 1415.615460
70 9216.0 1403.434935 1422.651793
71 9344.0 1402.856149 1424.026237
72 9472.0 1396.917353 1432.801002
73 9600.0 1396.123339 1432.422704
74 9728.0 1399.535917 1439.689956
75 9856.0 1414.048642 1442.948339
76 9984.0 1401.676171 1451.736028
77 10112.0 1414.126083 1457.734155
78 10240.0 1420.305433 1466.943900
79 10368.0 1411.127263 1463.104160
80 10496.0 1416.005610 1466.565466
81 10624.0 1409.151943 1470.820498
82 10752.0 1406.087477 1473.168060
83 10880.0 1401.270291 1482.425922
84 11008.0 1424.021362 1478.111364
85 11136.0 1422.071915 1484.134850
86 11264.0 1433.532950 1490.315245
87 11392.0 1420.309112 1489.868394
88 11520.0 1422.613285 1495.584278
89 11648.0 1429.311198 1497.151665
90 11776.0 1430.830235 1501.968013
91 11904.0 1440.067196 1507.183144
92 12032.0 1420.403459 1506.206378
93 12160.0 1419.023122 1511.268039
94 12288.0 1433.554729 1393.015506
95 12416.0 1449.698764 1392.734374
96 12544.0 1441.583664 1393.369388
97 12672.0 1445.716152 1392.544565
0 256.0 478.028491 682.211788
1 384.0 613.236913 801.876368
2 512.0 754.182178 911.741697
3 640.0 798.135845 958.299627
4 768.0 870.664640 1010.572452
5 896.0 928.360671 1058.014237
6 1024.0 984.002664 1120.445299
7 1152.0 1100.139529 610.393022
8 1280.0 1149.246505 669.128065
9 1408.0 1163.366768 720.776311
10 1536.0 1181.114345 779.522923
11 1664.0 1208.491767 813.867402
12 1792.0 1239.280240 855.664171
13 1920.0 1252.974956 908.944638
14 2048.0 1281.808976 958.445467
15 2176.0 1257.374456 974.126326
16 2304.0 1274.510204 1012.575192
17 2432.0 1299.346292 1054.240204
18 2560.0 1301.864916 1085.033216
19 2688.0 1315.793905 1099.785142
20 2816.0 1329.956456 1127.646529
21 2944.0 1320.420864 1163.865922
22 3072.0 1352.366259 1186.801725
23 3200.0 1348.247102 1194.823745
24 3328.0 1356.513581 1220.708485
25 3456.0 1373.092948 1245.892659
26 3584.0 1371.185145 1257.701248
27 3712.0 1381.051681 1270.816849
28 3840.0 1384.313603 1297.482545
29 3968.0 1386.132294 1316.563732
30 4096.0 1396.938877 1326.867313
31 4224.0 1331.989715 1158.815535
32 4352.0 1337.681856 1178.178747
33 4480.0 1356.518707 1181.381781
34 4608.0 1363.974264 1194.697773
35 4736.0 1357.126451 1200.045185
36 4864.0 1374.458060 1221.553039
37 4992.0 1367.842993 1235.787250
38 5120.0 1371.398724 1249.380283
39 5248.0 1371.351976 1259.701601
40 5376.0 1381.782947 1286.871473
41 5504.0 1381.364118 1295.814312
42 5632.0 1381.296323 1313.771361
43 5760.0 1394.546758 1325.800167
44 5888.0 1391.519427 1341.321506
45 6016.0 1398.167209 1353.458566
46 6144.0 1408.655146 1371.358857
47 6272.0 1416.639707 1378.268662
48 6400.0 1415.189418 1391.046639
49 6528.0 1413.696324 1396.664113
50 6656.0 1426.651691 1402.676188
51 6784.0 1410.454865 1412.084452
52 6912.0 1425.137374 1424.746635
53 7040.0 1418.304077 1429.993348
54 7168.0 1429.365415 1435.127952
55 7296.0 1427.991956 1440.786081
56 7424.0 1428.931798 1443.814394
57 7552.0 1423.834653 1454.145375
58 7680.0 1434.387630 1457.834798
59 7808.0 1433.907820 1466.229329
60 7936.0 1435.403687 1466.092109
61 8064.0 1440.171123 1475.208482
62 8192.0 1439.579975 1483.881006
63 8320.0 1387.635765 1404.007749
64 8448.0 1378.185540 1405.672848
65 8576.0 1392.153760 1394.156614
66 8704.0 1391.319871 1399.946213
67 8832.0 1378.923691 1404.064141
68 8960.0 1397.175502 1412.823133
69 9088.0 1407.773026 1413.353068
70 9216.0 1402.477995 1423.756587
71 9344.0 1399.845155 1422.123571
72 9472.0 1395.258197 1432.316744
73 9600.0 1395.873814 1430.873450
74 9728.0 1400.509255 1440.503042
75 9856.0 1414.313838 1441.375337
76 9984.0 1398.687599 1452.498519
77 10112.0 1411.513656 1454.502324
78 10240.0 1420.416437 1462.857218
79 10368.0 1414.151638 1466.318724
80 10496.0 1413.116185 1465.349377
81 10624.0 1410.750742 1467.233318
82 10752.0 1409.067946 1472.827147
83 10880.0 1402.241689 1480.663732
84 11008.0 1421.528681 1473.972025
85 11136.0 1420.534256 1487.110952
86 11264.0 1429.942133 1484.253568
87 11392.0 1415.399403 1489.279925
88 11520.0 1424.292151 1495.239122
89 11648.0 1423.625174 1495.959349
90 11776.0 1429.891952 1503.753380
91 11904.0 1443.761397 1505.134156
92 12032.0 1422.024153 1507.162510
93 12160.0 1417.047651 1509.910523
94 12288.0 1434.709538 1389.347092
95 12416.0 1448.814565 1391.463286
96 12544.0 1443.017867 1392.016397
97 12672.0 1450.992449 1392.449930
Expand All @@ -442,7 +442,7 @@ In the above plot, we can see that:

.. rst-class:: sphx-glr-timing

**Total running time of the script:** (0 minutes 23.352 seconds)
**Total running time of the script:** (0 minutes 25.227 seconds)


.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:
Expand Down
66 changes: 33 additions & 33 deletions main/_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -580,58 +580,58 @@ but feel free to arrange this script as you wish to benchmark any other matrix s
8 1280.0 1280.0 1280.0 157.538463 163.840004
9 1408.0 1408.0 1408.0 155.765024 132.970149
10 1536.0 1536.0 1536.0 176.947204 157.286398
11 1664.0 1664.0 1664.0 179.978245 179.978245
12 1792.0 1792.0 1792.0 172.914215 208.137481
11 1664.0 1664.0 1664.0 183.651271 179.978245
12 1792.0 1792.0 1792.0 172.914215 200.703997
13 1920.0 1920.0 1920.0 200.347822 166.554219
14 2048.0 2048.0 2048.0 226.719125 190.650180
15 2176.0 2176.0 2176.0 211.827867 209.621326
16 2304.0 2304.0 2304.0 229.691080 227.503545
17 2432.0 2432.0 2432.0 203.583068 200.674737
18 2560.0 2560.0 2560.0 222.911566 219.919464
19 2688.0 2688.0 2688.0 198.602388 198.602388
20 2816.0 2816.0 2816.0 212.752230 210.696652
21 2944.0 2944.0 2944.0 221.493479 223.479969
22 3072.0 3072.0 3072.0 210.494802 211.280236
23 3200.0 3200.0 3200.0 214.046818 215.488222
24 3328.0 3328.0 3328.0 207.467716 205.689424
25 3456.0 3456.0 3456.0 217.308808 219.677297
26 3584.0 3584.0 3584.0 210.082692 214.595213
27 3712.0 3712.0 3712.0 208.990259 218.593757
28 3840.0 3840.0 3840.0 207.879708 210.250955
29 3968.0 3968.0 3968.0 208.587935 214.077090
30 4096.0 4096.0 4096.0 219.668951 216.829933
14 2048.0 2048.0 2048.0 223.696203 190.650180
15 2176.0 2176.0 2176.0 211.827867 211.827867
16 2304.0 2304.0 2304.0 227.503545 225.357284
17 2432.0 2432.0 2432.0 205.069087 199.251522
18 2560.0 2560.0 2560.0 222.911566 217.006622
19 2688.0 2688.0 2688.0 199.647657 196.544332
20 2816.0 2816.0 2816.0 210.696652 208.680416
21 2944.0 2944.0 2944.0 218.579083 219.541994
22 3072.0 3072.0 3072.0 205.902197 211.280236
23 3200.0 3200.0 3200.0 214.046818 219.178074
24 3328.0 3328.0 3328.0 206.871539 208.067338
25 3456.0 3456.0 3456.0 216.724640 219.080343
26 3584.0 3584.0 3584.0 215.624440 212.565943
27 3712.0 3712.0 3712.0 209.868376 213.455857
28 3840.0 3840.0 3840.0 209.851994 208.271176
29 3968.0 3968.0 3968.0 211.114084 216.354501
30 4096.0 4096.0 4096.0 221.481394 218.240199
matmul-performance-fp8:
M N K Triton
0 256.0 256.0 256.0 3.276800
1 384.0 384.0 384.0 9.216000
1 384.0 384.0 384.0 10.053818
2 512.0 512.0 512.0 20.164923
3 640.0 640.0 640.0 34.133334
4 768.0 768.0 768.0 42.130286
5 896.0 896.0 896.0 58.538665
6 1024.0 1024.0 1024.0 63.550060
6 1024.0 1024.0 1024.0 61.680940
7 1152.0 1152.0 1152.0 80.702267
8 1280.0 1280.0 1280.0 102.400003
9 1408.0 1408.0 1408.0 82.602666
10 1536.0 1536.0 1536.0 99.688560
10 1536.0 1536.0 1536.0 98.303997
11 1664.0 1664.0 1664.0 116.868992
12 1792.0 1792.0 1792.0 135.414749
12 1792.0 1792.0 1792.0 133.802668
13 1920.0 1920.0 1920.0 99.453240
14 2048.0 2048.0 2048.0 114.130722
15 2176.0 2176.0 2176.0 121.226797
16 2304.0 2304.0 2304.0 134.201527
16 2304.0 2304.0 2304.0 134.959733
17 2432.0 2432.0 2432.0 131.898888
18 2560.0 2560.0 2560.0 146.285712
18 2560.0 2560.0 2560.0 146.941707
19 2688.0 2688.0 2688.0 118.171514
20 2816.0 2816.0 2816.0 129.036114
21 2944.0 2944.0 2944.0 139.596724
22 3072.0 3072.0 3072.0 144.079147
23 3200.0 3200.0 3200.0 138.828637
24 3328.0 3328.0 3328.0 131.611151
25 3456.0 3456.0 3456.0 138.287420
26 3584.0 3584.0 3584.0 148.375230
27 3712.0 3712.0 3712.0 141.297511
22 3072.0 3072.0 3072.0 144.446699
23 3200.0 3200.0 3200.0 139.130432
24 3328.0 3328.0 3328.0 130.537253
25 3456.0 3456.0 3456.0 138.763456
26 3584.0 3584.0 3584.0 148.620481
27 3712.0 3712.0 3712.0 139.716570
28 3840.0 3840.0 3840.0 138.240003
29 3968.0 3968.0 3968.0 145.961642
29 3968.0 3968.0 3968.0 145.613293
30 4096.0 4096.0 4096.0 155.165002
Expand All @@ -640,7 +640,7 @@ but feel free to arrange this script as you wish to benchmark any other matrix s
.. rst-class:: sphx-glr-timing

**Total running time of the script:** (2 minutes 17.000 seconds)
**Total running time of the script:** (2 minutes 17.281 seconds)


.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:
Expand Down
2 changes: 1 addition & 1 deletion main/_sources/getting-started/tutorials/04-low-memory-dropout.rst.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,7 @@ References
.. rst-class:: sphx-glr-timing

**Total running time of the script:** (0 minutes 0.677 seconds)
**Total running time of the script:** (0 minutes 0.684 seconds)


.. _sphx_glr_download_getting-started_tutorials_04-low-memory-dropout.py:
Expand Down
Loading

0 comments on commit 90aea5b

Please sign in to comment.