Skip to content

Commit

Permalink
[BUGFix] Disable tensorcore when shape is really small (#159)
Browse files Browse the repository at this point in the history
* Refactor BatchMatMulEmitter and BatchMatMulSelector for improved readability and maintainability

* Refactor import statements for improved readability and maintainability

* Refactor import statements for improved readability and maintainability

* disable failure email for ci

* remove email notifications.

* move relax pass from testing to mlc_llm

* Refactor scripts with se check_eual_ref_scripts_with_emitter function

* Lint Fix

* Refactor scripts with se check_eual_ref_scripts_with_emitter function

* buf fix for matrix support

* lint fix

* dispatch tensor core based on shapes
  • Loading branch information
LeiWang1999 authored Aug 29, 2024
1 parent 2c6a1e8 commit ad1d7ae
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion bitblas/gpu/matmul_analysis.py
Original file line number Diff line number Diff line change
Expand Up @@ -666,7 +666,7 @@ def check_last_trait(region: List[Range]):

block_stmt = sch.get(main_block)

minimal_tensorize_threshold = 16
minimal_tensorize_threshold = 16 if in_dtype in ["bfloat16", "float16"] else 32
# the batch dimension is not taken into consideration.
extent = block_stmt.iter_vars[1].dom.extent
if isinstance(extent,
Expand Down

0 comments on commit ad1d7ae

Please sign in to comment.