Skip to content

Issues: fla-org/flash-linear-attention

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

25 Open 120 Closed
25 Open 120 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Gated DeltaNet unused D parameter
#226 opened Mar 12, 2025 by koceja
The formulas about generalized delta rule.
#224 opened Mar 11, 2025 by necrophagists
[Bug] Inference Error in Sliding Window Attention Layer Due to Out-of-Bounds Indexing bug Something isn't working
#223 opened Mar 11, 2025 by Lynn-020809
2 tasks done
@sustcsonglin
[Bug] RuntimeError: Triton Error [CUDA]: context is destroyed bug Something isn't working
#222 opened Mar 11, 2025 by Triang-jyed-driung
2 tasks done
[Feature Request] Customize initialization / Add a switch for turning off FLA's initialization enhancement New feature or request
#220 opened Mar 10, 2025 by Triang-jyed-driung
3
[Feature Request] Allow Q K has different sequence len enhancement New feature or request
#219 opened Mar 10, 2025 by vanhowe
3
[RFC] Support context parallelism enhancement New feature or request
#217 opened Mar 7, 2025 by sustcsonglin
[Feature Request] Enhancing Unit Testing for FLA in the Context of Active Development and Diverse GPU Compatibility enhancement New feature or request todo To be implemented
#209 opened Mar 1, 2025 by uniartisan
@uniartisan
1
[Feature Request] enhancement New feature or request
#203 opened Feb 26, 2025 by conceptofmind
7
Discrepancy on the hedgehog featmap implementation
#195 opened Feb 21, 2025 by LouChao98
[RFC] Increase computation intensity for certain kernels enhancement New feature or request
#190 opened Feb 17, 2025 by sustcsonglin
1
Questions about ops.ttt.naive.py
#185 opened Feb 14, 2025 by necrophagists
3
[RFC] enhanced evaluation support enhancement New feature or request
#184 opened Feb 13, 2025 by sustcsonglin
3
[RFC] Fuse elementwise operations in RWKV layers enhancement New feature or request
#165 opened Feb 5, 2025 by sustcsonglin
2
[RFC] Support more hybrid patterns enhancement New feature or request urgent
#153 opened Feb 1, 2025 by sustcsonglin
[RFC] Implement model-specific 4d parallelism enhancement New feature or request
#148 opened Jan 28, 2025 by yzhangcs
1
[RFC] Fuse shortconv and output norm/gate into the kernel enhancement New feature or request
#140 opened Jan 24, 2025 by sustcsonglin FLA v1.0.0 release
@yzhangcs
[Bug] TypeError: 'constexpr' object is not iterable bug Something isn't working stale
#138 opened Jan 23, 2025 by York-Cheung
@yzhangcs
6
[RFC] Support for more finetuning Transformers to RNNs methods (e.g., LOLCATS) enhancement New feature or request urgent
#127 opened Jan 19, 2025 by sustcsonglin
[RFC] Autotune should consider batch size and number of heads enhancement New feature or request urgent
#117 opened Jan 11, 2025 by sustcsonglin FLA v1.0.0 release
2
[RFC] Remove head_first kernel enhancement New feature or request todo To be implemented
#114 opened Jan 10, 2025 by sustcsonglin FLA v1.0.0 release
[RFC] add Griffin and RecurrentGemma kernels enhancement New feature or request stale
#110 opened Jan 6, 2025 by sustcsonglin FLA v1.0.0 release
2
[RFC] Add xLSTM kernels enhancement New feature or request
#109 opened Jan 6, 2025 by sustcsonglin FLA v1.0.0 release
[RFC] Add TTT and Titans kernel enhancement New feature or request urgent
#107 opened Jan 5, 2025 by sustcsonglin FLA v1.0.0 release
1
[RFC] Add YOCO models enhancement New feature or request stale
#106 opened Jan 5, 2025 by yzhangcs FLA v1.0.0 release
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.