This is Kangqi's final project of DDA6202 Optimization Models and Methods in Machine Learning. My project is about the nomalization layer choice in transformer encoder. To this end, I utilized several tests proposed by previous researchers.
-
Notifications
You must be signed in to change notification settings - Fork 0
This is Kangqi's final project of DDA6202 Optimization Models and Methods in Machine Learning. My project is about the nomalization layer choice in transformer encoder. To this end, I utilized several tests proposed by previous researchers.
KyleYu2003/The-Benefits-of-Normalization-Layers-in-Transformers
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This is Kangqi's final project of DDA6202 Optimization Models and Methods in Machine Learning. My project is about the nomalization layer choice in transformer encoder. To this end, I utilized several tests proposed by previous researchers.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published