"# attention-visualizer"
-
Notifications
You must be signed in to change notification settings - Fork 0
Visualizing BERT-base-cased's attention heads on their subject-verb relationships through pattern analysis and BertViz visualization tools. This project explores how different attention heads capture syntactic dependencies between subjects and their corresponding verbs across various layers of the model.
vulong2505/attention-visualizer
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Visualizing BERT-base-cased's attention heads on their subject-verb relationships through pattern analysis and BertViz visualization tools. This project explores how different attention heads capture syntactic dependencies between subjects and their corresponding verbs across various layers of the model.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published