Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Maxvit #65

Open
wants to merge 69 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
69 commits
Select commit Hold shift + click to select a range
f275de7
Started adding maxvit
isamu-isozaki Apr 30, 2023
8242bdb
Started adapting lucidrian's maxvit
isamu-isozaki May 1, 2023
72551b7
Fixed attention in maxvitAttention
isamu-isozaki May 2, 2023
35244d6
Made maxvitblock
isamu-isozaki May 2, 2023
2f905c7
Cleaned up init
isamu-isozaki May 2, 2023
4e473d4
Main part done
isamu-isozaki May 2, 2023
4e91cb4
Added some documentation
isamu-isozaki May 2, 2023
f63913d
Confirmed run on random input
isamu-isozaki May 7, 2023
77da80e
Added docs
isamu-isozaki Jul 23, 2023
ad4d2a4
Removed some data
isamu-isozaki Jul 23, 2023
fcf417d
Refactored
isamu-isozaki Jul 23, 2023
e88bc1f
Resolved conflicts
isamu-isozaki Jul 23, 2023
c8107b7
Properly save
isamu-isozaki Jul 23, 2023
11fcedb
Added more docs
isamu-isozaki Jul 23, 2023
debe7a0
Added doc
isamu-isozaki Jul 23, 2023
c907c1c
Made mbconv a class
isamu-isozaki Jul 23, 2023
b91b149
Reformatting
isamu-isozaki Jul 23, 2023
e8e5fbe
Remove config for now
isamu-isozaki Jul 23, 2023
b1e17f1
Removed redundant
isamu-isozaki Jul 23, 2023
08b9e87
Fixed shape mismatch
isamu-isozaki Jul 23, 2023
147db13
Fixed according to original paper
isamu-isozaki Jul 23, 2023
0fcf030
maxvit training test
isamu-isozaki Jul 23, 2023
de55e1b
Resolve conflict
isamu-isozaki Jul 25, 2023
3a3881a
Resolve conflict
isamu-isozaki Jul 25, 2023
b04369a
Created config
isamu-isozaki Jul 25, 2023
8024ec2
Setting up tests
isamu-isozaki Aug 6, 2023
c0d1cb2
Logging
isamu-isozaki Aug 6, 2023
5398a71
More logs
isamu-isozaki Aug 6, 2023
b8a140f
Using conv
isamu-isozaki Aug 6, 2023
cbd8ac6
conv embeds
isamu-isozaki Aug 6, 2023
097f7a8
Fixed embedding_size
isamu-isozaki Aug 7, 2023
32840dd
Fixed embedding_size
isamu-isozaki Aug 7, 2023
9488364
Fixed embedding_size
isamu-isozaki Aug 7, 2023
0f63263
Disable pe
isamu-isozaki Aug 7, 2023
dd0b00a
Logs
isamu-isozaki Aug 7, 2023
81917c8
Back to pe
isamu-isozaki Aug 7, 2023
49a6616
Fixed shape
isamu-isozaki Aug 7, 2023
bec0da3
Made windowsize 8
isamu-isozaki Aug 7, 2023
b3561b7
Fixed variable size
isamu-isozaki Aug 7, 2023
e7805f5
Checking bias shape
isamu-isozaki Aug 7, 2023
dc8f67a
disable xformers
isamu-isozaki Aug 7, 2023
1f153a3
Logging
isamu-isozaki Aug 7, 2023
a49b2b6
Fixed permute
isamu-isozaki Aug 8, 2023
3747f18
Moved to minimal batch size
isamu-isozaki Aug 8, 2023
9e96358
Smaller window size
isamu-isozaki Aug 8, 2023
99e18d0
More logging
isamu-isozaki Aug 8, 2023
a7bc2c6
Check memory usage
isamu-isozaki Aug 11, 2023
dab1459
Printing model size
isamu-isozaki Aug 12, 2023
196e65c
Printing model size
isamu-isozaki Aug 12, 2023
a2713da
Removed some logs
isamu-isozaki Aug 12, 2023
9f9b508
Fixed model size
isamu-isozaki Aug 12, 2023
289a952
Fixed model size
isamu-isozaki Aug 12, 2023
fda1343
Roughly fixed memory issue
isamu-isozaki Aug 12, 2023
b041878
logging memory usage
isamu-isozaki Aug 12, 2023
6c1a6bd
logs
isamu-isozaki Aug 12, 2023
f8feba8
Resolved conflicts
isamu-isozaki Aug 13, 2023
8a19a82
Added back
isamu-isozaki Aug 13, 2023
ee405e5
Removed logs
isamu-isozaki Aug 13, 2023
d39df3e
Remove readme changes
isamu-isozaki Aug 13, 2023
030d107
Reduced diffs
isamu-isozaki Aug 13, 2023
8bfd0a3
Fixed style with make style
isamu-isozaki Aug 13, 2023
0f0fe52
Removed more diffs
isamu-isozaki Aug 13, 2023
63515d4
Removed diffs
isamu-isozaki Aug 13, 2023
db1b8bb
Removed diffs
isamu-isozaki Aug 13, 2023
7d348c9
lion test
isamu-isozaki Aug 13, 2023
19dc870
logs
isamu-isozaki Aug 13, 2023
a2a7847
Removed conversion to tuple
isamu-isozaki Aug 13, 2023
d6c144e
Removed conversion to tuple
isamu-isozaki Aug 13, 2023
46396a8
Removed logs
isamu-isozaki Aug 13, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
Started adding maxvit
isamu-isozaki committed Apr 30, 2023
commit f275de73419d9cab28fede8dcf6353bbc59e47c4
Loading