Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial Vision Transformer architecture with MAE decoder #37

Merged
merged 14 commits into from
Nov 21, 2023
Merged

Initial Vision Transformer architecture with MAE decoder #37

Show file tree
Hide file tree
Changes from 13 commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
06535cd
:pushpin: Pin to Pytorch 2.0 and CUDA 11.2
weiji14 Nov 15, 2023
1959771
:heavy_plus_sign: Add lightly
weiji14 Nov 16, 2023
fb8d06b
:construction: Initial Vision Transformer architecture with MAE decoder
weiji14 Nov 16, 2023
dc70447
:twisted_rightwards_arrows: Merge branch 'main' into model/init-vit
weiji14 Nov 19, 2023
fa40098
Revert ":heavy_plus_sign: Add lightly"
weiji14 Nov 19, 2023
bbd9f75
:heavy_plus_sign: Add transformers
weiji14 Nov 19, 2023
5fd5314
:building_construction: Switch from torchvision to transformers ViTMAE
weiji14 Nov 20, 2023
4770235
:necktie: Implement forward pass and training_step
weiji14 Nov 20, 2023
ed99427
:white_check_mark: Add unit test for MAELitModule
weiji14 Nov 20, 2023
4d2d7c2
:pushpin: Pin to CUDA 11.8
weiji14 Nov 20, 2023
c7b8e66
:twisted_rightwards_arrows: Merge branch 'main' into model/init-vit
weiji14 Nov 21, 2023
2ce108a
:card_file_box: Increase input channels from 12 to 13
weiji14 Nov 21, 2023
269eacf
:bug: Remove hardcoded batch_size in assert statements
weiji14 Nov 21, 2023
b4ac16c
:truck: Rename to model_vit.py and ViTLitModule
weiji14 Nov 21, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading