-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integrate the audio modality in CoCa #94
base: main
Are you sure you want to change the base?
Commits on May 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d909ae0 - Browse repository at this point
Copy the full SHA d909ae0View commit details -
Configuration menu - View commit details
-
Copy full SHA for e233676 - Browse repository at this point
Copy the full SHA e233676View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9986691 - Browse repository at this point
Copy the full SHA 9986691View commit details -
Configuration menu - View commit details
-
Copy full SHA for c47b6c1 - Browse repository at this point
Copy the full SHA c47b6c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 70823e1 - Browse repository at this point
Copy the full SHA 70823e1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0c87d91 - Browse repository at this point
Copy the full SHA 0c87d91View commit details -
Configuration menu - View commit details
-
Copy full SHA for b652a7d - Browse repository at this point
Copy the full SHA b652a7dView commit details -
Configuration menu - View commit details
-
Copy full SHA for b0e933a - Browse repository at this point
Copy the full SHA b0e933aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d8d5a5f - Browse repository at this point
Copy the full SHA d8d5a5fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ea65c8 - Browse repository at this point
Copy the full SHA 4ea65c8View commit details -
Configuration menu - View commit details
-
Copy full SHA for dfe88c9 - Browse repository at this point
Copy the full SHA dfe88c9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a3e844 - Browse repository at this point
Copy the full SHA 5a3e844View commit details
Commits on May 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 043384d - Browse repository at this point
Copy the full SHA 043384dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3cd9244 - Browse repository at this point
Copy the full SHA 3cd9244View commit details -
Configuration menu - View commit details
-
Copy full SHA for b09d20e - Browse repository at this point
Copy the full SHA b09d20eView commit details -
Configuration menu - View commit details
-
Copy full SHA for e09745d - Browse repository at this point
Copy the full SHA e09745dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a74dee - Browse repository at this point
Copy the full SHA 5a74deeView commit details -
Configuration menu - View commit details
-
Copy full SHA for f7b725c - Browse repository at this point
Copy the full SHA f7b725cView commit details -
Configuration menu - View commit details
-
Copy full SHA for c7308e2 - Browse repository at this point
Copy the full SHA c7308e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 32d0b19 - Browse repository at this point
Copy the full SHA 32d0b19View commit details -
Configuration menu - View commit details
-
Copy full SHA for 55c039f - Browse repository at this point
Copy the full SHA 55c039fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 966d237 - Browse repository at this point
Copy the full SHA 966d237View commit details -
Configuration menu - View commit details
-
Copy full SHA for dacf639 - Browse repository at this point
Copy the full SHA dacf639View commit details -
Configuration menu - View commit details
-
Copy full SHA for b40ecd5 - Browse repository at this point
Copy the full SHA b40ecd5View commit details -
Configuration menu - View commit details
-
Copy full SHA for a9ce132 - Browse repository at this point
Copy the full SHA a9ce132View commit details -
Configuration menu - View commit details
-
Copy full SHA for 63ef47c - Browse repository at this point
Copy the full SHA 63ef47cView commit details
Commits on May 10, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d6d84dc - Browse repository at this point
Copy the full SHA d6d84dcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3d04f78 - Browse repository at this point
Copy the full SHA 3d04f78View commit details -
Configuration menu - View commit details
-
Copy full SHA for e65a3cd - Browse repository at this point
Copy the full SHA e65a3cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 622570d - Browse repository at this point
Copy the full SHA 622570dView commit details -
Configuration menu - View commit details
-
Copy full SHA for efedc77 - Browse repository at this point
Copy the full SHA efedc77View commit details -
Configuration menu - View commit details
-
Copy full SHA for eba23a9 - Browse repository at this point
Copy the full SHA eba23a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9bdc830 - Browse repository at this point
Copy the full SHA 9bdc830View commit details -
Configuration menu - View commit details
-
Copy full SHA for b3aff91 - Browse repository at this point
Copy the full SHA b3aff91View commit details -
Configuration menu - View commit details
-
Copy full SHA for dffe644 - Browse repository at this point
Copy the full SHA dffe644View commit details
Commits on May 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d8bdebc - Browse repository at this point
Copy the full SHA d8bdebcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 244fac9 - Browse repository at this point
Copy the full SHA 244fac9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0524acd - Browse repository at this point
Copy the full SHA 0524acdView commit details -
Configuration menu - View commit details
-
Copy full SHA for df48b62 - Browse repository at this point
Copy the full SHA df48b62View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2945a03 - Browse repository at this point
Copy the full SHA 2945a03View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d0e3f3 - Browse repository at this point
Copy the full SHA 2d0e3f3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c0993f - Browse repository at this point
Copy the full SHA 1c0993fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0e3b239 - Browse repository at this point
Copy the full SHA 0e3b239View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7459ee0 - Browse repository at this point
Copy the full SHA 7459ee0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c0f456 - Browse repository at this point
Copy the full SHA 1c0f456View commit details -
Configuration menu - View commit details
-
Copy full SHA for a04bf97 - Browse repository at this point
Copy the full SHA a04bf97View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9086af6 - Browse repository at this point
Copy the full SHA 9086af6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 351990a - Browse repository at this point
Copy the full SHA 351990aView commit details -
Configuration menu - View commit details
-
Copy full SHA for c90df9d - Browse repository at this point
Copy the full SHA c90df9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 860b8fd - Browse repository at this point
Copy the full SHA 860b8fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 962c4ca - Browse repository at this point
Copy the full SHA 962c4caView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d1ea92 - Browse repository at this point
Copy the full SHA 2d1ea92View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1fb4fba - Browse repository at this point
Copy the full SHA 1fb4fbaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 22c77cd - Browse repository at this point
Copy the full SHA 22c77cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d980e7 - Browse repository at this point
Copy the full SHA 6d980e7View commit details
Commits on Jun 10, 2024
-
Configuration menu - View commit details
-
Copy full SHA for dfb7884 - Browse repository at this point
Copy the full SHA dfb7884View commit details -
Configuration menu - View commit details
-
Copy full SHA for da27f0d - Browse repository at this point
Copy the full SHA da27f0dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 016bed3 - Browse repository at this point
Copy the full SHA 016bed3View commit details
Commits on Jun 11, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 587c52b - Browse repository at this point
Copy the full SHA 587c52bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1ba15bc - Browse repository at this point
Copy the full SHA 1ba15bcView commit details -
Configuration menu - View commit details
-
Copy full SHA for d71cbdb - Browse repository at this point
Copy the full SHA d71cbdbView commit details -
feat: add new Dataset class for Audio/Vision
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for e824400 - Browse repository at this point
Copy the full SHA e824400View commit details -
fix: incorrect variable usage and audio input shape
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for fcaccea - Browse repository at this point
Copy the full SHA fcacceaView commit details -
fix: to avoid torch.tensor(tensor)
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 5dd535e - Browse repository at this point
Copy the full SHA 5dd535eView commit details -
fix: add argument to ignore padding indices
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 302d396 - Browse repository at this point
Copy the full SHA 302d396View commit details -
test: uptate tests to comply with changes
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 94c85ce - Browse repository at this point
Copy the full SHA 94c85ceView commit details -
feat: add entrypoint for audio coca tokenizer
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for ceaa897 - Browse repository at this point
Copy the full SHA ceaa897View commit details -
These can help run audio-only, vision-only or audio-vision experiments!
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for b3b7f77 - Browse repository at this point
Copy the full SHA b3b7f77View commit details -
mmaurya committed
Jun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 85c0c69 - Browse repository at this point
Copy the full SHA 85c0c69View commit details -
feat: allow masking of "pad" keys
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for e4c956c - Browse repository at this point
Copy the full SHA e4c956cView commit details -
feat: implement Conformer from scratch
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 94e042b - Browse repository at this point
Copy the full SHA 94e042bView commit details -
test: fix to comply to changes
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for c6c6f30 - Browse repository at this point
Copy the full SHA c6c6f30View commit details -
mmaurya committed
Jun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 03db6ec - Browse repository at this point
Copy the full SHA 03db6ecView commit details -
mmaurya committed
Jun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 9704c09 - Browse repository at this point
Copy the full SHA 9704c09View commit details -
feat: add audio-only and vision-only arrow dataset
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 7c5e063 - Browse repository at this point
Copy the full SHA 7c5e063View commit details -
chore: fix configs to comply to changes
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for a554b82 - Browse repository at this point
Copy the full SHA a554b82View commit details -
chore: add script which generates tokenizer
On the basis of a training.txt file and number of assimilation operations, a bpecodes file is generated which is used to create bpe_to_ind and ind_to_bpe dictionary pickles required for tokenization and detokenization.
mmaurya committedJun 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 75a0ebe - Browse repository at this point
Copy the full SHA 75a0ebeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 50add61 - Browse repository at this point
Copy the full SHA 50add61View commit details -
Configuration menu - View commit details
-
Copy full SHA for 433ac9d - Browse repository at this point
Copy the full SHA 433ac9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for aa50864 - Browse repository at this point
Copy the full SHA aa50864View commit details -
Configuration menu - View commit details
-
Copy full SHA for faeec41 - Browse repository at this point
Copy the full SHA faeec41View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c6fcff - Browse repository at this point
Copy the full SHA 1c6fcffView commit details -
Configuration menu - View commit details
-
Copy full SHA for e90a8d5 - Browse repository at this point
Copy the full SHA e90a8d5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 42f469b - Browse repository at this point
Copy the full SHA 42f469bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 03082b8 - Browse repository at this point
Copy the full SHA 03082b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 78efe14 - Browse repository at this point
Copy the full SHA 78efe14View commit details -
Configuration menu - View commit details
-
Copy full SHA for deb0788 - Browse repository at this point
Copy the full SHA deb0788View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a9695d - Browse repository at this point
Copy the full SHA 4a9695dView commit details -
Configuration menu - View commit details
-
Copy full SHA for f04243a - Browse repository at this point
Copy the full SHA f04243aView commit details -
Configuration menu - View commit details
-
Copy full SHA for cad8d11 - Browse repository at this point
Copy the full SHA cad8d11View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3653922 - Browse repository at this point
Copy the full SHA 3653922View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3b72cd2 - Browse repository at this point
Copy the full SHA 3b72cd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 357c76e - Browse repository at this point
Copy the full SHA 357c76eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2a4f45d - Browse repository at this point
Copy the full SHA 2a4f45dView commit details -
Configuration menu - View commit details
-
Copy full SHA for ae71bb7 - Browse repository at this point
Copy the full SHA ae71bb7View commit details -
Configuration menu - View commit details
-
Copy full SHA for b04652a - Browse repository at this point
Copy the full SHA b04652aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 137d4f2 - Browse repository at this point
Copy the full SHA 137d4f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for d93e6e5 - Browse repository at this point
Copy the full SHA d93e6e5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9528bb6 - Browse repository at this point
Copy the full SHA 9528bb6View commit details
Commits on Jun 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0c0317a - Browse repository at this point
Copy the full SHA 0c0317aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5f63246 - Browse repository at this point
Copy the full SHA 5f63246View commit details -
Configuration menu - View commit details
-
Copy full SHA for 857867e - Browse repository at this point
Copy the full SHA 857867eView commit details -
feat: add new Dataset class for Audio/Vision
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for c9ad825 - Browse repository at this point
Copy the full SHA c9ad825View commit details -
fix: incorrect variable usage and audio input shape
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 97ecb20 - Browse repository at this point
Copy the full SHA 97ecb20View commit details -
fix: to avoid torch.tensor(tensor)
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 4463ae7 - Browse repository at this point
Copy the full SHA 4463ae7View commit details -
fix: add argument to ignore padding indices
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for b410073 - Browse repository at this point
Copy the full SHA b410073View commit details -
test: uptate tests to comply with changes
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 6c0ced6 - Browse repository at this point
Copy the full SHA 6c0ced6View commit details -
feat: add entrypoint for audio coca tokenizer
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for e0577b7 - Browse repository at this point
Copy the full SHA e0577b7View commit details -
These can help run audio-only, vision-only or audio-vision experiments!
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for f40f7f6 - Browse repository at this point
Copy the full SHA f40f7f6View commit details -
mmaurya committed
Jun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 8bed2c2 - Browse repository at this point
Copy the full SHA 8bed2c2View commit details -
feat: allow masking of "pad" keys
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 743d999 - Browse repository at this point
Copy the full SHA 743d999View commit details -
feat: implement Conformer from scratch
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for b2cb27c - Browse repository at this point
Copy the full SHA b2cb27cView commit details -
test: fix to comply to changes
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 7a23ced - Browse repository at this point
Copy the full SHA 7a23cedView commit details -
mmaurya committed
Jun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 363701c - Browse repository at this point
Copy the full SHA 363701cView commit details -
mmaurya committed
Jun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for d403c62 - Browse repository at this point
Copy the full SHA d403c62View commit details -
feat: add audio-only and vision-only arrow dataset
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for bc0d9f0 - Browse repository at this point
Copy the full SHA bc0d9f0View commit details -
chore: fix configs to comply to changes
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for bae2f0f - Browse repository at this point
Copy the full SHA bae2f0fView commit details -
chore: add script which generates tokenizer
On the basis of a training.txt file and number of assimilation operations, a bpecodes file is generated which is used to create bpe_to_ind and ind_to_bpe dictionary pickles required for tokenization and detokenization.
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 0cf2290 - Browse repository at this point
Copy the full SHA 0cf2290View commit details -
Configuration menu - View commit details
-
Copy full SHA for f871403 - Browse repository at this point
Copy the full SHA f871403View commit details -
Configuration menu - View commit details
-
Copy full SHA for c9f58b9 - Browse repository at this point
Copy the full SHA c9f58b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1806062 - Browse repository at this point
Copy the full SHA 1806062View commit details -
mmaurya committed
Jun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for f8181d0 - Browse repository at this point
Copy the full SHA f8181d0View commit details -
chore: update audio coca arrow dataset config
mmaurya committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 25803ca - Browse repository at this point
Copy the full SHA 25803caView commit details
Commits on Jun 13, 2024
-
chore: Merge branch 'feat/audio_coca' of https://github.com/Modalitie…
…s/modalities into feat/audio_coca
Configuration menu - View commit details
-
Copy full SHA for b27bf78 - Browse repository at this point
Copy the full SHA b27bf78View commit details -
Configuration menu - View commit details
-
Copy full SHA for cca934e - Browse repository at this point
Copy the full SHA cca934eView commit details -
Configuration menu - View commit details
-
Copy full SHA for bcc7e9d - Browse repository at this point
Copy the full SHA bcc7e9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e78b2ea - Browse repository at this point
Copy the full SHA e78b2eaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d5f459 - Browse repository at this point
Copy the full SHA 8d5f459View commit details -
Configuration menu - View commit details
-
Copy full SHA for 162c965 - Browse repository at this point
Copy the full SHA 162c965View commit details