Skip to content

Commit

Permalink
added pretrain and finetune scripts
Browse files Browse the repository at this point in the history
  • Loading branch information
Fida Thoker committed Sep 16, 2024
1 parent 820e81f commit f16f367
Show file tree
Hide file tree
Showing 5 changed files with 10 additions and 10 deletions.
2 changes: 1 addition & 1 deletion FINETUNE.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ We provide the **off-the-shelf** scripts in the [scripts_finetune](scripts_finet
DATA_PATH='Your_Path/20bn-something-something-v2/something-something-v2-annotations/'
# Set the path to save checkpoints
MODEL_PATH='Your_Path/sigma_final_models/pretrain/ssv2/ssv2_vit_b_sigma_with_dino.pth'
OUTPUT_DIR='Output_path/finetune_ssv2_pretrained_with_ssv2_vit_b_sigma_with_dino/eval_lr_1e-3_epoch_40_8gpus_no_update_freq/log.txt'
OUTPUT_DIR='Output_Path/finetune_ssv2_pretrained_with_ssv2_vit_b_sigma_with_dino/eval_lr_1e-3_epoch_40_8gpus_no_update_freq/log.txt'

OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=8 \
--master_port 12320 run_class_finetuning.py \
Expand Down
4 changes: 2 additions & 2 deletions PRETRAIN.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ The implementation of our SIGMA supports **single and multi-node distributed tra
DATA_PATH="Your_Path/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='Your_Path/20bn-something-something-v2/something-something-v2-annotations/train.csv'

OUTPUT_DIR='Output_path/VITB_SSV2_Pretraining_Dino_single_node/'
OUTPUT_DIR='Output_Path/VITB_SSV2_Pretraining_Dino_single_node/'

OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=8 \
--master_port 12312 run_mae_pretraining.py \
Expand Down Expand Up @@ -60,7 +60,7 @@ To help the community to reproduce our results on slurm cluster, We provide the
DATA_PATH="Your_Path/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='Your_Path/20bn-something-something-v2/something-something-v2-annotations/train.csv'
OUTPUT_DIR='Output_path/VITB_SSV2_Pretraining_Dino_multi_node/'
OUTPUT_DIR='Output_Path/VITB_SSV2_Pretraining_Dino_multi_node/'
JOB_NAME=$1
# 4 for 1 node, 16 for 4 node, etc.
Expand Down
2 changes: 1 addition & 1 deletion scripts_pretrain/pretrain_ssv2_vit_b_multi_node.sh
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ source activate fgvssl
DATA_PATH="/ssdstore/fmthoker/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='/ssdstore/fmthoker/20bn-something-something-v2/something-something-v2-annotations/train.csv'

OUTPUT_DIR='/ivi/zfs/s0/original_homes/fthoker/runs/VITB_SSV2_Test/'
OUTPUT_DIR='Output_Path/VITB_SSV2_Pretraining_Dino_multi_node/'

JOB_NAME=$1
# 8 for 1 node, 16 for 2 node, etc.
Expand Down
6 changes: 3 additions & 3 deletions scripts_pretrain/pretrain_ssv2_vit_b_single_node.sh
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
DATA_PATH="/ssdstore/fmthoker/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='/ssdstore/fmthoker/20bn-something-something-v2/something-something-v2-annotations/train.csv'
DATA_PATH="Your_Path/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='Your_Path/20bn-something-something-v2/something-something-v2-annotations/train.csv'

OUTPUT_DIR='/ivi/zfs/s0/original_homes/fthoker/runs/VITB_SSV2_Test/'
OUTPUT_DIR='Output_path/VITB_SSV2_Pretraining_Dino_single_node/'

OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=8 \
--master_port 12312 run_mae_pretraining.py \
Expand Down
6 changes: 3 additions & 3 deletions scripts_pretrain/pretrain_ssv2_vit_s.sh
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@

DATA_PATH="/ssdstore/fmthoker/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='/ssdstore/fmthoker/20bn-something-something-v2/something-something-v2-annotations/train.csv'
DATA_PATH="Your_Path/20bn-something-something-v2/something-something-v2-videos_avi/"
DATA_PATH_CSV='Your_Path/20bn-something-something-v2/something-something-v2-annotations/train.csv'

OUTPUT_DIR='/ivi/zfs/s0/original_homes/fthoker/runs/VITS_SSV2_Test/'
OUTPUT_DIR='Output_Path/runs/VITS_SSV2_DINO/'

OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=8 \
--master_port 12312 run_mae_pretraining.py \
Expand Down

0 comments on commit f16f367

Please sign in to comment.