Discussions

• 1 You must be logged in to vote

  💬

  Best practices for automated parameter sweeps

  HenrikAsmuth started Nov 18, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Pipeline Parallelism Support

  mitchadam started Nov 14, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🤖

  DDP share information before processes are properly initialized.

  AndrasSalamon asked Nov 12, 2024 in DDP / multi-GPU / multi-node · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Use a pretrained model for training another model

  haertelkar asked Nov 9, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Closed · Unanswered

  

  

  1
• 8 You must be logged in to vote

  ⚡

  Gist on how to use Schedule-Free in Lightning

  CompRhys asked Apr 10, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  10
• 2 You must be logged in to vote

  ⚡

  Log the same metric when using multiple dataloaders in validation_step()

  thangld201 asked Sep 13, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 2 You must be logged in to vote

  ⚡

  self.global_step understanding

  ajinkyaambatwar asked Jun 16, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  3
• 6 You must be logged in to vote

  ⚡

  Timed out initializing process group in store based....

  EvanZ asked Nov 9, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  ddp_weakref is not set during the backward pass

  lokesh-vr-17773 asked Nov 4, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 7 You must be logged in to vote

  ⚡

  How to overwrite checkpoints with ModelCheckpoint

  nsabir2011 asked Nov 24, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  What is trainer/global_step in wandb logging?

  edmcman asked Oct 30, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 3 You must be logged in to vote

  ⚡

  Gradient checkpointing with DDP in a loop

  shivammehta25 asked Nov 11, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  8
• 2 You must be logged in to vote

  🤖

  Optuna HPO & Lightning Multi-GPU Training using DDP on SLURM - ValueError: World Size does not Match

  eTuDpy asked May 30, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  ⚡

  Exact behaviour of .prepare_data() and .setup() in LightningDataModule when passing DM or dataloaders to Trainer in respect to internal hooks.

  tiefenthaler asked Oct 29, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  How to change auto-requeue hpc.ckpt path

  arijit-hub started Oct 22, 2024 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  ⚡

  Active Learning Trainer

  BerAnton asked Oct 25, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  Collect Threads after Trainer.fit

  42elenz asked Oct 23, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Logging in Multi - GPU and new on_validation_step function

  42elenz asked Oct 23, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  Both GPUs are getting same data from IterableDataset with DDP

  akshat-suwalka asked Jul 22, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🤖

  Collective mismatch at end of training epoch

  valtsblukis asked Aug 3, 2022 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  ⚡

  Using sklearn data pre-processing pipelines inside LightningDataModule

  tiefenthaler asked Apr 23, 2024 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 3 You must be logged in to vote

  💬

  could not find the monitored key in the returned metrics

  morestart started Oct 17, 2023 in General · Closed

  

  

  

  

  4
• 1 You must be logged in to vote

  🤖

  Issue with ToTensor Transform and Multiprocessing in PyTorch Lightning

  DaniMlk asked Oct 15, 2024 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Dataloader reinsertion for recursive predictionsrs

  leonardcaquot94 started Oct 11, 2024 in General

  

  

  0
• 8 You must be logged in to vote

  💬

  Conflict between Lightning and Huggingface Transformers (device_map).

  richarddwang started Jun 20, 2023 in General

  

  

  

  

  4