Code

Distconv channelwise softmax#2148

Code

Open

szaman19 wants to merge 23 commits intoLBANN:developLBANN/lbann:developfrom szaman19:distconv-channelwise-softmaxszaman19/lbann:distconv-channelwise-softmaxCopy head branch name to clipboard

+1,192-511

Commits

Commits on Jun 17, 2024

• Adding channelwise softmax distconv unit test.

  szaman19

  committed
  d41bf54

  Copy full SHA for d41bf54

• Set up boilerplate

  szaman19

  committed
  b3cf148

  Copy full SHA for b3cf148

• Update cmake-ary

  szaman19

  committed
  d108b2f

  Copy full SHA for d108b2f

• - Fixed old file naming issues

  Show description for 0d95e9a
  szaman19

  committed
  0d95e9a

  Copy full SHA for 0d95e9a

• Adding forward impl

  szaman19

  committed
  5fc580c

  Copy full SHA for 5fc580c

• Moved shareed kernels to channelwise_softmax_kernels.cuh

  Show description for 3368e4f
  szaman19

  committed
  3368e4f

  Copy full SHA for 3368e4f

• Compiling and linking correctly

  szaman19

  committed
  569c830

  Copy full SHA for 569c830

• Updated ci test to test split case

  Show description for 3a43037
  szaman19

  committed
  3a43037

  Copy full SHA for 3a43037

• Adding some debug code to see why output is always

  szaman19

  committed
  52399f1

  Copy full SHA for 52399f1

• Passing forward pass on CI

  szaman19

  committed
  cfd768d

  Copy full SHA for cfd768d

• Passing CI tests

  szaman19

  committed
  ce7896f

  Copy full SHA for ce7896f

• - Added model compile-time checks on the shape of the input when distconv is enabled

  Show description for af77dcc
  szaman19

  committed
  af77dcc

  Copy full SHA for af77dcc

• Strange behavior on CI. Every couple of gradient checks fail...

  szaman19

  committed
  a2b1760

  Copy full SHA for a2b1760

• Passing CI tests

  szaman19

  committed
  281aafd

  Copy full SHA for 281aafd

• Updated implementation to incorporate updated channelwise softmax API

  Show description for 4930744
  szaman19

  committed
  4930744

  Copy full SHA for 4930744

• Added guard on double ETI

  szaman19

  committed
  4b57509

  Copy full SHA for 4b57509

• Updated CI test with new environment imports

  Show description for 4896b5d
  szaman19

  committed
  4896b5d

  Copy full SHA for 4896b5d

• Update ci_test/unit_tests/test_unit_layer_channelwise_softmax_distconv.py

  Show description for 66f5ee3
  

  szaman19

  and

  bvanessen

  committed
  66f5ee3

  Copy full SHA for 66f5ee3

Commits on Jun 18, 2024

• Updated year on textsd

  szaman19

  committed
  8eef5a0

  Copy full SHA for 8eef5a0

• Updated instantiation code

  szaman19

  committed
  e9fcd84

  Copy full SHA for e9fcd84

• Updated copyright years

  szaman19

  committed
  602eeab

  Copy full SHA for 602eeab

Commits on Jun 25, 2024

• Remove comment after applying PR suggestions

  szaman19

  committed
  c888476

  Copy full SHA for c888476

• Fix a couple issues with the auto-detection of the NVCC_GENCODE in NCCL (LBANN#2459)

  

  benson31

  authored and

  szaman19

  committed
  bb876fa

  Copy full SHA for bb876fa