Code

Reg cocktails#358

Code

Draft

ravinkohli wants to merge 50 commits intodevelopmentautoml/Auto-PyTorch:developmentfrom reg_cocktailsautoml/Auto-PyTorch:reg_cocktailsCopy head branch name to clipboard

+3,711-944

Commits

Commits on Jul 21, 2022

• First push for Mix/cut regularization

  Show description for e138b69
  

  franchuterivera

  authored and

  ravinkohli

  committed
  e138b69

  Copy full SHA for e138b69

• Add cyclic property to lr scheduler and use_swa to trainer

  Show description for 3b4feae
  ravinkohli

  committed
  3b4feae

  Copy full SHA for 3b4feae

• ADD tests for SWA, SE

  Show description for b845d4d
  ravinkohli

  committed
  b845d4d

  Copy full SHA for b845d4d

• ADD tests for LookAhead

  Show description for 8a2364d
  ravinkohli

  committed
  8a2364d

  Copy full SHA for 8a2364d

• Added default for lookahead config

  Show description for e2ee40a
  ravinkohli

  committed
  e2ee40a

  Copy full SHA for e2ee40a

• Fix errors in Adversarial training

  ravinkohli

  committed
  6e0d2bb

  Copy full SHA for 6e0d2bb

• Fix pickling error for swa model

  ravinkohli

  committed
  9290b07

  Copy full SHA for 9290b07

• Fix issues after rebase from refactor_development

  Show description for c35c795
  ravinkohli

  committed
  c35c795

  Copy full SHA for c35c795

• Added n_restarts as hyperparameter for CosineAnnealing

  ravinkohli

  committed
  2512709

  Copy full SHA for 2512709

• fix bug with ealy stopping and swa

  ravinkohli

  committed
  41677fd

  Copy full SHA for 41677fd

• cont...

  Show description for e236df0
  ravinkohli

  committed
  e236df0

  Copy full SHA for e236df0

• Addressed comments from arlind, change in T_mul and T_0 calculations

  Show description for f29a7e0
  ravinkohli

  committed
  f29a7e0

  Copy full SHA for f29a7e0

• Updating search space (#156)

  Show description for f141d06
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  f141d06

  Copy full SHA for f141d06

• Adding constant clause in the testing module for hyperparameter ranges, removing use_pynisher since it is not used anymore, hack for the moment to bypass illegal hyperparameter ranges for conditions

  Show description for 9339895
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  9339895

  Copy full SHA for 9339895

• Updating implementation for tabular regression

  Show description for 126f7d4
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  126f7d4

  Copy full SHA for 126f7d4

• Fixing buggy implementation of the network head with constant updates

  

  ArlindKadra

  authored and

  ravinkohli

  committed
  f6f05ba

  Copy full SHA for f6f05ba

• Updating implementation

  Show description for 456e261
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  456e261

  Copy full SHA for 456e261

• Implementation fix for constant updates to skip connections. Multibranch choice was dependant on an illegal value

  

  ArlindKadra

  authored and

  ravinkohli

  committed
  c7af699

  Copy full SHA for c7af699

• Fixing the implementation for weight decay in the case of fixed updates. The reason is the illegal value for weight decay when use weight decay is off

  

  ArlindKadra

  authored and

  ravinkohli

  committed
  2102b08

  Copy full SHA for 2102b08

• update setup.py

  ravinkohli

  committed
  18da2bd

  Copy full SHA for 18da2bd

• Updating implementation of the reg cocktails so that it is compatible with fixed search space updates

  Show description for 18bdabf
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  18bdabf

  Copy full SHA for 18bdabf

• Create fit evaluator, no resampling strategy and fix bug for test statistics

  Show description for 0c2c604
  ravinkohli

  committed
  0c2c604

  Copy full SHA for 0c2c604

• Additional metrics during train (#194)

  Show description for 6d4790f
  ravinkohli

  committed
  6d4790f

  Copy full SHA for 6d4790f

• Fixing issues with imbalanced datasets (#197)

  Show description for 5168ba5
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  5168ba5

  Copy full SHA for 5168ba5

• Reproducibility in cocktail (#204)

  Show description for 23d808b
  ravinkohli

  committed
  23d808b

  Copy full SHA for 23d808b

• fix bug in adversarial trainer (#207)

  ravinkohli

  committed
  6283c56

  Copy full SHA for 6283c56

• Add dropout shape as a hyperparameter (#213)

  Show description for bc0540b
  ravinkohli

  committed
  bc0540b

  Copy full SHA for bc0540b

• Change weighted loss to categorical and fix for test adversarial trainer (#214)

  ravinkohli

  committed
  5d6062f

  Copy full SHA for 5d6062f

• added no head (#218)

  ravinkohli

  committed
  622c185

  Copy full SHA for 622c185

• Fix bugs in cutout training (#233)

  Show description for c4b7729
  ravinkohli

  committed
  c4b7729

  Copy full SHA for c4b7729

• Cocktail hotfixes (#245)

  Show description for 0c8d2ff
  

  ArlindKadra

  authored and

  ravinkohli

  committed
  0c8d2ff

  Copy full SHA for 0c8d2ff

• [refactor] Address Shuhei's comments

  Show description for c1a73f8
  

  nabenabe0928

  authored and

  ravinkohli

  committed
  c1a73f8

  Copy full SHA for c1a73f8

• [doc] Add referencing to each regularization techniques

  

  nabenabe0928

  authored and

  ravinkohli

  committed
  769e041

  Copy full SHA for 769e041

• [fix] Address Ravin's comments and fix range issues in row cut

  

  nabenabe0928

  authored and

  ravinkohli

  committed
  0da4f72

  Copy full SHA for 0da4f72

• [doc] Add the reference to the fit_dictionary

  

  nabenabe0928

  authored and

  ravinkohli

  committed
  c4a4565

  Copy full SHA for c4a4565

• Bug fixes (#249)

  Show description for 6543316
  

  3 peoplecommitted
  6543316

  Copy full SHA for 6543316

• [FIX] Passing checks (#298)

  Show description for 392f07a
  

  ravinkohli

  and

  nabenabe0928

  committed
  392f07a

  Copy full SHA for 392f07a

• [FIX] Tests after rebase of reg_cocktails (#359)

  Show description for 02e97a1
  ravinkohli

  committed
  02e97a1

  Copy full SHA for 02e97a1

• rebase and fix flake

  ravinkohli

  committed
  03ddb64

  Copy full SHA for 03ddb64

• fix merge conflicts after rebase

  ravinkohli

  committed
  59b5830

  Copy full SHA for 59b5830

• [FIX] Enable preprocessing in reg_cocktails (#369)

  Show description for c3b8844
  ravinkohli

  committed
  c3b8844

  Copy full SHA for c3b8844

• fixes after rebase

  ravinkohli

  committed
  c1fffa1

  Copy full SHA for c1fffa1

• [FIX] SWA and SE with non cyclic schedulers (#395)

  Show description for 366bede
  

  ravinkohli

  and

  nabenabe0928

  committed
  366bede

  Copy full SHA for 366bede

• fixes after rebase

  ravinkohli

  committed
  637a68b

  Copy full SHA for 637a68b

Commits on Jul 26, 2022

• fix tests after rebase

  ravinkohli

  committed
  e69ff3b

  Copy full SHA for e69ff3b

• fix mypy and flake

  ravinkohli

  committed
  c138173

  Copy full SHA for c138173

• fix silly removal of lightgbm

  ravinkohli

  committed
  afddca5

  Copy full SHA for afddca5

Commits on Aug 12, 2022

• [add] documentation update in base trainer (#468)

  theodorju

  authored
  34c704d

  Copy full SHA for 34c704d

Commits on Sep 23, 2022

• [FIX] apply cutout for each row. (#481)

  Show description for d29d11b
  ravinkohli

  authored
  d29d11b

  Copy full SHA for d29d11b

Commits on Oct 17, 2022

• [FIX] ROC AUC for multi class classification (#482)

  Show description for 873df9a
  ravinkohli

  authored
  873df9a

  Copy full SHA for 873df9a