Skip to content

avr2002/hyperparameter-optimization

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PythonVersion License https://github.com/solegalli/hyperparameter-optimization/blob/master/LICENSE Sponsorship https://www.trainindata.com/

Hyperparameter tuning for Machine Learning - Code Repository

Launched: May, 2021

Links

Table of Contents

  1. Cross-Validation

    1. K-fold, LOOCV, LPOCV, Stratified CV
    2. Group CV and variants
    3. CV for time series
    4. Nested CV
  2. Basic Search Algorithms

    1. Manual Search, Grid Search and Random Search
  3. Bayesian Optimization

    1. with Gaussian Processes
    2. with Random Forests (SMAC) and GBMs
    3. with Parzen windows (Tree-structured Parzen Estimators or TPE)
  4. Multi-fidelity Optimization

    1. Successive Halving
    2. Hyperband
    3. BOHB
  5. Other Search Algorthms

    1. Simulated Annealing
    2. Population Based Optimization
  6. Gentetic Algorithms

    1. CMA-ES
  7. Python tools

    1. Scikit-learn
    2. Scikit-optimize
    3. Hyperopt
    4. Optuna
    5. Keras Tuner
    6. SMAC
    7. Others

Links

About

[branch: avr/my-course-notes]My notes for the course Hyperparameter Optimization for Machine Learning

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%