Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Redesign ML units #385

Open
bensoltoff opened this issue Oct 6, 2022 · 6 comments · Fixed by #386
Open

Redesign ML units #385

bensoltoff opened this issue Oct 6, 2022 · 6 comments · Fixed by #386
Labels
hard

Comments

@bensoltoff
Copy link
Member

Consider Alison Hill's revised tidymodels workshop. Still pretty similar to the old one, but has some distinct adjustments. Worth incorporating into a three-day unit on ML?
@bensoltoff bensoltoff added the hard label Oct 6, 2022
@bensoltoff bensoltoff mentioned this issue Oct 6, 2022
Closed
@bensoltoff
Copy link
Member Author

bensoltoff commented Oct 6, 2022 •
edited
Loading

Day 1

  • Keep what I have
  • Incorporate definition of stratified sampling
  • Introduce yardstick for assessing model performance
  • Define ROC AUC

Day 2

  • Keep as is

Day 3

  • Introduce tree-based inference
  • Define decision tree and hyperparameters
  • Fit decision tree and random forest
  • Tune hyperparameters for RF model using tuning grid
  • Identify the best model and finalize the workflow

@bensoltoff
Copy link
Member Author

Homework

  • Explicitly incorporate tuning for second dataset
  • Replace classification problem with more culturally-sensitive problem

@bensoltoff
Copy link
Member Author

bensoltoff commented Oct 6, 2022 •
edited
Loading

In-class exercises

Ensure they match the slides.

  • Day 1
  • Day 2
  • Day 3

@bensoltoff bensoltoff linked a pull request Oct 17, 2022 that will close this issue
385 redesign ml units #386
Merged
@bensoltoff
Copy link
Member Author

Still need to revise hw07

@bensoltoff bensoltoff reopened this Oct 17, 2022
@bensoltoff
Copy link
Member Author

bensoltoff commented Oct 19, 2022 •
edited
Loading

  • Fix exercise files to be qmd not rmd

@bensoltoff
Copy link
Member Author

bensoltoff commented Oct 19, 2022 •
edited
Loading

  • Fix roc_curve() slide. Should read
roc_curve(data, truth, ...)

truth = actual outcome

... = probability of one of the outcome classes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
hard
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

385 redesign ml units cis-ds/course-site
1 participant
@bensoltoff