Implement other validation methods

[gdevenyi]

• LOOCV-like codes
• nfold-cv
• Multi-atlas fusion mode

We want to as much as possible leverage existing registrations here

[gdevenyi]

LOOCV code written, must test, asking Rob

[gdevenyi]

Multi-atlas fusion code written, can be used for template QC or for multiatlas segmentation. Must test.

[gdevenyi]

For validation codes, should scripts auto-run magetbrain at the end to submit all the jobs?

[gdevenyi]

Furthermore, should I automate producing overlap scores?

[gdevenyi]

NFOLD CV code seems to work, woo.

[gdevenyi]

Automation of overlap scores is essential, code in progress.

As for cross validation, auto-submit makes sense, doing so after the fact is more work than it should be.

[gdevenyi]

Codes for collecting validation results

• nfold cv collect
• multiatlas collect
• loocv collect
• nfold cv with proper stratification of populations see http://scikit-learn.org/stable/modules/generated/sklearn.cross_validation.StratifiedKFold.html