13.6 Cross validation and log score for logistic regression

  • As in Section 11.8, we can use loo crossvalidation to compare models. In this case the log score is:

log score=nnewi=1yilogpnewi+(1yi)log(1pnewi)

  • For calibration purposes: If you have no info and simply assign p=0.5 for every outcome, the log score is 0.693nnew.

  • Examples using loo will be given in the next session