Methods based on penalized likelihood cannot be applied in many problems. Statistical learning theory provide the theoretical framework for predictive inference, but model choice based on VC dimension is often not feasible. In binary classification, ROC curve and AUC provide a reasonable criterium for model choice, combined with resampling.