"Pre-asymptotic Optimality of Cross-validation"Bartel, FelixChoosing models from a hypothesis space is a frequent task in inverse problems. Cross-validation is a classical tool in the learner's repertoire to estimate the goodness of one such model. Much work was dedicated to computing this quantity in a fast manner but tackling its theoretical properties occurs to be difficult. So far, most optimality results are stated in an asymptotic fashion. Here, we propose a concentration inequality on the difference of cross-validation score and the least-squares error. This gives a pre-asymptotic bound which holds with high probability. For the assumptions we rely on bounds on the uniform error of the model which allow for a broadly applicable framework. We support our claims by applying this machinery to Shepard's model where we are able to determine precise constants of the concentration inequalities. Numerical experiments in combination with fast algorithms indicate the applicability of our results. |
| http://univie.ac.at/projektservice-mathematik/e/talks/Bartel_2021-06_bare_conf_ICCHA.pdf |
« back