Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Best subset selection meets resampling: tackling selection instability at very low numbers of events per variable.

Created on 16 Oct 2026

Authors

Ricardo Knauer, Nicholas M Brisson, Georg N Duda, Deborah Falla, David W Evans, Erik Rodner

Published in

The international journal of biostatistics. Oct 15, 2026. Epub Oct 15, 2026.

Abstract

Trust is a basic necessity for translating machine learning models from bench to bedside. To foster clinicians' trust in predictive models, these models should be interpretable or explainable. A major prerequisite for interpretability or explainability is that feature subsets are stable, i.e., that predictors returned by feature or best subset selection approaches do not change dramatically when the data is perturbed only slightly. However, prior research has shown that stable selections are usually not possible when the number of labels in the smaller class per feature, or outcome events per variable (EPV), is very low, and it remains challenging to build stable, interpretable models in such cases. In this work, we conduct a narrative review in the very low EPV regime and propose to combine cardinality-constrained best subset selection for logistic regression with resampling to tackle the selection instability. We perform a comprehensive evaluation on both synthetic and real-world clinical data, and find that our novel resampling-based model selection procedure yields interpretable feature subsets with a better discriminative performance and stability compared to best subset selection without resampling as well as feature selection with and without resampling. A Python package implementing the proposed methods is available at https://github.com/ml-lab-htw/l0l2learn.

PMID:
42878117
Bibliographic data and abstract were imported from PubMed on 16 Oct 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 11
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement