Hybrid optimization for efficient pruning of randomly generated neural networks.

Authors

Ji Xia, Huanfei Ma

Published in

Chaos (Woodbury, N.Y.). Volume 35. Issue 7. Jul 01, 2025.

Abstract

Randomly generated neural networks, such as reservoir computing (RC) and extreme learning machines (ELMs), simplify training by fixing randomized weights, but suffer from computational redundancy and high hardware demands due to their reliance on excessive neurons. This paper proposes a hybrid regularization framework integrating L1 and L2 optimization strategies to achieve network size compression while balancing performance. Simulations on classical chaotic systems demonstrate that the optimized network retains only a subset of core neurons from the original network while achieving a comparable predictive performance. Comparative experiments further reveal the differential effects of various pruning strategies and confirm that the hybrid regularization method outperforms other approaches in balancing network compactness and stability, and shows stronger universality. Overall, this work provides an efficient solution for dynamic system modeling in resource-constrained scenarios and physical realization.

PMID:
40690609
Bibliographic data and abstract were imported from PubMed on 22 Jul 2025.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.