SHARP: Generating Synthesizable Molecules via Fragment-Based Hierarchical Action-Space Reinforcement Learning for Pareto Optimization.

Authors

Jeonghyeon Kim, Seongok Ryu, Woohyeong Lee, Ansoo Lee, Hahnbeom Park, Chaok Seok

Published in

Journal of chemical information and modeling. Oct 24, 2025. Epub Oct 24, 2025.

Abstract

Designing drug-like molecules that satisfy multiple objectives-such as high binding affinity, synthesizability, and drug-likeness-poses a complex global optimization problem over an astronomically large chemical space. Existing deep learning-based molecular generative models often treat this task as distribution modeling, relying on atom-level autoregressive actions with less consideration of explicit optimization feedback. Consequently, they frequently generate invalid structures, converge to local optima, or produce synthetically infeasible candidates. Here, we introduce Synthesizable Hierarchical Action-space Reinforcement learning for Pareto optimization (SHARP), a molecular generator that addresses these limitations via a fragment-based hierarchical action space and reinforcement learning. SHARP ensures synthetic accessibility by applying action masks guided by a pretrained Synthesizability Estimation Model (SEM). The reinforcement learning (RL) policy is trained using a composite reward function integrating docking scores, pharmacophore matching, and solvent accessibility to generate functionally relevant and experimentally tractable molecules. Furthermore, across four lead optimization tasks-fragment growing, linker design, scaffold hopping, and side chain decoration-on a diverse receptor set, SHARP consistently outperforms prior methods in producing molecules at high affinity with reasonable synthesizability. These results demonstrate that reinforcement learning with a chemically intuitive action space design can be an effective solution to the optimization challenges in AI-driven drug discovery, offering a robust framework for rational molecular design in structure-based applications.

PMID:
41134962
Bibliographic data and abstract were imported from PubMed on 25 Oct 2025.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.