Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Large Language Models in Multi-Turn Mental Health Dialogues: Simulation-Based Boundary Safety Evaluation Study.

Created on 20 Nov 2026

Authors

Youyou Cheng, Zhuangwei Kang, Kerry Jiang, Chenyu Sun, Qiyang Pan, Tianyu Jiang, Blaine Jacobs

Published in

JMIR formative research. Oct 13, 2026. Epub Oct 13, 2026.

Abstract

Large language models (LLMs) have been widely used for mental health support. However, current safety evaluations in this field are mostly limited to detecting whether LLMs output prohibited words in single-turn conversations, neglecting the gradual erosion of safety boundaries in long dialogues.
This study aims to characterize how safety boundaries erode during multi-turn mental health conversations and to compare different pressure mechanisms that accelerate boundary violations.
We developed a multi-turn stress-testing framework and conducted long-dialogue safety tests on three cutting-edge LLMs using two pressure methods: static progression and adaptive probing. We generated 50 virtual patient profiles and stress-tested each model through up to 20 rounds of virtual psychiatric dialogues (300 conversations in total). Judge determinations were audited by a held-out LLM from a different model family, blinded to the original verdicts.
Violations were common across all models, with both pressure modes producing similar violation rates (131/150, 87.3%, under static progression vs 132/150, 88.0%, under adaptive probing). However, adaptive probing significantly advanced the time-to-breach, reducing the average number of turns from 8.21 in static progression to 4.64; the per-model reduction ranged from 2.52 to 4.51 turns, and all 95% CIs excluded 0. Qualitatively, boundary erosion manifested as a gradual drift from empathetic support to inappropriate medical reassurance. Rather than abruptly failing, models frequently assumed clinical authority, substituted for professional roles, or formed relational dependency when users exhibited persistent distress. Under both mechanisms, the most frequent breach types were certainty or zero-risk reassurance and relational dependence, which together accounted for 69.5% of classifiable breaches under static progression and 62.1% under adaptive probing. In a blinded audit of 231 turns from 20 profiles with author adjudication, 98.2% of flagged breaches were confirmed (κ=0.71).
These findings suggest that the robustness of LLM safety boundaries cannot be inferred solely through single-turn tests; it is necessary to fully consider the wear and tear on safety boundaries caused by different interaction pressures in extended dialogues. Clinical implications include the need for multi-turn safety evaluation protocols and awareness that empathetic responses may gradually drift into boundary violations.

PMID:
43062310
Bibliographic data and abstract were imported from PubMed on 20 Nov 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 2
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement