General-purpose large language model (LLM)-based chatbots are increasingly used by clinicians to discuss medical problems, including antibiotic prescribing. Their use creates an unprecedented setting for clinical reasoning in which diagnostic and therapeutic thinking becomes dynamically shared between human and machine. Here, we propose a theoretical framework, intended for subsequent empirical assessment, around the concept of shared reasoning fragility, defined as the potential instability arising from the interaction between clinician reasoning and the chatbot’s opaque, association-based processes, which are structurally different from classical human reasoning. The theoretical framework is based on the conceptual argument that, while the black box dilemma is often discussed for classification-oriented clinical decision support systems with an emphasis on explainability versus external validation, chatbot-assisted practice introduces a distinct problem: chatbots can accompany clinicians throughout the entire reasoning pathway rather than being consulted only at the final decision point. In the present perspective, we argue more explicitly that the fragility of this continuous co-reasoning primarily stems from its novelty and pervasiveness. Using strictly illustrative examples in antibiotic prescribing, we suggest the theoretical possibility that fluent and convincing outputs may redirect attention, mask omissions in work-up, and subtly shift hypothesis selection during shared clinical reasoning processes. While it is important to stress that our framework is purely theoretical and thus cannot be confirmed at the present stage, our considerations are intended to motivate the required quantitative research to confirm or refute shared reasoning fragility, measure its extent, and evaluate downstream implications for patient care.

A Theoretical Framework for Shared Reasoning Fragility in Clinician-Chatbot Interactions Through the Example of Antibiotic Prescribing

Grossi A.;
2026-01-01

Abstract

General-purpose large language model (LLM)-based chatbots are increasingly used by clinicians to discuss medical problems, including antibiotic prescribing. Their use creates an unprecedented setting for clinical reasoning in which diagnostic and therapeutic thinking becomes dynamically shared between human and machine. Here, we propose a theoretical framework, intended for subsequent empirical assessment, around the concept of shared reasoning fragility, defined as the potential instability arising from the interaction between clinician reasoning and the chatbot’s opaque, association-based processes, which are structurally different from classical human reasoning. The theoretical framework is based on the conceptual argument that, while the black box dilemma is often discussed for classification-oriented clinical decision support systems with an emphasis on explainability versus external validation, chatbot-assisted practice introduces a distinct problem: chatbots can accompany clinicians throughout the entire reasoning pathway rather than being consulted only at the final decision point. In the present perspective, we argue more explicitly that the fragility of this continuous co-reasoning primarily stems from its novelty and pervasiveness. Using strictly illustrative examples in antibiotic prescribing, we suggest the theoretical possibility that fluent and convincing outputs may redirect attention, mask omissions in work-up, and subtly shift hypothesis selection during shared clinical reasoning processes. While it is important to stress that our framework is purely theoretical and thus cannot be confirmed at the present stage, our considerations are intended to motivate the required quantitative research to confirm or refute shared reasoning fragility, measure its extent, and evaluate downstream implications for patient care.
2026
2026
2026
19
1
9
9
601126
ELETTRONICO
Inglese
antibiotic prescribing; artificial intelligence; deep learning; healthcare; infection; machine learning; natural language processing
262
Giacobbe, D. R.; Grossi, A.; Marelli, C.; Muccio, M.; Guastavino, S.; Murgia, Y.; Mora, S.; Signori, A.; Rosso, N.; Giacomini, M.; Campi, C.; Piana, M...espandi
open
Articoli su Riviste::Articolo su Rivista
13
info:eu-repo/semantics/article
File in questo prodotto:
File Dimensione Formato  
GIACOBBE et al. (2026)_A Theoretical Framework for Shared Reasoning Fragility in Clinician-Chatbot Interactions.pdf

accesso aperto

Tipologia: Versione Editoriale (PDF)
Licenza: Creative commons
Dimensione 2.17 MB
Formato Adobe PDF
2.17 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11383/2213352
 Attenzione

L'Ateneo sottopone a validazione solo i file PDF allegati

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact