Beyond Accuracy: Counterfactual Fragility and Demographic Bias in Clinical Evaluation of LLMs
arXiv:2609.32807v2 Announce Type: replace Abstract: Clinical LLM evaluation often emphasizes answer accuracy; however, accuracy alone does not test counterfactual consistency or demographic robustness. We evaluated six LLMs on 150 MedQA USMLE questions using two automated perturb