Technology
Mental health workers raise concerns over algorithmic triage tools while California debates AI health legislation
Clinicians at Kaiser Permanente and Rogers Behavioral Health report intake errors and delays, prompting union demands and proposed state regulations.
The short version
- Mental health clinicians report that increasing reliance on AI and automated tools for patient intake and triage is leading to care delays, missed diagnoses, and improper treatment placements.
- Health care provider spokespeople maintain that the technology is intended only to support clinicians and that all final clinical decisions remain in the hands of licensed professionals.
- In response to the expanding use of AI in medical settings, California lawmakers are considering bills to increase transparency, protect workers who override AI recommendations, and prohibit clinical decisions made solely by algorithms.
Key facts
- Mental health workers at Kaiser Permanente and Rogers Behavioral Health report that algorithmic triage and intake systems have resulted in missed diagnoses, treatment delays, and inappropriate patient placements.[Hacker News]
- Spokespeople for Kaiser Permanente and Rogers Behavioral Health stated that AI tools are meant to support clinical judgment rather than replace it, asserting that licensed clinicians make all admission, triage, and placement decisions.[Hacker News]
- Rogers Behavioral Health partnered with AI company Limbic in late 2024 to assist with intake processes, case management, and clinical assessments.[Hacker News]
- California Assembly Bill 2575 would protect health care workers from retaliation if they override AI recommendations, mandate AI transparency, and shift liability for patient harm to AI developers and facilities.[Hacker News]
- The California Hospital Association and Kaiser signed a letter opposing AB 2575, contending that it would undermine clinical decision support systems.[Hacker News]
- California Assembly Bill 1979 proposes to ban clinical decisions based strictly on AI outputs and strengthen data privacy controls.[Hacker News]
What remains uncertain
- The extent to which clinical triage staffing changes are directly caused by AI implementation versus broader corporate restructuring remains disputed between union workers and management.[Hacker News]