Kaiser Nurses Warn AI Surveillance Undermines Patient Care
Kaiser nurses say AI, workplace surveillance are making their jobs, care worse
Kaiser Permanente nurses report that AI-driven surveillance and strict call-time metrics are forcing them to cut compassionate care short. Facing performance penalties for spending over 15 minutes on complex cases, staff feel pressured to prioritize speed over patient safety. As union negotiations begin, these healthcare workers argue that algorithmic management threatens to replace human empathy with profit-driven efficiency.
You aren't calling Comcast. We're dealing with life here.
- derekdahmer
I RFTA and the majority of the complaints are about call center metrics and the pressure to ration care. These are real concerns about misuse of metrics, but not AI. The AI empathy thing was a 2024 pilot that was discontinued.
FWIW my wife works for Kaiser and finds a lot of value in the the medical LLM tools available to her. She tells me being able to do live translation, summarize notes, and quickly get comprehensive answers save her time and help her give better care. Her older patients also frequently come in bringing AI-powered alerts from their apple watches that detected cardiac events.
It's annoying that we use broad terms to describe a set of technologies that in some ways can be problematic and in another ways are very beneficial. We gotta evaluate each of these as they come rather than talk about blanket bans.
- neaden
If you think using a machine to evaluate how well a human is showing empathy is a good idea, you probably shouldn't have any position of power.
- abeindoria
That is surprising. My primary care provider had a different response. Basically he said something in line of
"You wouldn't believe how much of a relief it has been. In your last visit, you saw me typing everything you were saying, right? I don't have to. I can listen to you and take very specific notes as necessary as opposed to focusing on both typing and listening to you at the same time. It has bought my stress levels down to here." (Indicated by his hand lowering)
- segfault99
Workplace metrics and surveillance... What could possibly go wrong?
That being said, more than one (female at that) doctor has told me in confidence and based upon their observations during residencies, etc. that if I'm ever admitted, be very careful how I modulate my interactions with nurses. They're not all Florence Nightingale and Mother Theresa and there exist those who will @#$% you up on various pretexts or are just plain sloppy and negligent.
Despite all the moralising fluff, it's just a job, not some saintly vocation. Some safety oversight is needed, just as it is for any other work function. Still, can bet that anything 'Corporate' has mandated will be Goodharted up the wazoo.
- doodlebugging
This problem with workplace AI interfering with nurses ability to manage healthcare obligations for their clients is not confined to Kaiser. UHC has also introduced the AI surveillance tools and are using it to do similar things.
- Loughla
The nurses at our local rural hospital are tagged and tracked wherever they go on the hospital campus. Time spent in one spot is part of their review.
I wondered why they zip in and out of the rooms, when just a few years ago they would spend fifteen to twenty minutes in each room. The patient load hadn't grown. The number of nurses has gone up, not down.
So I'm blaming the stupid metric on their evaluations for a worse standard of care.
- lukeschlather
The article mentions uses of AI but doesn't really give any examples of harm from AI. It does give specific examples where it sounds like Kaiser is optimizing calls to minimize cost rather than improve quality of care. It's also pretty easy to expect that the examples given (treating longer calls as a problem and penalizing nurses for giving more than 3 pieces of advice) reduce the quality of care.
- insane_dreamer
the more I read about how AI is being used, the more I'm coming to the conclusion that despite me personally find it quite useful in my work, and even my personal life to some extent, it is a net negative to society as a whole, and if the choice is between zero AI or the AI that is being deployed, we'd be better out without it
what significant improvements to society or humanity have come about as direct result of AI, that wouldn't have been achieved without it? faster protein folding is the only one I can think of and that more a matter of "faster" than "impossible without AI"
I think at some point there's going to be some version of the Butlerian Jihad
- none_to_remain
They want you to blame "AI" like Claude jumped up and decided to start hassling nurses, not individuals in management
- api
Every time “relentless push for efficiency destroying X” comes up I should repost this:
https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart....
This is a well understood phenomenon.