The AI Clinic · Issue 013Shadow AI & policy
Your staff already found their own AI.
Your clinic probably already has shadow AI
The story I keep coming back to is the one most clinics won't find in a software audit. People are already using AI. The question is whether they have a safe, approved way to do it.
- A survey cited by JMIR found 58% of more than 500 health care professionals had used free, general-purpose AI tools at work.
- Rural health leaders told STAT that AI can lighten documentation but can't cover their financial and staffing losses.
- Researchers rated 27 chronic-pain apps and found quality ranged from poor to good, with engagement scoring poorly.
The Big Story
Your clinic probably already has shadow AI
Some clinicians are quietly using consumer AI tools that their organizations never approved. They're drafting letters, summarizing notes, looking up clinical questions, and trying to get through a workload that still doesn't fit inside the day.
JMIR calls this "shadow AI." The report cites a survey of more than 500 health care professionals in which 58% said they had used free, general-purpose AI tools at work. That gap between what staff need and what an organization has approved creates problems with privacy and accuracy. It also leaves hard questions about cybersecurity, patient consent, and who is accountable when the output is wrong.
Mark's read: This is probably already happening in your clinic. A ban written by someone who has never watched a clinician finish notes at 7 p.m. won't fix it. Give people an approved path, clear rules, and a place to ask questions before a free chatbot becomes the unofficial workflow.
The Rounds
AI can't fill a rural hospital's funding gap
The Trump administration is pointing to AI, including AI-based avatars, as part of the answer for rural health care. Rural leaders interviewed by STAT were much less certain. They described tools that can reduce documentation burden and help with communication, but not the financial and staffing losses putting rural systems at risk.
Mark's read: AI can take work off a care team's plate. It can't replace a clinician, broadband, a referral network, or money. Be suspicious when a technology claim is asked to carry a policy problem it can't solve.
The Rounds
Astra matters because it can use the computer
OpenAI's GPT-6 Astra is getting mixed reviews. It appears unusually strong at computer use and 3D work, while trailing other models on some general reasoning and design benchmarks. That makes it less of an obvious replacement for the model you already use and more of a look at where agents are going.
Mark's read: There is nothing your clinic needs to buy because of Astra this week. Watch the computer-use piece. The model that can reliably work through scheduling, billing, portals, and the EHR will matter more to most clinics than another chatbot that writes a slightly better paragraph.
In the Clinic
What happens when the scribe arrives before the skill?
A new viewpoint asks what ambient AI scribes could do to medical education. The concern is straightforward: if trainees use AI-written notes before they learn to build a note themselves, they may miss some of the clinical reasoning that documentation forces them to practice.
Mark's read: This is a viewpoint, not proof that scribes cause deskilling. One author is also a medical director at Suki.ai, an ambient-scribe company. Still, the teaching question is real. Trainees need protected reps where they gather the story, decide what matters, and write the note without the machine doing the first pass.
In the Clinic
The pain app your colleague likes may still be poor
Researchers evaluated 27 chronic-pain apps relevant to Australian occupational therapy practice. The average objective quality score was 3.33 out of 5, rated acceptable, but scores ranged from poor to good. Engagement scored poorly on average, and the mean subjective quality score was 2.67 out of 5.
Mark's read: "A colleague recommended it" isn't an appraisal method. Before you hand an app to a patient, check who made it, what data it collects, whether the content is accurate, and whether the patient can actually use it long enough to matter.
Research Watch
AI can help with a systematic review, but it can't own one
A narrative review of 21 publications mapped where large language models are being used in systematic reviews and meta-analyses. The authors propose roles for AI across six stages, starting with question development and searching. The framework also covers screening and data extraction, along with analysis, with retrieval and human oversight built into the workflow.
Reported accuracy across the included studies ranged from 61% to 99%, but that isn't one clean performance number. The studies tested different models on different tasks, and the proposed framework still needs real-world validation.
Mark's read: Use AI to help with the labor. Don't let it quietly make the inclusion decisions, invent extraction data, or turn a pile of papers into certainty. The human still owns the methods.
Try This
Find the AI your policy missed
Ask your team one question this week: "Which AI tools are you already using for work?"
Don't start with punishment. Start with the actual workflow. What are they putting into the tool? What are they getting back? Where does patient information enter the process? You can't write a useful AI policy for an imaginary clinic.
The last word
What AI tool is already being used in your clinic that nobody has written down yet? Hit reply and tell me.
Get the next issue.
One email a week. The AI that matters for clinical work, in plain language.