KargelaAIAll issues
The AI Clinic

The AI Clinic · Issue 016AI in practice operations

Write it down before you automate it.

A PT owner traded his software for written procedures

By Mark Kargela, PT, DPTOctober 7, 20264 min read

Six stories made the cut this week. Two are about camera-based gait analysis, so I folded them into one. The one I keep coming back to is a PT owner who stopped paying for software and wrote down his procedures instead.

In 30 seconds
  • Larry Benz runs his back office on written procedures and an AI agent that drafts while a human sends.
  • Camera-based gait systems tracked the lab reasonably well, but errors grew in people with Parkinson's disease.
  • A safety screen knocked out 11 of 17 AI models tested on clinical nursing prompts.

The Big Story

A PT owner traded his software for written procedures

Larry Benz has run dental and physical therapy platforms. In his Substack, The Operator, he describes a back office that now runs on a folder of written procedures and an AI agent that follows them. A daily brief lands at 6 AM. His inboxes get sorted overnight into reply now, know about, and cleared. Scheduling requests get a drafted reply offering three open times. He cancelled a paid scheduling tool and replaced it with a written rulebook of his own preferences.

He watched it for a week before he trusted it. By his count, the agent scanned his mail a little over 800 times, drafted exactly one reply, and stayed away from all 23 threads that touched money. His guardrail is simple. The agent drafts, a human sends. Anything that leaves the building, touches a patient, or involves money stays with a person.

Mark's read: This is one operator's account, not an audited case study, so don't treat it as an ROI model. I think he's right about where the work is, though. Benz says the first draft from the agent comes back about 80% right, and most of the miss lives in the procedure, not the machine. Nobody ever wrote down what "flag anything unusual" means. Before you shop for another AI product, check whether the procedure it's supposed to run exists anywhere outside someone's head.

Read the post

In the Clinic

Camera-based gait analysis isn't ready to replace the lab

A Journal of Biomechanics study ran 10 people with Parkinson's disease and 10 healthy adults through a marker-based lab system and two commercial camera setups at the same time. Joint angles and gait speed tracked the lab well, with correlations above 0.7. But errors ran from about 5 to 19 degrees depending on the joint, and the smallest change the camera systems could reliably detect went as high as 28.57 degrees. Errors got worse with fewer cameras, simpler body models, and in the Parkinson's group.

A separate systematic review in Cureus looked at randomized trials that used motion capture and wearable sensors in rehab. The authors report better gait and balance outcomes in everything from neuro rehab to cancer rehab. The trials were too different from each other to pool, though.

Mark's read: Twenty people is a small sample. And look where the errors got worse: in the patients we'd actually use it on. If a vendor shows you a slick phone-based gait report, ask for the minimal detectable change for the joint you care about. If it's bigger than the change you're hoping to see in your patient, that number can't tell you they got better.

Read the study

The Rounds

Why clinicians push back on AI decision support

An npj Digital Medicine meta-synthesis pulled together 13 qualitative studies from nine countries on how health professionals see AI-assisted clinical decisions. They liked the promise of faster diagnosis and easier workflow. The objections were consistent. They couldn't see how the AI reached its answer. Nobody was clear on who's responsible when it's wrong. And they worried about privacy, consent, over-reliance, and losing the human side of care.

Mark's read: If you're rolling out any AI tool, that list is your staff meeting agenda. Answer the "who's responsible" question in writing before go-live. My guess is most of the quiet resistance comes from leaving that one vague.

Read the paper

Academic Corner

PT students' AI attitudes track anxiety, not just knowledge

A survey of 196 physiotherapy students at three universities in Türkiye, published in Work, found that AI literacy, excitement about AI, trust in AI tools, and believing AI belongs in the curriculum went with more positive attitudes. Higher AI anxiety went with more negative ones, and curiosity went with fewer. Demographics didn't predict either.

Mark's read: It's a cross-sectional survey, so it can't tell us what causes what. Still, for anyone teaching DPT students, the message is that a lecture on how language models work won't touch the fear. My bet is on low-stakes reps where students catch the AI being wrong. That builds the skill and takes some of the mystery out of it at the same time.

Read the study

Academic Corner

11 of 17 AI models failed a nursing safety screen

A team in Italy built an evaluation framework aligned with the EU AI Act and ran 15 large and 2 small language models through 32 clinical nursing prompts, graded blind against answers from a Delphi expert panel. A safety screen knocked out 11 of the 17 right away. DeepSeek-R1, Perplexity Sonar, Mistral Large 2, and Qwen2.5-14B didn't resist even explicit harmful prompts. Only Anthropic's Sonnet models were rated "recommended" across the board. The paper is in JMIR Medical Informatics.

Mark's read: The models tested are already a generation or two old, so skip the leaderboard. (Full disclosure, I use Claude every day.) The useful part is the method: a fixed set of real prompts, expert answers to grade against, and a safety gate a model has to clear before anything else counts. A program director could build a small version of that for the tools students are allowed to use.

Read the study

Try This

Write one procedure before you buy one tool

Pick one task you or your front desk do every week, like the Monday numbers check. Write it out in plain language: what to pull, what counts as a problem, what the finished output looks like, and what the AI is never allowed to do (send, pay, or touch a patient record). Hand it to an AI tool you already use and compare its draft to how you'd do it. The gaps show you what your procedure was missing. Keep patient information out of it unless the tool is covered by a BAA.

What else is happening

The last word

What's one procedure in your clinic that only lives in someone's head? Hit reply and tell me.

Get the next issue.

One email a week. The AI that matters for clinical work, in plain language.