Healthcare · 2023
Trust, before transformers
Six hospital systems wanted to pilot LLM tools for clinical documentation. None of them had a shared answer to: how do we know this is safe?
- Client
- Clinical informatics consortium
- Role
- Strategy & Governance Lead
- Duration
- 9 months
- Year
- 2023
01 — The challenge
What we walked
into.
Each system had its own risk appetite, IT stack, and clinical workflow. Vendors were eager. Regulators were watching. Nobody wanted to be first — or last.
02 — Approach
How we got
there.
01
Built a shared evaluation rubric grounded in real clinical tasks, not benchmarks.
02
Designed a tiered governance model so low-risk uses could ship while high-risk ones paused.
03
Ran a cross-system red-team exercise to surface failure modes early.
04
Wrote the playbook so a new hospital could onboard in weeks, not quarters.
03 — Outcome
What shipped.
6
Hospital systems aligned on a shared framework
0
Patient-safety incidents in pilot
11
Vendor tools evaluated against the rubric
"In healthcare, the right pace is the pace that doesn't break trust. Slower than the hype cycle. Faster than the skeptics expect."
Jenny Kan — reflection