Hospital AI Lab Practical information on medical AI for U.S. hospitals

Updated:

Where to start

You do not need to understand how a model works to review a proposal for one. You need to know what it is for, who regulates it, where patient data goes, and what changes for staff. Five steps, in order.

1. Name the task before the technology

Write one sentence: what job will this tool do, for whom, and what happens today without it? A tool that drafts visit summaries, a tool that flags patients for review and a tool that schedules staff raise different questions. Vendors describe what the product can do; you need to describe the job.

2. Ask who regulates it

Some software is regulated by FDA as a medical device, and some clinical decision support software is excluded from the device definition if it meets statutory criteria. FDA’s guidance (January 2026) explains how it reads those criteria. Ask the vendor in writing whether it treats the product as a device or as non-device clinical decision support, and why. FDA’s list of AI-enabled devices is not comprehensive, so do not use it as proof either way.

3. Follow the patient data

Find out whether the tool receives protected health information, where it goes, who else touches it, and how it is deleted. If the vendor handles PHI for you, it is probably a business associate, and a written business associate agreement is required before PHI is disclosed (45 CFR 164.502(e)). Our data checklist walks through the sections.

4. Get the answers in writing

Use the vendor questions in the templates page. Put the answers into the contract or an attachment to it. Pay attention to breach notice: the hospital’s own notice to patients is due within 60 calendar days of discovery, so a vendor that notifies you late can use up your time.

5. Plan for the people who will work with it

Ask who gets more work, who reviews the tool’s output, who responds to its alerts, and how staff are trained. HIPAA requires workforce training on PHI policies and documentation that it took place (45 CFR 164.530(b)). Nursing leaders should be in the review from the start, not after go-live.

See also

  • Glossary — terms you meet in proposals and meetings.
  • Adoption checklist — questions to put to the vendor when you review a specific adoption proposal.