Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Physician in the Loop

Physician in the Loop artwork

Special Topic: Not the doctor's to sign

Nov 19, 20267 minAudio
ShareXLinkedInFacebookWhatsAppEmail

Free AI tools for doctors come with a HIPAA contract one doctor can accept alone. A hospital's records need the hospital's signature, and the companies should make the safe path the default. Read the special topic and its sources: https://physicianintheloop.org/specials/patient-data-in-ai-tools/ The voice on this episode is generated by AI. It reads a special topic from Physician in the Loop as written; every fact in it links to its source.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Transcript

From the show.

This is a Physician in the Loop special topic.

Not the doctor's to sign

Free AI tools for doctors come with a HIPAA contract one doctor can accept alone. A hospital's records need the hospital's signature, and the companies should make the safe path the default.

Monument Health decided to block OpenEvidence, STAT reported on Nov. 5. The popular tool answers clinicians' medical questions. By STAT's account, the decision drew a few objections at the health system, which is based in South Dakota and Wyoming. One came from a doctor who had been storing more than a hundred patient records in OpenEvidence. Patrick Woodard, Monument's chief information officer, told that doctor it would have to end, the report says.

The tool all but invites those records. OpenEvidence announced in April 2025 that it was “fully HIPAA compliant.” Covered entities, the law's term for the doctors, clinics and others it binds, could now enter patients' protected health information under the company's business associate agreement, or BAA. That is the written contract the federal privacy law requires with a company a provider engages to handle its records. It is where the trouble starts. Patient details should go only into AI tools covered by an agreement the clinician's own organization has signed. And the companies that give these tools away should make the safe path the default, rather than leave it to a doctor between patients.

Under OpenEvidence's terms, a covered entity that chooses to send patient information agrees, by sending it, to have it handled under the company's agreement. Its rivals offer much the same. Doximity's agreement takes effect on the day a provider registers as a member. OpenAI made ChatGPT for Clinicians free to verified physicians in April, with what it calls “optional support for HIPAA compliance” through an agreement for eligible accounts. OpenEvidence's own profile, printed in a Mount Sinai release, says it alone is trusted by hundreds of thousands of verified clinicians.

That agreement can mean less than it seems. HIPAA lets a covered entity give records to a contractor once it has written assurances that the contractor will safeguard them. The covered entity must get them. The federal health department's examples of such contractors include a vendor's chatbot on a provider's patient portal. A doctor who runs her own practice and bills insurers electronically is a covered entity, and for her that agreement may be enough. A doctor on a hospital's payroll is handling the hospital's records. A MaineHealth notice about the tool says that “such individual BAAs do not cover the sharing of MaineHealth data with external parties.” Federal guidance on cloud companies is blunter. A covered entity that stores patients' electronic records with one, without an agreement, “is in violation of the HIPAA Rules.”

When records go somewhere a hospital never approved, its patients carry the risk. In September a worker at Johns Hopkins Bayview Medical Center uploaded a spreadsheet of patient information to a public AI tool the hospital had not approved. It may have held names, medical record numbers and the medications patients were given, among other details. The worker deleted the chat. Hopkins asked the company that runs the tool to delete the data. Hopkins did not answer questions from Straight Arrow News about which company was involved or whether the deletion had been confirmed. About 3,200 patients have been sent letters and offered a year of free credit monitoring, for a spreadsheet somebody else uploaded.

OpenEvidence knows where the danger lies. Its own fine print says so. The terms recommend that users remove “any information that identifies an individual” before they submit anything, from names and insurance numbers to photographs of tattoos or scars. “You shall be solely responsible for any claims arising from your failure to de-identify,” they tell the doctor. And anyone who does enter a patient's details confirms having all necessary consents and authorizations from the patient, “your employer, or other relevant parties.” The safe path is already written down. Following it has been left to a physician with a full clinic.

Doctors who rely on these tools will say a block does more harm than any contract could. The tools help with real decisions. A block does not stop the questions. Wolters Kluwer Health, which sells clinical decision support of its own, paid for a survey of 518 hospital and health system staff. In its results, nearly one in five said they had used an unauthorized AI tool, often because it was faster. Block the tool, on this view, and the questions move to personal phones. They have a point. A ban with nothing behind it fails doctors. But that is a reason to buy the tool properly, not to settle for the click. Northwestern Medicine has signed an agreement with OpenEvidence. MaineHealth has tried, and “thus far has not come to acceptable terms with them.” And many questions need no patient's name at all, as OpenAI's own launch post points out.

Health systems should move first. Each one whose doctors use a free tool can sign with its maker or name an approved alternative, then tell clinicians in one plain sentence what may go in the box. MaineHealth already puts its warning on a page that users acknowledge by proceeding to OpenEvidence. Medical staffs should ask for the same. The companies have the easier fix. An account not tied to an agreement signed by the clinician's organization should catch names, record numbers and insurance numbers before a question leaves the screen, strip them out and say why. A company that already tells doctors to remove identifiers could do it for them, rather than leave it to a tired person at the end of a shift.

The doctor at Monument was told to stop after objecting to the block. The patients at Hopkins learned what had happened from a letter. In both places, someone noticed after the records had gone in. A box that takes patients' details should ask whose agreement covers them before it accepts the first name.

This special topic was read by an AI voice. Its sources are linked at physicianintheloop.org.

Open the transcript file

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Special Topic: What changes on Jan. 1

    Nov 20, 20267 minAudio

    Laws in at least eight states that touch AI in health care take effect on Jan. 1. Most bind insurers and chatbot companies. A few, in California and Colorado, reach the practice itself. Read the special topic and its...

    Credit the people on this episode

  2. Friday Letter: On a short leash

    Nov 20, 20267 minAudio

    Software has begun to act for doctors, not just advise them. It should be kept on a short leash, because the doctor watching it rarely notices when it slips. Read the letter and its sources:...

    Credit the people on this episode

  3. Daily Briefing for November 20, 2026

    Nov 20, 20266 minAudio

    Hospitals race to patch a Java flaw found with AI in an hour The voices on this episode are generated, and so is the script, from the day's post at Physician in the Loop. Every fact in the post links to its source. Read...

    Credit the people on this episode

  4. Daily Briefing for November 19, 2026

    Nov 19, 20267 minAudio

    AI hacking agents seize some networks in under 3 hours, FBI warns The voices on this episode are generated, and so is the script, from the day's post at Physician in the Loop. Every fact in the post links to its source....

    Credit the people on this episode

  5. Special Topic: No longer eliminated

    Nov 18, 20267 minAudio

    The United States, Mexico and Bolivia have lost their measles elimination status, the Pan American Health Organization says. The head of the federal disease agency has said its response would not fundamentally change....

    Credit the people on this episode