Updated:
Hospital chatbots and AI-written text: what Article 50 asks
Does a patient know they are chatting with an AI? Article 50 of the EU AI Act sets disclosure rules for chatbots and AI-written content. What it says.
A hospital’s website now has a chat window that answers questions about appointments. A patient types, “Is this a real person?” The EU AI Act has a short article on exactly this: Article 50, “Transparency obligations for providers and deployers of certain AI systems”. This post reads the official English text of Regulation (EU) 2024/1689 as published in the Official Journal in July 2024. We have not read later EU amendments or any Irish implementing law, so check the current text before you rely on it. This is general information, not legal advice.
The chatbot rule, and who it is aimed at
Article 50(1) puts the duty on providers, the companies that build and place the system on the market. They must design AI systems intended to interact directly with people so that the people concerned are informed they are interacting with an AI system. The exception is where this is obvious to a reasonably well-informed, observant and circumspect person, given the circumstances and context of use. Article 50(5) adds that the information must be given in a clear and distinguishable way at the latest at the time of the first interaction, and must meet applicable accessibility requirements.
A hospital that buys a chatbot is usually the deployer, not the provider. The article’s duty in this paragraph sits with the provider, so the practical step for the hospital is to ask the vendor how the product does this, and to check what a patient actually sees on screen.
AI-generated content
Article 50(2) asks providers of AI systems that generate synthetic audio, image, video or text to make sure outputs are marked in a machine-readable format and detectable as artificially generated or manipulated, as far as technically feasible. The duty does not apply to the extent the system performs an assistive function for standard editing or does not substantially alter the input data provided by the deployer or its meaning.
Article 50(4) has a rule for deployers. Those using an AI system that generates or manipulates text published to inform the public on matters of public interest must disclose that the text was artificially generated or manipulated. This does not apply where the content has undergone human review or editorial control and a person holds editorial responsibility for publication. A hospital newsletter or public health notice written with AI could fall in this area, so it is worth deciding who holds editorial responsibility before you publish.
What the article does not settle
- Article 50(6) says these paragraphs do not affect the requirements in Chapter III and are without prejudice to other transparency duties in Union or national law. Other rules, for example on personal data, may also apply to a chatbot that handles patient details.
- We have not read any guidance on how Article 50 applies in a hospital. The questions below are our suggestions, not requirements.
Questions to ask before the chat window goes live
- Does the first message say, in plain words, that the patient is talking to an AI?
- Can the patient reach a person, and is that route easy to find?
- If staff use AI to draft public notices, who reviews them and who is the named editor?
- What does the vendor say about marking AI-generated output, and in what form?
Key takeaways
- Article 50(1): providers must design chatbots so people are told they are interacting with an AI, unless it is obvious; the information comes at the latest at the first interaction (Article 50(5)).
- Article 50(2) and (4) cover marking AI-generated content and disclosing AI-written public-interest text, with an exception for human editorial control.
- A hospital that buys a tool should ask the vendor how it meets Article 50 and check what patients see. This is general information, not legal advice.
Source: Regulation (EU) 2024/1689 (Artificial Intelligence Act), Official Journal, 12 July 2024, Article 50 (text read from the EU Publications Office). Read on 16 November 2026.
This site’s content is for general information, research, and education. It does not replace medical diagnosis or advice for any specific patient, and it is not legal advice.