Skip to main content

Welcome to a Grasp lesson

Create a free account to keep studying and create your own study path.

Lesson 7

AI in Healthcare: Developer vs. User Roles

Recommended resources

Hello! Welcome to your seventh and final lesson in the "AI Fundamentals for Clinicians" module.

In our last lesson, we explored the fascinating process of how an AI model learns from expert-labeled examples by adjusting itself to reduce errors. We saw the "behind the scenes" of the training process. Now, we'll zoom out to understand the people involved.

This lesson addresses the learning outcome: Distinguish between the roles of the AI developer and the clinical AI user. This distinction is fundamental to your journey. As a future dentist, your primary role will be that of a skilled clinical AI user. Understanding the boundaries and responsibilities of both roles is critical for using these powerful tools safely, ethically, and effectively in your practice.

Let's get started.

1. Two Sides of the Same Coin: The Architect and the Pilot

Think of a sophisticated aircraft. There are two key roles: the aeronautical engineers who design and build the plane, and the pilot who flies it. Both are experts, but their responsibilities are distinct.

  • The Architect (The AI Developer): This is the team of engineers and computer scientists who design, build, test, and validate the AI model. They are concerned with data, algorithms, code, and the underlying performance of the system.
  • The Pilot (The Clinical AI User): This is you—the dentist. You take the finished, certified "aircraft" (the AI software) and use your clinical expertise to apply it in real-world patient care. Your focus is on interpretation, clinical judgment, and patient outcomes.

This image provides a simple visual metaphor for this relationship. The robot with the technical components represents the development process, while the person at the laptop represents the user interacting with the finished product.

Human-AI Interaction and Development
This image visually distinguishes the user interacting with an AI application from the complex inner workings and development process of the AI itself.

2. The Role of the AI Developer: Building the Tool

The AI developer is responsible for everything that happens before the software reaches your clinic. Their work is foundational.

A key responsibility for developers is ensuring the data used to train the AI is fair and representative. Biased data leads to biased AI, which can be dangerous in a clinical setting.

Artificial intelligence in healthcare: opportunities and challenges | Navid Toosi Saidy | TEDxQUT

In this TEDx talk, Navid Toosi Saidy discusses the immense promise of AI in healthcare but also highlights some of the core challenges. This first clip focuses on a major responsibility of the developer.

Watch the segment from 05:59 to 07:34. Pay close attention to the speaker's point about the developer's 'huge responsibility' to make sure training data is diverse and that the model can express uncertainty when it encounters data it wasn't well-trained on.

Based on this and other industry standards, the developer's key responsibilities include:

  • Designing and Building: Creating the AI model's architecture and writing the code.
  • Data Curation: Collecting, cleaning, and labeling the vast datasets needed for training (like the thousands of radiographs we discussed in the last lesson).
  • Bias Mitigation: Ensuring the training data is representative of diverse populations to promote fairness and equity.
  • Training and Validation: Running the training process and rigorously testing the model to ensure it is accurate and safe.
  • Documentation: Creating clear "Instructions for Use" that explain what the AI does, its limitations, and what kind of input data it needs to function correctly.
  • Enabling Oversight: Designing the user interface so that a clinician can easily review, interpret, and, if necessary, override the AI's suggestions.

3. The Role of the Clinical AI User: Applying the Tool

Once the AI tool is developed, validated, and approved by regulatory bodies (like the FDA), it can be deployed in a clinic. This is where your role as the clinical AI user begins. You are not expected to be a programmer, but you are expected to be an expert user.

The following resource provides a detailed look at the ethical responsibilities that fall on the dentist when using AI.

Ethical Use of Artificial Intelligence in Dentistry

The paper 'Ethical Use of Artificial Intelligence in Dentistry' is a crucial read. It directly addresses the responsibilities of the dentist as the primary user of AI technology.

First, read section '2.1.3 Education and skills needed...'. This section outlines the skills you, as a user, need. Then, read section '2.2.2 Accountability'. This is a key section that clearly distinguishes the accountability of the developer from that of the dentist (the user).

As the paper highlights, your responsibilities as a clinical AI user are centered on safe and effective application:

  • AI Literacy: Possessing the knowledge to use the tool correctly, understand its outputs, and be aware of its limitations. This course is designed to build that literacy.
  • Critical Judgement: Never accepting an AI's output blindly. Your clinical expertise is paramount. You must critically evaluate the AI's findings in the context of the whole patient and be prepared to override the AI's suggestion. This is often called "human-in-the-loop" oversight.
  • Ensuring Proper Use: Verifying that the input data (e.g., the quality of the radiograph) is appropriate for the system. Garbage in, garbage out.
  • Accountability for Clinical Decisions: While a developer might be liable for a faulty algorithm, the clinician is ultimately responsible for the final diagnosis and treatment plan delivered to the patient. You are accountable for how you use the tool in your decision-making process.
  • Patient Communication: Ethically, you must be able to discuss the role of AI in your patient's care, especially regarding informed consent.

The following reading from an article about the EU's AI Act provides a very structured overview of the responsibilities of the "deployer" (the user).

The AI Act: responsibilities and obligations for healthcare ...

While focused on European regulations, the article 'The AI Act: responsibilities and obligations...' clearly breaks down the practical duties of a user of a high-risk AI system, which includes most medical AI.

Read the sections titled 'Ensuring artificial intelligence literacy among healthcare staff' and 'Establishing human oversight and monitoring'. Notice how these official obligations align perfectly with the ethical responsibilities we've discussed.


4. A Symbiotic Relationship

The developer and the user are not in isolated silos. The best AI tools are born from collaboration.

How AI can heal healthcare | Edmund Jackson | TEDxNashville

In this final clip, Edmund Jackson describes how teams of clinicians and engineers worked together to build a life-saving AI. This is a perfect example of the developer-user collaboration.

Watch the segment from 08:34 to 10:08. Notice how he says HCA brought together 'teams of clinicians and engineers' to wrap the complexity of sepsis in an algorithm. This teamwork is essential.

Clinicians provide the essential subject matter expertise that guides developers. They label the data, define the clinical problem, and give feedback on whether a tool is actually useful in practice. In turn, developers provide clinicians with tools that can augment their skills, improve efficiency, and ultimately enhance patient care.

Here is a summary table to help you consolidate these two distinct but complementary roles:

Aspect The AI Developer (The Architect) The Clinical AI User (The Pilot)
Primary Goal Build a safe, accurate, and reliable AI tool. Apply the tool to improve patient diagnosis and treatment.
Core Activities Data collection, algorithm design, coding, training, validation. Clinical examination, data input, interpreting AI output, diagnosis.
Key Skillset Computer science, statistics, machine learning engineering. Clinical expertise (dentistry), critical thinking, AI literacy.
Main Responsibility The integrity and performance of the AI model itself. The final clinical decision and patient outcome.
Source of Liability Flaws in the AI's design, biased data, manufacturing defects. Misuse of the tool, failure to evaluate AI output, clinical error.
Test your understanding!

A startup company, "ToothAI," develops a new AI software that analyzes intraoral photographs to screen for signs of oral cancer. The software is approved and purchased by your dental clinic.

Based on the roles we've discussed, identify one primary responsibility of the ToothAI developers and one primary responsibility of you, the dentist using the software.

Show answer
  • Responsibility of the ToothAI Developer: A key responsibility would be to ensure the AI was trained on a diverse dataset of intraoral images from people of various ethnicities, ages, and genders. If they only trained it on images from one demographic, the AI might fail to detect lesions in other patient groups, making it dangerously biased.

  • Responsibility of the Dentist (Clinical User): Your primary responsibility is to use the software as a screening aid, not a definitive diagnosis. If the AI flags a suspicious area, you must perform a thorough clinical examination, possibly a biopsy, and use your professional judgment to make the final diagnosis. You cannot simply trust the AI's output without verification. If the AI says "no lesion found," you must still trust your own clinical senses if you see something concerning.


Conclusion

Congratulations on completing the first module of this course! You have built a solid conceptual foundation of what AI is, what it does, and how it learns.

Key Takeaways from this Lesson:

  • AI Developers are the architects: They build and validate the AI, focusing on data, algorithms, and technical performance. Their main responsibility is the integrity of the tool itself.
  • Clinical AI Users are the pilots: They apply the finished tool in practice, focusing on interpretation, clinical context, and patient safety. Their main responsibility is the final clinical decision.
  • These roles are distinct but interdependent. Effective and ethical AI in dentistry requires close collaboration between the people who build the tools and the people who use them.
  • This course is focused on preparing you for the role of an expert clinical AI user.

In our next module, "Training AI for Dental Vision," we will build on this foundation and begin to explore the specifics of how AI is applied to dental imaging. Our very first lesson will tackle a fundamental question: How are digital dental images, like radiographs and CBCT scans, represented as data that an AI can 'see' and process?