Nos offres
Trouvez l’offre pensée pour vous.
Le meilleur de l’assurance santé, prévoyance et de la prévention, adapté à vos besoins.
Pour nos membres
Retrouvez tous ces services dans votre poche !
Télécharger l'application
Ressources
Notre sélection d'articles
Retrouvez nos articles les plus consultés.
Qu’est-ce qu’une mutuelle d’entreprise ?
La mutuelle est-elle obligatoire ?
Tous nos articles sur l’assurance santé
Me connecter
Discover AlanDiscover Alan
Blog
|
Discover Alan

Is AI ready for patients? Our study with Mo.

Alan has been on a mission to make healthcare more accessible since 2016. We recently reached a new milestone with Mo, our AI-powered medical assistant, deployed within Alan's medical advice chat.

Below are the results of the first large-scale study examining conversational medical AI in real-world conditions.

Is AI ready for patients? Our study with Mo.
Author
Antoine Lizée
Antoine LizéeAI Lead
Updated on
25 November 2024
Author
Antoine Lizée
Antoine LizéeAI Lead
Updated on
25 November 2024
Share this article
In this article

Conversational AI for better healthcare

Everyday, we ask Google more than 1 billion health-related questions. This number highlights a gap: we want to understand and take action for our health, but we lack reliable and accessible guidance. This is the challenge that Mo aims to address.

Mo is an AI-powered medical assistant, designed to support you with Alan's medical expertise every day.

A Groundbreaking Study

Study Framework: Real-World, Large-Scale Conditions

To continuously evaluate and improve Mo, we integrated it into our existing medical chat service, where Alan members regularly communicate with doctors. Over a three-week period, we included more than 1,500 conversations in the study, of which 926 were eligible for interaction with Mo. We offered Mo to half of the eligible patients to compare patient experience with and without Mo.

A Responsible and Secure Approach

Mo's development follows a responsible approach to healthcare innovation. Every message is verified by a doctor within 15 minutes, ensuring Mo’s accuracy and relevance. We implemented essential safeguards: data hosting within the European Union, adherence to the strictest security standards, clear differentiation between AI and doctors in the interface, and explicit patient consent for AI use.

Patient Outcomes: Satisfaction and Engagement

Unexpected Adoption

As AI in healthcare often raises concerns, we wanted to understand how patients would respond to Mo. The results were compelling: in 81% of conversations, patients chose to interact with Mo, even though they had initially come to speak with a doctor. This adoption rate suggests that patients are ready to embrace AI in their healthcare journey - just as they've already integrated the internet into their health practices today.

81% of patients decided to start with Mo even though they came to talk to a doctor.
Talking with Mo is optional. In 81% of conversations, patients decided to start with Mo even though they came to talk to a doctor.

Strong Engagement

We also observed strong engagement in conversations where Mo was present, thanks to its instantaneous responses. Conversations were more dynamic, with patients responding 2 to 3 times faster to Mo than to doctors (57% of responses to Mo came within one minute, versus 27% with doctors).

57% of answers from patients in less than 1 minute with Mo, versus 27% with a doctor.
The patients answered faster to Mo than to GPs. 57% of answers from patients in less than 1 minute with Mo, versus 27% with a doctor.

For example, thanks to instant responses, rather than switching to something else and waiting for a notification, users continue their conversations with Mo without putting down their phones. Our hypothesis? This engagement facilitates information exchange, resulting in better guidance.

High Satisfaction

Patient satisfaction is key to AI adoption. Mo's results in this area are remarkable: conversations assisted by Mo received an average rating of 4.6/5, slightly exceeding the control group conversations. Patients also rated the clarity of information higher. More notably, patients reported equivalent levels of perceived empathy and trust compared to traditional conversations, even while knowing they were interacting with AI.

Patients rated their conversations with Mo with higher levels of satisfaction than without Mo.
Patients were very satisfied with Mo, slightly more than in the control group where Mo was not proposed.

Universal Appeal

Despite substantial volumes, we observed no significant disparities in Mo's acceptance across genders or ages. In other words: Mo appears to be a universal solution. Men, women, young people, seniors: all groups are equally represented.

Safety and medical accuracy

Doctor collaboration was integral to Mo's development. Our Product team included a doctor to ensure Mo's design would serve medical professionals' needs and reliably serve patients.

When we presented Mo to our medical chat team - 18 doctors who had been with Alan for over two years on average - we were pleased to be met with curiosity where we had expected skepticism.

The results validate this collaborative approach: doctors rated 95% of Mo's conversations as "good" or "excellent". No conversation raised patient safety concerns, thanks to their supervision.

95% of patient-Mo discussions were evaluated as "good" or "excellent" by the doctors.
Doctors gave a "good" or "excellent" rating to Mo in 95% of the conversations with patients.

"I find Mo very effective and believe it fully embraces its role as an assistant," confirms one of the general practitioners working on the medical chat.

Looking ahead

The detailed results of this study are available here.

These initial results are encouraging, but they're just a first step. Our vision for Mo goes further: we want to make it a health companion who supports you long-term. An assistant that answers your questions, understands your context, and bridges the gap between you and healthcare professionals.

Artificial intelligence, used ethically and transparently, can transform healthcare for everyone's benefit. With Mo, we're laying the first foundations for a more accessible, preventive, and human healthcare system.

We still have (plenty of) work ahead to provide increasingly accurate and reliable answers to patients. If you're passionate about AI and building better healthcare, apply.

A huge thank you to all of the general practitioners at the Alan Clinic who supported Mo's development with their goodwill and involvement. None of this would be possible without them!

Published on 25/11/2024

On the same topic

Full Range: Product managers at Alan – Thomas Rolf
Full Range: Product managers at Alan – Thomas Rolf
Nov 22, 2024

All categories

Discover Alan

The future of health and well-being

Alan decrypts