Email
Password
Remember meForgot password?
    Log in with Twitter

article imageStartup at odds with doctors over claim about AI diagnoses

By Lisa Cumming     Jun 28, 2018 in Technology
Babylon Health announced Wednesday that the company's AI had undergone a series of tests and had "demonstrated its ability to provide health advice which is on-par with practicing clinicians." Doctors are disputing this claim.
The UK-based healthcare startup's announcement that their AI had achieved medical test scores on par with human doctors, including on relevant sections of the MRCGP, was met with concern from doctors over the research behind the study.
According to a press release from Babylon Health, the average pass mark for the MRCGP over the past five years was 72 per cent. On the first try, Babylon’s AI scored 81 per cent.
Babylon Health's research paper on artificial intelligence and human doctors for triage and diagnosis goes as far to claim "the triage advice recommended by the AI System was, on average, safer than that of human doctors, when compared to the ranges of acceptable triage provided by independent expert judges, with only a minimal reduction in appropriateness."
The research paper is not peer reviewed and has drawn a significant amount of criticism from those in the healthcare industry.
To further test the AI's diagnostic abilities, according to the company, it was tested alongside seven primary care doctors using 100 medical vignettes. On this Babylon’s AI scored 80 per cent for accuracy. When tested against conditions seen frequently in primary care, according to the company, the AI had 98 per cent accuracy.
Healthcare professionals are questioning the methodology of Babylon's research and how accurate the AI is at actually diagnosing.
Going forward, Bablyon Health founder and CEO Dr. Ali Parsa said that their mission it to use the AI to relieve the shortage of doctors worldwide.
"Even in the richest nations, primary care is becoming increasingly unaffordable and inconvenient, often with waiting times that make it not readily accessible," he said in the release. "Babylon’s latest artificial intelligence capabilities show that it is possible for anyone, irrespective of their geography, wealth or circumstances, to have free access to health advice that is on-par with top-rated practicing clinicians."
Time will tell if they get there.
More about Babylon, Health, Babylon Health, Artificial, Startup
 
Latest News
Top News