'Less than one percent' of diagnostic AI studies based on high-quality data

Less than one percent of available studies on the effectiveness of artificial intelligence (AI) in detecting diseases is supported by high-quality data, according to new research. A comprehensive review of scientific literature led by University of Birmingham and University Hospitals Birmingham NHS Foundation Trust found that only a handful could be considered robust enough to back up their claims. It suggested that many studies were biased in favour of machine-learning and tended to over-hype the ability of computer algorithms when comparing them to those of human healthcare professionals. It consequently found that AI was able to detect diseases from medical images with a similar level of accuracy as healthcare professionals – contrary to several studies that have suggested AI can greatly outstrip human diagnosis. The study concluded that, while machine learning held promise to aid clinical diagnosis, its true potential remained uncertain, and called for higher standards of research and reporting to improve future evaluations.