Artificial Intelligence Platform Screens for Acute Neurological Illnesses at Mount Sinai
The study’s findings lay the framework for applying deep learning and computer vision techniques to radiological imaging.
An artificial intelligence platform designed to identify a broad range of acute neurological illnesses, such as stroke, hemorrhage, and hydrocephalus, was shown to identify disease in CT scans in 1.2 seconds, faster than human diagnosis, according to a study conducted at the Icahn School of Medicine at Mount Sinai and published today in the journal Nature Medicine.
“With a total processing and interpretation time of 1.2 seconds, such a triage system can alert physicians to a critical finding that may otherwise remain in a queue for minutes to hours,” says senior author Eric Oermann, MD, Instructor in the Department of Neurosurgery at the Icahn School of Medicine at Mount Sinai. “We’re executing on the vision to develop artificial intelligence in medicine that will solve clinical problems and improve patient care.”
This is the first study to utilize artificial intelligence for detecting a wide range of acute neurologic events and to demonstrate a direct clinical application. Researchers used 37,236 head CT scans to train a deep neural network to identify whether an image contained critical or non-critical findings. The platform was then tested in a blinded, randomized controlled trial in a simulated clinical environment where it triaged head CT scans based on severity. The computer software was tested for how quickly it could recognize and provide notification versus the time it took a radiologist to notice a disease. The average time for the computer algorithm to preprocess an image, run its inference method, and, if necessary, raise an alarm was 150 times shorter than for physicians to read the image.
This study used “weakly supervised learning approaches,” which built on the research team’s expertise in natural language processing and the Mount Sinai Health System’s large clinical datasets. Dr. Oermann says the next phase of this research will entail enhanced computer labeling of CT scans and a shift to “strongly supervised learning approaches” and novel techniques for increasing data efficiency. Researchers estimate the goal of re-engineering the system with these changes will be accomplished within the next two years.
“The expression ‘time is brain’ signifies that rapid response is critical in the treatment of acute neurological illnesses, so any tools that decrease time to diagnosis may lead to improved patient outcomes,” says study co-author Joshua Bederson, MD, Professor and System Chair for the Department of Neurosurgery at Mount Sinai Health System and Clinical Director of the Neurosurgery Simulation Core.
“The application of deep learning and computer vision techniques to radiological imaging is a clear imperative for 21st century medical care,” says study author Burton Drayer, MD, the Charles M. and Marilyn Newman Professor and System Chair of the Department of Radiology for the Mount Sinai Health System, CEO of the Mount Sinai Doctors Faculty Practice, and Dean for Clinical Affairs of the Icahn School of Medicine.
This study was performed by the Mount Sinai AI Consortium, known as “AISINAI”—a group of scientists, physicians, and researchers dedicated to developing artificial intelligence in medicine that will improve patient care and help doctors accurately diagnose disease.
AISINAI’s current research builds on their paper published earlier this year in the journal Radiology, where they presented their work on natural language processing algorithms for identifying clinical concepts in radiology reports for CT scans.
About the Mount Sinai Health System
Mount Sinai Health System is one of the largest academic medical systems in the New York metro area, with more than 43,000 employees working across eight hospitals, over 400 outpatient practices, nearly 300 labs, a school of nursing, and a leading school of medicine and graduate education. Mount Sinai advances health for all people, everywhere, by taking on the most complex health care challenges of our time — discovering and applying new scientific learning and knowledge; developing safer, more effective treatments; educating the next generation of medical leaders and innovators; and supporting local communities by delivering high-quality care to all who need it.
Through the integration of its hospitals, labs, and schools, Mount Sinai offers comprehensive health care solutions from birth through geriatrics, leveraging innovative approaches such as artificial intelligence and informatics while keeping patients’ medical and emotional needs at the center of all treatment. The Health System includes approximately 7,300 primary and specialty care physicians; 13 joint-venture outpatient surgery centers throughout the five boroughs of New York City, Westchester, Long Island, and Florida; and more than 30 affiliated community health centers. We are consistently ranked by U.S. News & World Report's Best Hospitals, receiving high "Honor Roll" status, and are highly ranked: No. 1 in Geriatrics and top 20 in Cardiology/Heart Surgery, Diabetes/Endocrinology, Gastroenterology/GI Surgery, Neurology/Neurosurgery, Orthopedics, Pulmonology/Lung Surgery, Rehabilitation, and Urology. New York Eye and Ear Infirmary of Mount Sinai is ranked No. 12 in Ophthalmology. U.S. News & World Report’s “Best Children’s Hospitals” ranks Mount Sinai Kravis Children's Hospital among the country’s best in 4 out of 10 pediatric specialties. The Icahn School of Medicine at Mount Sinai is one of three medical schools that have earned distinction by multiple indicators: It is consistently ranked in the top 20 by U.S. News & World Report's "Best Medical Schools," aligned with a U.S. News & World Report "Honor Roll" Hospital, and top 20 in the nation for National Institutes of Health funding and top 5 in the nation for numerous basic and clinical research areas. Newsweek’s “The World’s Best Smart Hospitals” ranks The Mount Sinai Hospital as No. 1 in New York and in the top five globally, and Mount Sinai Morningside in the top 20 globally.