Speech Analysis Software Predicted Psychosis in At-Risk Patients with up to 83 Percent Accuracy, Mount Sinai Researchers Find
Big-data approach has potential to improve prediction of psychiatric and other medical disorders
Computer-based analyses of speech transcripts obtained from interviews with at-risk youths were able to predict which youths would later develop psychosis within two years, with an accuracy of up to 83 percent. In two independent cohorts of young people at risk for psychosis, a disturbance in the flow of meaning when speaking, otherwise known as being tangential or going off track, predicted who would later develop psychosis.
This same computer-based language classifier was able to predict psychosis onset in a second at-risk cohort with 79 percent accuracy, and could discriminate speech from individuals with psychosis from healthy individuals with an accuracy of 72 percent.
Taken together, the results from this study suggest that this technology has the potential to improve prediction of psychosis and other disorders.
The results of the study will be published online in World Psychiatry on January 22 at 10am EST.
Disorganized thinking, a symptom of psychosis, is regularly assessed using interview-based clinical ratings of speech. It is characterized by tangential language, looseness of associations, and reduced complexity of speech. While it can be severe enough to impair effective communication, language disturbance is more typically a subtle but persistent feature that can be present prior to the onset of psychosis in young people at risk.
This study examined transcripts from interviews with at-risk young people in two different cohorts—one in New York City with 34 participants and one in Los Angeles with 59 participants—for whom psychosis onset within the next two years was known. The transcripts were analyzed by computer using automated natural language processing methods to determine differences in speech between those who developed psychosis and those who did not.
"The results of this study are exciting because this technology has the potential to improve prediction of psychosis and ultimately help us prevent psychosis by helping researchers develop remediation and training strategies that target the cognitive deficits that may underlie language disturbance," said the study’s first author, Cheryl Corcoran, MD, Associate Professor of Psychiatry, Program Leader in Psychosis Risk, Icahn School of Medicine at Mount Sinai.
"More broadly, language and behavior are the primary sources of data for psychiatrists to diagnose and treat mental disorders," said Dr. Corcoran. "There are now novel computerized methods to characterize complex behaviors such as language. Speech is easy to collect and inexpensive to analyze using computer-based analysis. This technology could be applied across psychiatry, and plausibly in other fields of medicine."
Other institutions involved in the study include the IBM T.J. Watson Research Center; the University of Buenos Aires, Argentina; the University of California, Los Angeles; and the New York State Psychiatric Institute at Columbia University Medical Center.
This research was supported by grants from the U.S. National Institute of Mental Health (R01 MH 107558; R03 MH 108933, the New York State Office of Mental Health, and a NARSAD/BBRF Young Investigator Award and Miller Family Term Chair to C.E. Bearden.
About the Mount Sinai Health System
Mount Sinai Health System is one of the nation’s leading integrated academic health systems and one of the largest in the New York metropolitan area. Its comprehensive system includes seven hospitals, more than 400 outpatient practices, over 600 research and clinical laboratories, the Icahn School of Medicine at Mount Sinai, the Graduate School of Biomedical Sciences, and the Mount Sinai Phillips School of Nursing. Together, the Health System comprises approximately 48,000 employees, more than 9,000 physicians, and 8,600 nurses.
As a leading learning health system, Mount Sinai combines clinical expertise with scientific discovery to improve patient care while training the next generation of health care and biomedical leaders. The Health System provides care across every stage of life, from prenatal care through geriatrics, while advancing personalized medicine through artificial intelligence, data science, and biomedical research.
Mount Sinai is consistently recognized among the nation’s leading academic health systems for patient care, research, and education. The Mount Sinai Hospital is ranked No. 1 in New York by Newsweek and No. 5 on the magazine’s World’s Best Hospitals list. The Icahn School of Medicine at Mount Sinai ranks No. 11 among U.S. medical schools and No. 1 among freestanding medical schools for National Institutes of Health funding, reflecting the strength of its scientific enterprise and leadership in biomedical research.