Mount Sinai Researchers Assess Accuracy of Commercially Available Lab Tests
Scientists from the Icahn School of Medicine at Mount Sinai performed an in-depth comparison of basic blood tests run by commercial laboratories to assess comparability of the tests among the different laboratories, finding that testing service and time of collection significantly influenced results. Given that lab tests are used to help decide everything from disease diagnosis to whether a patient needs medicine or whether that medication is working, this study highlights the importance of knowing the accuracy and variability of test results.
The IRB-approved research study, which was first designed in early 2015 with data collected last July, analyzed results from comparable blood tests on healthy adults conducted at LabCorp, Quest Diagnostics, and Theranos. Researchers collected multiple samples from the same individuals and controlled for variables such as age, sex, and time of blood collection, among many others, but still found that more than half of test results showed significant differences between test providers. Triglyceride levels and red blood cell counts were among the most consistent results, while white blood cell counts and overall cholesterol levels were among the most variable. Test results from Theranos were flagged by Theranos as abnormal 1.6 times more often than those from LabCorp or Quest. Data from blood samples collected earlier in the day also showed significant differences compared to samples from the same subjects later in the day. The study was published today in the Journal of Clinical Investigation.
“While most of the variability we found was within clinically accepted ranges, there were several cases where inaccurate results would have led to incorrect medical decisions,” said Joel Dudley, senior author on the paper and Director of Biomedical Informatics at the Icahn School of Medicine at Mount Sinai. “We hope this study will inspire the biomedical community to take a critical look at all testing variables to ensure that lab results are as robust and reproducible as possible.”
The study focused on common blood tests, which typically return a single data point or a few data points. However, as Mount Sinai scientists showed, even standard blood tests can generate rich data for statistical analysis: this study collected 14 samples to generate 22 lab results for each of 60 subjects, leading to a total of more than 18,000 data points in this project alone. While most results were within normal ranges, having even a small amount of inaccurate data mixed in could lead to erroneous conclusions from scientific or clinical studies.
“These testing disparities occurred despite rigorous laboratory certification and proficiency standards designed to ensure consistency,” said co-senior author Eric Schadt, PhD, the Jean C. and James W. Crystal Professor of Genomics at the Icahn School of Medicine at Mount Sinai, and Founding Director of the Icahn Institute for Genomics and Multiscale Biology. “Our results suggest the need for greater transparency in lab technologies and procedures, as well as a much more thorough investigation of biological mechanisms that may contribute to more dynamic levels than we currently understand.”
Brian A. Kidd et al. Evaluation of Direct-to-Consumer Low-Volume Lab Tests in Healthy Adults. The Journal of Clinical Investigation. DOI: 10.1172/JCI86318
Disclosure: J.T. Dudley owns equity in NuMedii Inc. and has received consulting fees or honoraria from Janssen Pharmaceuticals, GlaxoSmithKline, AstraZeneca, and Lam Therapeutics. If you have questions regarding industry relationships, we encourage you to visit our website at http://icahn.mssm.edu/ where Mount Sinai publicly discloses the industry relationships of our faculty.
About the Mount Sinai Health System
The Mount Sinai Health System is New York City's largest academic medical system, encompassing eight hospitals, a leading medical school, and a vast network of ambulatory practices throughout the greater New York region. Mount Sinai advances medicine and health through unrivaled education and translational research and discovery to deliver care that is the safest, highest-quality, most accessible and equitable, and the best value of any health system in the nation. The Health System includes approximately 7,300 primary and specialty care physicians; 13 joint-venture ambulatory surgery centers; more than 415 ambulatory practices throughout the five boroughs of New York City, Westchester, Long Island, and Florida; and more than 30 affiliated community health centers. The Mount Sinai Hospital is ranked on U.S. News & World Report's "Honor Roll" of the top 20 U.S. hospitals and is top in the nation by specialty: No. 1 in Geriatrics and top 20 in Cardiology/Heart Surgery, Diabetes/Endocrinology, Gastroenterology/GI Surgery, Neurology/Neurosurgery, Orthopedics, Pulmonology/Lung Surgery, Rehabilitation, and Urology. New York Eye and Ear Infirmary of Mount Sinai is ranked No. 12 in Ophthalmology. Mount Sinai Kravis Children's Hospital is ranked in U.S. News & World Report’s “Best Children’s Hospitals” among the country’s best in four out of 10 pediatric specialties. The Icahn School of Medicine is one of three medical schools that have earned distinction by multiple indicators: ranked in the top 20 by U.S. News & World Report's "Best Medical Schools," aligned with a U.S. News & World Report "Honor Roll" Hospital, and No. 14 in the nation for National Institutes of Health funding. Newsweek’s “The World’s Best Smart Hospitals” ranks The Mount Sinai Hospital as No. 1 in New York and in the top five globally, and Mount Sinai Morningside in the top 20 globally.