Can AI be relied upon for cancer-related inquiries?
Can AI be relied upon for cancer-related inquiries?
AI Chatbots and Cancer Care: The Good, the Bad, and the Hilariously Inaccurate
AI has revolutionized many fields, from finance to transportation, and it’s no surprise it has made its way into the realm of health care. However, a recent study suggests that when it comes to cancer care, AI may not always be the most accurate source of information. Two studies published in JAMA Oncology assessed the quality of responses offered by AI chatbots regarding cancer care, revealing a mix of accuracy and hilarious inaccuracies.
The Upside: Some Accuracy, Some Laughter
The first study focused on the full-sentence conversational AI service called ChatGPT, which gained significant attention since its launch last year. Researchers found that approximately two-thirds of the cancer information provided by ChatGPT aligned with the current guidelines from the U.S. National Comprehensive Cancer Network. However, the remaining one-third contained glaring inaccuracies, some of which were truly mind-boggling.
According to study author Dr. Danielle Bitterman, an assistant professor of radiation oncology, there were instances where ChatGPT recommended curative treatment for an incurable diagnosis. Other times, the AI offered incomplete treatment regimens, omitting essential components like radiotherapy or chemotherapy. This alarming mix of correct and incorrect information made it challenging even for experts to detect errors, highlighting the need for cautious interpretation when relying on AI chatbots for medical advice.
The Downside: Knowledge Beyond Reach
The second study widened the scope, assessing answers from four different AI chatbot services: ChatGPT, Perplexity, Chatsonic, and Microsoft’s Bing. Researchers concluded that the responses provided were of “good” quality and accuracy. However, they also pointed out that most of the information was too complex for the average medical non-professional. In addition, all responses were accompanied by a warning, emphasizing the importance of consulting a physician before making any healthcare decisions based solely on the provided data.
Dr. Abdo Kabarriti, chief of urology at South Brooklyn Health, emphasized that while the information provided by AI chatbots was accurate, it was often presented at a college reading level. This presents a significant hurdle, as the average consumer tends to read at around the sixth-grade level. Consequently, the AI information received was often beyond the comprehension of the intended audience. Furthermore, AI chatbots do not prescribe specific actions based on symptoms, instead directing users to consult a physician. Although this may be a liability concern, it reinforces the fact that AI chats cannot replace the necessary interaction patients need with their healthcare providers.
- Canadian wildfire smoke causes spikes in asthma-related ER visits i...
- Actions for Finding a Lump
- Shelter dogs at risk of tick and mosquito-borne diseases.
AI: A Scalable Privilege
Despite the concerns raised by these studies, Dr. Atul Butte, chief data scientist with the University of California Health System, remains optimistic about the potential of AI in healthcare. He views AI as a “huge net plus” for both patients and the medical community. The information provided by AI chatbots is expected to improve over time, becoming more accurate and accessible.
Some studies have even shown that AI has the potential to offer better advice and more empathy compared to medical professionals. Dr. Butte posits that AI chatbots will play a critical role in the future delivery of medical information and care. This is particularly important for patients who may not have access to the world’s best medical centers. By training AI on data and practices from renowned institutions, the knowledge can be delivered globally to patients and doctors alike through digital tools.
Dr. Butte aptly refers to artificial intelligence as “scalable privilege,” providing the opportunity to extend exceptional medical care to all corners of the world. With advancements in AI technology, the hope is that, in the not-too-distant future, AI chatbots will become more user-friendly, offering accessible and accurate information that empowers patients in their cancer care journey.
Conclusion
While AI chatbots may not currently be the ultimate source of accurate information for cancer care, they hold great promise for the future. As AI technology continues to evolve, the accuracy and accessibility of the information provided by chatbots are expected to improve. However, it is crucial to remember that AI chats should never replace the guidance and expertise of healthcare professionals. The future of AI in cancer care is exciting, but it should always be viewed as a complement to, rather than a substitute for, personalized medical advice.
Sources: – Danielle Bitterman, MD, assistant professor, radiation oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute and Harvard Medical School, Boston – Abdo Kabarriti, MD, chief, urology, South Brooklyn Health, New York City – Atul Butte, MD, PhD, chief data scientist, University of California Health System, and professor and inaugural director, Bakar Computational Health Sciences Institute, UC San Francisco – JAMA Oncology, Aug. 24, 2023
Additional Information: For more information about AI in healthcare, visit the U.S. National Institute of Biomedical Imaging and Bioengineering.
