Studies show ChatGPT provides reliable information on vaccines, STIs
Click Here to Manage Email Alerts
Key takeaways:
- ChatGPT provided accurate information on vaccines and STIs in response to most questions.
- ChatGPT could help improve vaccine uptake and STI awareness, researchers said.
ChatGPT could help reduce vaccine hesitancy and provide accurate information on sexually transmitted infections, according to two new studies.
Although artificial intelligence is not yet being used widely in ID clinical care, experts expect it will eventually support infection prevention and antimicrobial stewardship efforts and facilitate drug development, among other uses.
ChatGPT, a free-to-use AI system, has already shown potential for a wide array of uses in health care, from breast cancer screening, dermatological care and identification of irritable bowel syndrome to summarizing medical abstracts, supporting clinical decision-making and answering common patient questions.
The results of two new studies assessing ChatGPT’s ability to offer accurate information on vaccines and sexual health were presented ahead of the ESCMID Global Congress, the new name of the European Society of Clinical Microbiology and Infectious Diseases’ annual meeting.
“Our findings showed that ChatGPT displayed a remarkable ability to accurately respond to a wide breadth of commonly asked questions, encompassing topics such as misconceptions around mRNA vaccination and the importance of testing for STIs,” Matthew Koh, MD, a senior resident in the division of infectious diseases at the National University Health System in Singapore, said in a press release.
“In the majority of instances, ChatGPT performed at the level of advice provided by professional organizations and guidelines,” he said.
To test whether ChatGPT could provide accurate information on vaccines and vaccine hesitancy, as well as on sexual health, Koh and colleagues performed two experiments using a selection of commonly asked questions about both. Two independent infectious disease fellows compared the AI responses with CDC recommendations and clinical guidance.
To test the system’s responses about vaccines and vaccine hesitancy, infectious disease physicians asked ChatGPT 15 questions that addressed doubts about vaccine efficacy, concerns about adverse effects from vaccines and cultural concerns about vaccines. These included information on the HPV vaccine, messenger RNA vaccines, and people with egg allergy-related concerns about influenza vaccination.
“Overall, ChatGPT’s responses to vaccine hesitancy were accurate and may help individuals who have vaccine-related misconceptions,” Koh said.
To test the system’s responses about STIs, the researchers identified 17 common questions covering general risk factors, access to care and diagnosis, and management and post-exposure prophylaxis. These included questions on STI risks for virgins, safe sex practices, HIV, partner testing and follow-up testing and chlamydia treatment.
Although the researchers noted that ChatGPT failed to consider HIV PrEP and did not recommend testing for other STIs when patients seek chlamydia treatment, they said the system may be able to provide helpful advice for STI education and could improve knowledge and access to care.
In both cases, Koh said the results suggest the potential power of AI systems to assist in public health campaigns, and although information from ChatGPT should still be used in conjunction with a physician consult, the easy availability of accurate information may also drive more people to seek preventive health care or treatment.
“The goal of this project is to empower the general public,” Koh said. “The hope is that individuals can educate themselves on ChatGPT by making accurate advice more accessible and increase vaccine uptake and protection from STIs.”
References:
- Koh MCY, et al. Presentation P3922. Presented at: ESCMID Global Congress; April 27-30, 2024; Barcelona.
- Koh MCY, et al. Presentation P3923. Presented at: ESCMID Global Congress; April 27-30, 2024; Barcelona.
Collapse
Press Release
Read more about
Click Here to Manage Email Alerts