LLMs and VLMs for healthcare

Highlights from our year of investigations into clinical potentials and risks of LLMs and VLMs

November 11, 2024

Written byBittermanLab


Link to full post on Huggingface


Healthcare AI is evolving fast, and so are the lessons we’re learning along the way! As researchers, 2024 has been a busy year exploring how large language models (LLMs) and vision-language models (VLMs) interact with healthcare data, from handling synonymous drug names to managing demographic biases and multilingual performance. Some of what we found was surprising—like how a simple switch from a brand to a generic name could throw a model off track. In this blog post, we’ll take you through the highlights of our journey, sharing what these findings mean for making healthcare AI more reliable, fair, and helpful.

llmeval