The Healthcare Vision of ChatGPT-4o and Multimodal LLMs – The Medical Futurist Newsletter

Text, image, voice, video OpenAI released ChatGPT-4o, an omnimodel that can deal with multiple modalities from [sound to video and image](. This is exactly the multimodal large language model revolution we have been preaching about for months. M-LLMs will represent the ultimate interface between medical professionals and a range of AI-based technologies. But we won't get there without prompt engineering. While the future is a singular term in almost every language, in reality, we have multiple futures ahead of us and without seeing and creating the detailed desired vision we would like to choose, it's hard to find out what we have to do today to achieve that. This is how, I hope, the visions we share with you help get towards an optimistic future in medicine and healthcare. I hope you will find the newsletter useful! Best regards, Berci Bertalan Meskó, PhD The Medical Futurist [THE HEALTHCARE VISION OF CHATGPT-4O AND MULTIMODAL LLMS]( --------------------------------------------------------------- New, multimodal large language models can deliver handsomely in medicine. The use cases can be listed all day long. Examples include real-time updates from trusted medical sources, more accurate and interactive symptom checkers, supporting multiple languages to provide medical information. Such an AI chatbot could be trained on a larger and more diverse set of medical literature, could securely interface with Electronic Health Records and could be used to identify and mitigate biases. [READ MORE]( WHY DO I THINK IT'S IMPORTANT? Of course we are not quite there yet, but the progress is significant, and extremely important. [TEST-AT-HOME KIT FOR CANCER PATIENTS APPROVED FOR USE]( --------------------------------------------------------------- This device that can measure both haemoglobin levels and total white blood cell count got regulatory approval in the NHS in the United Kingdom. "The machine took all that [physical and mental exhaustion of frequent hospital visits] away, it's a simple finger prick that doesn't hurt. It's a small amount of blood and then it's hidden away - there's no stress or anxiety." [READ MORE]( WHY DO I THINK IT'S IMPORTANT? The less time a cancer patient needs to spend waiting at a hospital, the better they can recover in peace at home. [INTRODUCTION TO ARTIFICIAL INTELLIGENCE IN MEDICINE AND HEALTHCARE]( --------------------------------------------------------------- AI is getting more and more prominent in our everyday and professional lives, and we all will need to learn to deal with it. We designed this course to cover all bases, from the basic terms and concepts to introducing the use cases, discussing social and ethical implications and facing the greatest challenges. You will get up to speed in no time. [ENROLL HERE]( [WHY DO SCIENTISTS WORK FOR FREE?]( --------------------------------------------------------------- What a weird phenomenon! The peer-review process, a cornerstone of scientific publishing, necessitates the contribution of significant expertise and time from other scientists on a voluntary basis (for free). This ensures the quality and integrity of research before publication. And while the financial burden of publication often falls on the authors, access to the published work can be further restricted by paywalls. The dissemination of knowledge rests heavily on the pro bono efforts of researchers. [WATCH THE VIDEO]( WHY IT'S IMPORTANT? If all of a sudden all scientists stopped working for free, the world of research would collapse. [9 TECHNOLOGIES THAT WILL SHAPE THE FUTURE OF DENTISTRY]( --------------------------------------------------------------- Disruptive innovations will have a huge impact on how dentistry will be practiced and how patients will take care of themselves in the future. Can you imagine that you might get your 3D-printed prosthesis in an hour instead of 4-5 sessions at the dentist? How about having a teledentist consultation? Or being able to grow new teeth at the age of 80? [READ MORE]( WHY IT'S IMPORTANT? These technologies will result in better and more personalized care, faster solutions, often at lower costs than today. [HOW SUCCESSFUL ARE AI-DISCOVERED DRUGS IN CLINICAL TRIALS? A FIRST ANALYSIS AND EMERGING LESSONS]( --------------------------------------------------------------- Here is an excellent confirmation that AI-generated drugs can indeed perform well in clinical trials. "In Phase I we find AI-discovered molecules have an 80–90% success rate, substantially higher than historic industry averages. In Phase II the success rate is ∼40%, albeit on a limited sample size, comparable to historic industry averages." [READ MORE]( WHY DO I THINK IT'S IMPORTANT? Using AI for this purpose seems inevitable and based on studies like this, not using them would be a missed opportunity. [INTRODUCTION TO MED-GEMINI MODELS FINE-TUNED FOR MULTIMODAL MEDICAL DOMAIN]( --------------------------------------------------------------- It's so inspiring to see that whenever a tech company comes up with an upgrade in generative AI, they soon release the medical version too! Now Google shared the recent progress with Med-Gemini, a family of large language models fine-tuned for multimodal medical domain applications. "On multimodal benchmarks such as NEJM Image Challenges and multimodal USMLE-style questions, Med-Gemini achieves a new state of the art, surpassing GPT-4 V by a wide margin. We demonstrate the effectiveness of long-context capabilities through medical video and EHR question answering on which Med-Gemini surpasses prior bespoke methods in a zero-shot manner." [READ MORE]( WHY DO I THINK IT'S IMPORTANT? Multimodal AI is coming to medicine. Prepare yourself and the healthcare workforce by learning prompt engineering! MORE NEWS ABOUT THE FUTURE OF MEDICINE --------------------------------------------------------------- FOREVER YOUNG – [Are You Going To Wake Up From Cryosleep?]( INJECTING NANOCARRIERS – [Gene therapy relieves back pain, repairs damaged disc in mice]( ACETIC ACID – [New gel could make drinking alcohol less harmful]( CHOOSE WISELY – [The right video games can boost kids' well-being]( [color-forwardtofriend-48.png](mailto:berci@medicalfuturist.com) [color-facebook-48.png]( [color-youtube-48.png]( [color-linkedin-48.png]( [color-twitter-48.png]( [color-instagram-48.png]( © The Medical Futurist 2024 This email was sent to {EMAIL} [why did I get this?]( [unsubscribe from this list]( [update subscription preferences]( Medical Futurist · Budapest · Budapest, Pest 1118 · Hungary