A collection of resources on applications of multi-modal learning in medical imaging.

Foundation models based medical image analysis

Awesome radiology report generation and image captioning papers.

Code for the paper "ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning" (ACL'23).

Code used for the MLMI 2021 paper Clinically Correct Report Generation from Chest X-Rays Using Templates

Code for the paper "RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning" (EMNLP'23 Findings).

Code for the paper "RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection" (ACL'25).

Code for the paper "ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentation" (EMNLP'24 Findings).

[IJBHI 2024] This is the official implementation of CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation accepted to IEEE Journal of Biomedical and Health Informatics (J-BHI), 2023.

Medical Report Generation And VQA (Adapting XrayGPT to Any Modality)

GPT-2 based medical reports generator for X-ray images in Czech.

AI-powered Chest X-ray report generation app using VLM (Swin-T5) and LLM (LLaMA-3) for multilingual Q&A and medical education support.

Resources on the use of multimodal learning in medical imaging.

Medivance.AI is a cutting-edge, all-in-one AI healthcare platform that transforms the way patients, doctors, and healthcare organizations interact with medical data.

The primary objective of this work is to develop an innovative system capable of providing explainable brain tumor detection.

This is the official implementation of MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement accepted to IEEE Journal of Biomedical and Health Informatics (J-BHI), 2025.