Technology Radar›HealthTech›Digital health & MedTech›Multimodal AI diagnostic decision support systems

Multimodal AI Diagnostic Decision Support Systems

See how AI systems combine clinical data to support diagnosis, which research directions are gaining momentum, and where applications are emerging.

Updated 29 September 2026Based on 5,562 documents
1.6k
Organizations active (24 mo)
+67% activity YoY
8
Startups (young or venture-backed)
20
Funding rounds (24 mo)
$92.5B disclosed
1.6k
Publications in 2025
+341% vs 2024

Multimodal AI diagnostic decision support systems in 2026: overview

Multimodal diagnostic decision support combines inputs such as medical images, physiological signals, patient records and clinical text to help healthcare professionals assess disease. The value is in joining evidence that may be incomplete or ambiguous on its own, while keeping clinicians responsible for the final decision. Fusion and clinical reasoning are central design challenges: systems must handle missing or uneven data and make their recommendations understandable enough to evaluate.

Recent work is moving beyond image classification toward systems that connect signals, images and evidence. In September 2026, SR University researchers proposed a quantum–deep hybrid architecture for combining healthcare signals and images; Adnan Aydin University researchers examined explainable Alzheimer’s and frontotemporal dementia diagnosis using EEG and clinical data. Other active directions include retrieval-grounded diagnostic agents and vision-language models. The open problem is translating promising model performance into reliable clinical support, particularly when inputs are incomplete, datasets differ, or explanations do not reflect how a model reached its conclusion.

  • 1From fusion to reasoning: Research is shifting from combining data sources alone toward systems that connect multimodal findings with clinical evidence and diagnostic reasoning.
  • 2Clinical validation matters: Strong retrospective results do not establish clinical readiness; reliability, interpretability and performance across different patient settings remain key hurdles.
  • 3Broader clinical reach: Radiology and neurology remain active areas, while multimodal methods are also gaining ground in digital pathology and primary and emergency care.
Summary generated from Linknovate data on 29 September 2026.

Top organizations working on multimodal AI diagnostic decision support systems

Ranked by Linknovate activity score · last 24 months

The activity score adds up the relevance of every patent, publication, grant and news item linking an organization to multimodal AI diagnostic decision support systems. Showing 7 of 1,570 organizations.

#OrganizationApproachSignals (24 mo)MomentumWhy it matters
1
Shanghai JiaoTong University Research · China
Early-level fusion PUB 53 · NEWS 1 +62% Recently, researchers developed a multimodal ultrasound feature-fusion network for prostate cancer grading. The university’s work also applies foundation models to reconstruct MRI for uterine fibroid analysis.
2
Zhejiang University Research · China
Knowledge-grounded reasoning PUB 39 · NEWS 10 +177% Recently, researchers developed AgentEYE, an autonomous ophthalmic diagnostic agent that combines multimodal inputs with medical evidence. The university also studies collaboration between large and small models for multimodal medical diagnosis.
3
SRM University Research · India
Early-level fusion PUB 35 · NEWS 1 +77% Recently, researchers proposed a cross-modal attentive fusion network for tri-modal lesion-growth prediction. The university’s work also includes multimodal clinical decision support and handwriting-based Parkinson’s disease detection.
4
Fudan University Research · China
Knowledge-grounded reasoning PUB 32 · NEWS 5 +329% Recently, researchers developed multimodal methods for dermatological diagnosis and for assessing gastrointestinal stromal tumors using endoscopic ultrasound and Doppler images. The university also studies evidence-guided reasoning for pediatric chest radiology.
5 Joint representation learning PUB 28 · NEWS 1 +90% The university’s research includes explainable multimodal deep learning for Parkinson’s disease diagnosis, alongside AI-based prediction and decision-support research in pregnancy complications.
6
SU SR University Research · India
Early-level fusion PUB 29 +64% Recently, researchers proposed a hybrid quantum-deep architecture for processing healthcare signals and images together. The university’s work also explores multimodal data for chronic kidney disease prediction and monitoring.
7
Tsinghua University Research · China
Vision-language models PUB 33 · NEWS 2 +92% Recently, researchers fused vibrational spectroscopy with clinical data for aortic dissection diagnosis and prognosis. The university also developed MammoVLM, a vision-language model for mammography diagnostic assistance.
8
··Hidden organizationCompany
ApproachPAT 00 · PUB 00
GRANTS 0 · NEWS 00
+00%Available to registered users.
9
··Hidden organizationCompany
ApproachPAT 00 · PUB 00
GRANTS 0 · NEWS 00
+00%Available to registered users.
10
··Hidden organizationCompany
ApproachPAT 00 · PUB 00
GRANTS 0 · NEWS 00
+00%Available to registered users.
+1,563 more organizations
Including 8 startups and 1,447 universities & research centers. Filter by country, approach and maturity.

Startups to watch and leading research centers

Startups to watch 8 total

Young and venture-backed companies with the highest activity score.
  • AILabThe organization’s work includes benchmarking medical language models for ECG question answering and research on explainable multimodal clinical decision support for chronic eye disease.
  • Linus Health Inc.United StatesLinus Health has patented cognitive and movement-disorder decision support based on multimodal assessments, including mobile screening methods that estimate memory impairment from audio interactions.
  • ··
    Hidden startupCountryAvailable to registered users, with funding and founding year.
  • ··
    Hidden startupCountryAvailable to registered users, with funding and founding year.
See all 8 startups, with funding and founding year

Leading research institutions 1,447 total

Ranked by publications, patents, grants and news in the last 24 months.
  • Shanghai JiaoTong UniversityChinaRecently, researchers developed a multimodal ultrasound feature-fusion network for prostate cancer grading. The university’s work also applies foundation models to reconstruct MRI for uterine fibroid analysis.
  • Zhejiang UniversityChinaRecently, researchers developed AgentEYE, an autonomous ophthalmic diagnostic agent that combines multimodal inputs with medical evidence. The university also studies collaboration between large and small models for multimodal medical diagnosis.
  • SRM UniversityIndiaRecently, researchers proposed a cross-modal attentive fusion network for tri-modal lesion-growth prediction. The university’s work also includes multimodal clinical decision support and handwriting-based Parkinson’s disease detection.
  • ··
    Hidden research institutionCountryAvailable to registered users, with their key researchers.
  • ··
    Hidden research institutionCountryAvailable to registered users, with their key researchers.
See all research groups and their key researchers

Where multimodal AI diagnostic decision support systems innovation happens

China
34.6%
United States
26.8%
India
22.2%
United Kingdom
9.4%
Germany
6.4%
Italy
5.0%
South Korea
4.3%
Japan
3.9%
France
3.9%
Canada
3.4%
Rest of worldEurope

Share of documents with at least one organization from each country.

Open the interactive map with all 1,570 organizations

Main technical approaches

Last 24 months
ApproachWhat it isDocumentsLeading organizations
Early-level fusionCombines raw or low-level inputs early, but can be sensitive to missing data and differences in modality quality. 115
Cc (Creative Conspiracy), Wang Pp, MCI
Joint representation learningLearns a shared representation across modalities, but depends on suitable paired data and effective alignment. 140
Cc (Creative Conspiracy), Wang Pp, University of Electronic Science and Technology of China
Late-level fusionCombines separate modality-specific predictions, making systems modular but potentially missing cross-modal interactions. 122
Fourth Hospital of Hebei Medical UniversityHebei, Cc (Creative Conspiracy), 4 Front Inc.
Vision-language modelsConnects medical images with text for flexible querying and interpretation, but can produce weakly grounded or unsupported outputs. 928
SRM University, Shanghai JiaoTong University, Peking Union Medical College
Knowledge-grounded reasoningUses clinical evidence or knowledge resources to guide diagnostic reasoning, at the cost of maintaining reliable retrieval and knowledge sources. 860
Shanghai JiaoTong University, Beijing Union Medical College Hospital, CLIP

Funding and investment

$92.5B
Disclosed private funding, 20 rounds in the last 24 months
$38.8M
Public grant funding since 2020, across 15 grants
8
Startups active in the last 24 months

Recent funding rounds

Feb 2026
Indiana University United States · The Pfizer Foundation
$5MGrant
Dec 2025
Amazon United States
$35BExpansion
Month 20XX
Hidden organization Country · investors
$00MSeries X
Month 20XX
Hidden organization Country · investors
$00MSeries X
See all 20 rounds, with investors and amounts

The funding data lists 15 grants since 2020 totaling $38,842,094. Because the feed also contains mixed-purpose awards, treat this as a recorded funding signal rather than a clean estimate of investment dedicated to the field.

Patent landscape

Top patent holders · last 24 months
OneSource Solutions International Inc.
2
Linus Health Inc.
2
CAS Shenzhen Institutes of Advanced Technology
1
Clover Health
1
Curai Inc.
1
See every patent holder and their full portfolio

Recent developments

Latest news, duplicates removed
Get alerts for new multimodal AI diagnostic decision support systems developments

Frequently asked questions about multimodal AI diagnostic decision support systems

What companies are working on multimodal AI diagnostic decision support systems?

Google and MayoClinic are listed as corporate participants, while Linus Health Inc. is a named startup; research contributors include Shanghai JiaoTong University and Zhejiang University. Shanghai JiaoTong University has 55 recent-window documents, Zhejiang University 49, and Google 54. These are activity signals, not proof that each organization has a deployed clinical product.

Which multimodal AI diagnostic decision support startups are most promising in 2026?

FACTS identifies 8 startups, but names only AILab and Linus Health Inc. in its startup profiles, so it does not support a reliable ranking of the most promising firms for 2026. Linus Health has 2 patents in the window and works on cognitive and movement-disorder decision support. AILab’s work includes ECG question-answering benchmarks and explainable support for chronic eye disease.

Which universities and research centers lead multimodal AI diagnostic decision support research?

Shanghai JiaoTong University and Zhejiang University are among the most active named research organizations, with 55 and 49 recent-window documents respectively. Other active groups include Tsinghua University, which works on mammography vision-language models, and the Chinese Academy of Sciences CAS, whose research includes retrieval-augmented radiology report generation. These document counts indicate activity, not clinical adoption.

How much funding has multimodal AI diagnostic decision support received?

The recorded funding data lists 15 grants since 2020, totaling $38,842,094. The figure should be interpreted cautiously: the funding feed includes mixed-purpose awards and does not establish that every dollar was dedicated to multimodal diagnostic support. It is a recorded funding signal, not a comprehensive measure of investment across the field.

Who holds the most multimodal AI diagnostic decision support patents?

OneSource Solutions International Inc. and Linus Health Inc. are the leading listed patent holders, with 2 patents each. Other named holders include CAS Shenzhen Institutes of Advanced Technology, Clover Health, Curai Inc., Rad Ai, O.vision and Persown Inc., each with 1 listed patent. The patent-holder list is separate from the field’s 14 patents recorded in the 24-month window.

Is multimodal AI diagnostic decision support patent activity growing?

No: the 14 patents recorded in the 24-month window accompany a 25% decline in patent activity over the latest 12 months versus the previous 12 months. By contrast, publications reached 1,565 in the last year and grew 340.8% over the same comparison window. The difference points to a research-heavy field, not proof of commercial readiness.

What are the latest developments in multimodal AI diagnostic decision support?

In September 2026, SR University researchers proposed a quantum–deep hybrid architecture for processing healthcare signals and images, while Adnan Aydin University researchers explored explainable Alzheimer’s and frontotemporal dementia diagnosis using EEG and clinical data. Other recent work includes JADE-Plus, a multimodal agentic retrieval-augmented framework for jawbone lesion diagnostic support, published in July 2026.

What are the main approaches in multimodal AI diagnostic decision support, and how do they differ?

The 5 listed approaches are early-level fusion, joint representation learning, late-level fusion, vision-language models and knowledge-grounded reasoning. Early fusion combines inputs up front; joint learning builds shared representations; late fusion combines separate predictions. Vision-language models link images and text, while knowledge-grounded systems retrieve clinical evidence to support reasoning. Each approach trades flexibility or richer interactions against data, alignment or grounding challenges.

What are the applications of multimodal AI diagnostic decision support?

The listed applications include neurology, oncology, radiology, primary and emergency care, and digital pathology. Neurology has 690 documents, oncology 578, radiology 505, primary and emergency care 458, and digital pathology 127. Recent examples span EEG-based dementia assessment, breast cancer diagnosis using mammography and pathology images, and multimodal decision support for clinical care.

Go beyond the top 7

Discover and track organizations, patents, publications, grants, news and more. Get live alerts on new startups, funding rounds and emerging developments.