@ Nature this week calls out lack of real world data for AI medical algorithms.
AI-powered medical devices that inform clinical decision-making need rigorous, real-world testing equivalent to what’s required for drugs and self-driving cars.
- Since ChatGPT’s release in late 2022, generative AI has flooded into clinics rapidly — roughly 3 peer-reviewed articles on clinical AI publish every day, and 230+ million people weekly ask ChatGPT health questions.
- AI systems now handle admin tasks, order labs, help prescribe drugs, interpret X-rays/MRI/CT scans, and diagnose rare diseases.
- But regulatory oversight lags: some AI-powered medical products are being certified *without* real-world assessment.
Why current testing falls short:
- Most AI tools are novel, so there’s little existing clinical data to benchmark against (unlike a revised stethoscope or new bandage).









