Imaging is a cornerstone of many medical specialties, such as Radiology, Pathology and Ophthalmology. Humans assessing the images are becoming the bottleneck, as they have to read an ever growing number of more extensive imaging studies. Computers can potentially extract more information from images, more reliably, and more accurately. AI and, particularly deep learning, has so far brought substantial improvements to the analysis of medical images. In this talk I will present how deep learning is transforming healthcare, from detection and diagnosis to treatment monitoring. I will further discuss the challenges that we are currently facing and the need of new approaches to accomplish clinically meaningful solutions that can be integrated in clinical practice.