Speaker: A. Murat Tekalp
Affiliation: Koç University, Türkiye
Title:Image Modeling: From Hand-Designed Prior Models to Image Foundation Models
Time: 9:00, November 4
Location:Meeting Room, Yifu Auditorium
Abstract:
With a unified Bayesian framework connecting the six-decade development trajectory of image modeling, this work integrates traditional imaging inverse problem methods with manually designed priors and current big data-based deep image foundation models and generative models under the same probabilistic manifold perspective, and clarifies the internal connection between variational optimization for maximum a posteriori estimation and posterior sampling of modern generative models. The study reveals that the log-prior gradient (score function / Stein Score Function) is the shared core mathematical kernel for image restoration and conditional image generation tasks, and provides a unified explanation for the evolution logic from Tikhonov, total variation and non-local priors to plug-and-play priors and denoising diffusion models. This work bridges the long-standing research gap between the traditional signal processing field and the machine learning field, clarifies the main thread of image modeling evolving from artificial analytical models to data-driven learning models, proves that denoising score is the common thread running through imaging inverse problems and image generation tasks, provides a unified theoretical paradigm for algorithm design, theoretical analysis and model improvement of imaging inverse problems based on generative priors, and has important guiding value for the theoretical development and methodological innovation in computational imaging, image reconstruction and image generation.
Personal Introduction:
Professor A. Murat Tekalp is currently a Member of the Turkish Academy of Sciences, a Member of the Academia Europaea, Professor at the Department of Electrical and Electronics Engineering of Koç University, an IEEE Fellow, and former Dean of the School of Engineering at Koç University. He has won many honors including the Science Award of the Scientific and Technological Research Council of Türkiye, the IEEE Turkey Section Lifetime Achievement Award and the Fulbright Senior Scholar Award, is deeply engaged in digital image processing, video coding and multimedia signal processing research, is the author of the classic monograph Digital Video Processing, has published 469 academic publications and holds 10 US patents, served as Editor-in-Chief of Signal Processing: Image Communication and is on the editorial board of multiple internationally renowned journals, has contributed key technologies to the MPEG-4 and MPEG-7 international standards, and enjoys extensive influence in the international multimedia field.
[Editor:Shuaihao Deng, Yaoguang Zhang]