Generation of Structurally Realistic Retinal Fundus Images with Diffusion Models

Published in IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), 2024

Authors: Sojung Go, Younghoon Ji, Sang Jun Park, Soochahn Lee

TL;DR: A diffusion-model-based framework that generates retinal fundus images whose vascular and anatomical structures are structurally realistic, enabling high-fidelity synthetic data for downstream retinal analysis.


What this paper is about

Figure description Sample of generated fundus image and artery/vein mask from the proposed method, together with a real data for comparison. The proposed method can generate anatomically accurate fundus images and corresponding artery/vein masks.

Synthetic retinal fundus images are useful for augmenting training data, but conventional generative models often produce images with anatomically implausible vessel trees and optic disc structures. This paper explores whether diffusion models can be guided to produce fundus images whose underlying anatomy is realistic enough to support downstream clinical tasks.

Key idea

Figure description Overview of the proposed method. The top row depicts the process for generating GT A/V masks, which are used to train $G_M$, which generates new A/V masks, and $G_I$ which generates fundus images conditioned on the A/V masks. $G_E$ performs super-resolution to generate high-resolution images.

The method leverages diffusion models conditioned on structural priors so that generated fundus images exhibit coherent vessel topology and plausible optic disc / macula arrangement. By incorporating explicit structural guidance into the generation process, the framework produces images that are both visually realistic and anatomically consistent.

Why it matters

Structurally realistic synthetic fundus images can mitigate data-scarcity issues in retinal imaging research, especially for rare pathologies, and support the development of more robust models for tasks such as vessel segmentation, disease classification, and screening.