The FIREFLY Dataset
FIREFLY (Fundus Images REgistered with FLuorescein angiographY) is a retinal imaging dataset that pairs color fundus photographs with their corresponding fluorescein angiography (FA) captures, along with fine-scale vessel segmentation masks and artery/vein classification labels. The dataset is built by registering FA sequences to their fundus counterparts, aggregating vascular detail across FA frames using CNN-based methods, producing artery/vein labels via graph-based neural networks, and validating the final annotations with clinicians and imaging technicians.
A synthetic counterpart, FIREFLY-Gen, extends the dataset by generating realistic retinal fundus images together with matching vessel masks using diffusion and GAN-based generative models — expanding data availability for training and evaluating vessel analysis methods.
Request access to the FIREFLY-Gen dataset →
Why it matters
Standard fundus photography cannot reveal fine-scale vasculature, while FA does — at the cost of a contrast agent and a different appearance space. By registering the two modalities and distilling FA-level detail into fundus coordinates, FIREFLY enables supervision that was previously impossible: fundus-based models can now be trained and evaluated on vessel maps derived from FA-quality ground truth.
Construction pipeline
- Cross-modal registration between fundus and FA image pairs.
- Fine-scale vessel extraction from FA frames and projection into fundus coordinates.
- Artery/vein classification using hierarchical graph networks that leverage both modalities.
- Joint deep learning of fundus and FA for improved A/V classification.
- Synthetic augmentation (FIREFLY-Gen) using diffusion models to generate structurally realistic fundus images with paired vessel annotations.
Related publications
- Fine-Scale Vessel Extraction in Fundus Images by Registration with Fluorescein Angiography — MICCAI, 2019
- Multimodal Registration of Fundus Images with Fluorescein Angiography for Fine-Scale Vessel Segmentation — IEEE Access, 2020
- Combining Fundus Images and Fluorescein Angiography for Artery/Vein Classification Using the Hierarchical Vessel Graph Network — MICCAI, 2020
- Combined Deep Learning of Fundus Images and Fluorescein Angiography for Retinal Artery/Vein Classification — IEEE Access, 2022
- Generation of Structurally Realistic Retinal Fundus Images with Diffusion Models — CVPRW, 2024