Beyond the Last Frame: Temporal Modelling of Fluorescein Angiography for Hyperfluorescence Classification
| Type of publication: | Conference paper |
| Citation: | vanRijn_BEYONDTHELASTFRAME_2026 |
| Publication status: | Accepted |
| Booktitle: | Ophthalmic Medical Image Analysis |
| Series: | Lecture Notes in Computer Science |
| Year: | 2026 |
| Month: | September |
| Abstract: | Fluorescein angiography (FA) captures the passage of dye through the retinal vasculature over time, and the resulting hyperfluorescence patterns are central to assessing retinal vascular and inflammatory disease. Yet existing automated grading methods reduce each examination to a single frame, discarding the temporal evolution that clinicians rely on to distinguish these patterns. We investigate whether temporal modelling improves automated hyperfluorescence grading beyond single-frame approaches by representing each FA examination as a sequence of frames. We partition each sequence into Early, Mid, and Late phases using a data-driven procedure based on linear discriminant analysis of frame embeddings. Frames from each phase are encoded by the RETFound-Green retinal foundation model and aggregated by an attention-pooled gated recurrent unit (GRU) to classify five hyperfluorescence types. To enable temporal analysis, we reconstruct and release per-frame acquisition times in the public AngioReport FA dataset. Evaluated on held-out patients over five random seeds, our pipeline consistently improves discrimination over the state-of-the-art single-frame approach across all five hyperfluorescence types, raising the overall AUROC from 0.82 to 0.87, with the largest gains for types defined by their temporal evolution. Modelling the temporal dimension of FA, rather than a single frame, thus consistently improves grading, and our released timestamped dataset opens temporal FA analysis to the community. Code and the reconstructed timestamps are available at https://gitlab.idiap.ch/medai/software/paper/miccai-omia-beyond-the-last-frame. |
| Main Research Program: | AI for Everyone |
| Additional Research Programs: |
AI for Life |
| Keywords: | |
| Projects: |
Idiap IMAGIN-AIR |
| Authors: | |
| Added by: | [UNK] |
| Total mark: | 0 |
|
Attachments
|
|
|
|
|
Notes
|
|
|
|
|
