Generative modeling of living cells with SO(3)-equivariant
implicit neural representations

J 2024

Generative modeling of living cells with SO(3)-equivariant implicit neural representations

WIESNER, David, Julian SUK, Sven DUMMER, Tereza NEČASOVÁ, Ulman VLADIMÍR et. al.

Základní údaje

Originální název

Generative modeling of living cells with SO(3)-equivariant implicit neural representations

Autoři

WIESNER, David (203 Česká republika, domácí), Julian SUK (528 Nizozemské království), Sven DUMMER (528 Nizozemské království), Tereza NEČASOVÁ (203 Česká republika, domácí), Ulman VLADIMÍR (203 Česká republika), David SVOBODA (203 Česká republika, garant, domácí) a Jelmer WOLTERINK (528 Nizozemské království)

Vydání

Medical Image Analysis, Netherlands, Elsevier, 2024, 1361-8415

Další údaje

Jazyk

angličtina

Typ výsledku

Článek v odborném periodiku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Švýcarsko

Utajení

není předmětem státního či obchodního tajemství

Odkazy

URL

Impakt faktor

Impact factor: 10.900 v roce 2022

Organizační jednotka

Fakulta informatiky

DOI

http://dx.doi.org/10.1016/j.media.2023.102991

UT WoS

001171218800001

Klíčová slova anglicky

cell shape modeling; neural networks; implicit neural representations; signed distance function; generative model; interpolation

Štítky

cbia-web

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 30. 4. 2024 14:23, RNDr. David Wiesner, Ph.D.

Anotace

V originále

Data-driven cell tracking and segmentation methods in biomedical imaging require diverse and information-rich training data. In cases where the number of training samples is limited, synthetic computer-generated data sets can be used to improve these methods. This requires the synthesis of cell shapes as well as corresponding microscopy images using generative models. To synthesize realistic living cell shapes, the shape representation used by the generative model should be able to accurately represent fine details and changes in topology, which are common in cells. These requirements are not met by 3D voxel masks, which are restricted in resolution, and polygon meshes, which do not easily model processes like cell growth and mitosis. In this work, we propose to represent living cell shapes as level sets of signed distance functions (SDFs) which are estimated by neural networks. We optimize a fully-connected neural network to provide an implicit representation of the SDF value at any point in a 3D+time domain, conditioned on a learned latent code that is disentangled from the rotation of the cell shape. We demonstrate the effectiveness of this approach on cells that exhibit rapid deformations (Platynereis dumerilii), cells that grow and divide (C. elegans), and cells that have growing and branching filopodial protrusions (A549 human lung carcinoma cells). A quantitative evaluation using shape features and Dice similarity coefficients of real and synthetic cell shapes shows that our model can generate topologically plausible complex cell shapes in 3D+time with high similarity to real living cell shapes. Finally, we show how microscopy images of living cells that correspond to our generated cell shapes can be synthesized using an image-to-image model.

Návaznosti

LM2023050, projekt VaV

Název: Národní infrastruktura pro biologické a medicínské zobrazování

Investor: Ministerstvo školství, mládeže a tělovýchovy ČR, Czech BioImaging: Národní výzkumná infrastruktura pro biologické a medicínské zobrazování

MUNI/A/1081/2022, interní kód MU

Název: Modelování, analýza a verifikace (2023)

Investor: Masarykova univerzita, Modelování, analýza a verifikace (2023)

Citovat

WIESNER, David, Julian SUK, Sven DUMMER, Tereza NEČASOVÁ, Ulman VLADIMÍR, David SVOBODA a Jelmer WOLTERINK. Generative modeling of living cells with SO(3)-equivariant implicit neural representations. Medical Image Analysis. Netherlands: Elsevier, 2024, roč. 2024, č. 91, s. 102991-103008. ISSN 1361-8415. Dostupné z: https://dx.doi.org/10.1016/j.media.2023.102991.

@article{2324238,
   author = {Wiesner, David and Suk, Julian and Dummer, Sven and Nečasová, Tereza and Vladimír, Ulman and Svoboda, David and Wolterink, Jelmer},
   article_location = {Netherlands},
   article_number = {91},
   doi = {http://dx.doi.org/10.1016/j.media.2023.102991},
   keywords = {cell shape modeling; neural networks; implicit neural representations; signed distance function; generative model; interpolation},
   language = {eng},
   issn = {1361-8415},
   journal = {Medical Image Analysis},
   title = {Generative modeling of living cells with SO(3)-equivariant implicit neural representations},
   url = {https://doi.org/10.1016/j.media.2023.102991},
   volume = {2024},
   year = {2024}
}

TY  - JOUR
ID  - 2324238
AU  - Wiesner, David - Suk, Julian - Dummer, Sven - Nečasová, Tereza - Vladimír, Ulman - Svoboda, David - Wolterink, Jelmer
PY  - 2024
TI  - Generative modeling of living cells with SO(3)-equivariant implicit neural representations
JF  - Medical Image Analysis
VL  - 2024
IS  - 91
SP  - 102991-103008
EP  - 102991-103008
PB  - Elsevier
SN  - 13618415
KW  - cell shape modeling
KW  - neural networks
KW  - implicit neural representations
KW  - signed distance function
KW  - generative model
KW  - interpolation
UR  - https://doi.org/10.1016/j.media.2023.102991
N2  - Data-driven cell tracking and segmentation methods in biomedical imaging require diverse and information-rich training data. In cases where the number of training samples is limited, synthetic computer-generated data sets can be used to improve these methods. This requires the synthesis of cell shapes as well as corresponding microscopy images using generative models. To synthesize realistic living cell shapes, the shape representation used by the generative model should be able to accurately represent fine details and changes in topology, which are common in cells. These requirements are not met by 3D voxel masks, which are restricted in resolution, and polygon meshes, which do not easily model processes like cell growth and mitosis. In this work, we propose to represent living cell shapes as level sets of signed distance functions (SDFs) which are estimated by neural networks. We optimize a fully-connected neural network to provide an implicit representation of the SDF value at any point in a 3D+time domain, conditioned on a learned latent code that is disentangled from the rotation of the cell shape. We demonstrate the effectiveness of this approach on cells that exhibit rapid deformations (Platynereis dumerilii), cells that grow and divide (C. elegans), and cells that have growing and branching filopodial protrusions (A549 human lung carcinoma cells). A quantitative evaluation using shape features and Dice similarity coefficients of real and synthetic cell shapes shows that our model can generate topologically plausible complex cell shapes in 3D+time with high similarity to real living cell shapes. Finally, we show how microscopy images of living cells that correspond to our generated cell shapes can be synthesized using an image-to-image model.
ER  -

WIESNER, David, Julian SUK, Sven DUMMER, Tereza NEČASOVÁ, Ulman VLADIMÍR, David SVOBODA a Jelmer WOLTERINK. Generative modeling of living cells with SO(3)-equivariant implicit neural representations. \textit{Medical Image Analysis}. Netherlands: Elsevier, 2024, roč.~2024, č.~91, s.~102991-103008. ISSN~1361-8415. Dostupné z: https://dx.doi.org/10.1016/j.media.2023.102991.

Podrobný výpis o publikaci