Enabling Live-Cell 4D Super-Resolution Microscopy Guided by Artificial Intelligence


Funding Image
Alias: SelfDriving4DSR
Agency: ERC
Type: Consolidator
Principal Investigator: Ricardo Henriques
Start-date: September 2021
End-date: September 2026
DOI: 10.3030/101001332

Project aims to develop a "self-driving" 4D super-resolution microscope guided by AI for long-term live cell imaging with nanoscale resolution. It will use computational optics, machine learning, and adaptive optics to optimize imaging conditions based on the biological sample. A pilot study will track HIV viral infection in cells for over 24 hours to gain new insights into virus latency and replication efficiency linked to entry events previously unobservable.

Technology explored


NanoJ-Fluidics NanoJ-Fluidics
NanoJ-SQUIRREL NanoJ-SQUIRREL
NanoJ-SRRF NanoJ-SRRF
NanoJ-VirusMapper NanoJ-VirusMapper
QuickPALM QuickPALM
vLume vLume

Supported publications


DL4MicEverywhere - deep learning for microscopy made flexible, shareable and reproducible
Iván Hidalgo-Cenalmor, Joanna W. Pylvänäinen, Mariana G. Ferreira, Craig T. Russell, Alon Saguy, Ignacio Arganda-Carreras, Yoav Shechtman, Guillaume Jacquemet, Ricardo Henriques, Estibaliz Gómez-de-Mariscal
Paper published in Nature Methods, May 2024
Technologies: BioImage Model Zoo, DL4MicEverywhere and ZeroCostDL4Mic
Funded by: EMBO, ERC, H2021 and H2022
News: Labonline, MSN, AZoRobotics and Aamuset Kaupunkimedia
Blogs: news-medical.net
DOI: 10.1038/s41592-024-02295-6
Cell constriction requires processive septal peptidoglycan synthase movement independent of FtsZ treadmilling in Staphylococcus aureus
Simon Schäper, António D. Brito, Bruno M. Saraiva, Georgia R. Squyres, Matthew J. Holmes, Ethan C. Garner, Zach Hensel, Ricardo Henriques, Mariana G. Pinho
Paper published in Nature Microbiology, March 2024
Technologies: CARE and NanoJ
Funded by: EMBO and ERC
DOI: 10.1038/s41564-024-01629-6
The rise of data‐driven microscopy powered by machine learning
Leonor Morgado, Estibaliz Gómez‐de‐Mariscal, Hannah S. Heil, Ricardo Henriques
Review published in Journal of Microscopy, March 2024
Technologies: NanoJ and NanoJ-Fluidics
Funded by: CZI, EMBO, ERC, FCT, H2021 and H2022
DOI: 10.1111/jmi.13282
Harnessing artificial intelligence to reduce phototoxicity in live imaging
Estibaliz Gómez-de-Mariscal, Mario Del Rosario, Joanna W. Pylvänäinen, Guillaume Jacquemet, Ricardo Henriques
Perspective published in Journal of Cell Science, February 2024
Technologies: BioImage Model Zoo, CARE, DeepBacs, NanoJ-SRRF and ZeroCostDL4Mic
Funded by: CZI, EMBO, ERC, H2021 and H2022
DOI: 10.1242/jcs.261545
High-fidelity 3D live-cell nanoscopy through data-driven enhanced super-resolution radial fluctuation
Romain F. Laine, Hannah S. Heil, Simao Coelho, Jonathon Nixon-Abell, Angélique Jimenez, Theresa Wiesner, Damián Martínez, Tommaso Galgani, Louise Régnier, Aki Stubb, Gautier Follain, Samantha Webster, Jesse Goyette, Aurelien Dauphin, Audrey Salles, Siân Culley, Guillaume Jacquemet, Bassam Hajj, Christophe Leterrier, Ricardo Henriques
Paper published in Nature Methods, November 2023
Technologies: CARE, NanoJ, NanoJ-eSRRF, NanoJ-SQUIRREL, NanoJ-SRRF, NanoPyx and Nuclear-Pores as references
Funded by: CZI, EMBO, ERC, FCT, H2021, H2022, InnOValley and Wellcome Trust
News: Photonics.com, The Science Times, Optics.org and Phys.org
Blogs: Springer Nature Protocols and Methods Community
DOI: 10.1038/s41592-023-02057-w
Transertion and cell geometry organize the Escherichia coli nucleoid during rapid growth
Christoph Spahn, Stuart Middlemiss, Estibaliz Gómez-de-Mariscal, Ricardo Henriques, Helge B. Bode, Séamus Holden, Mike Heilemann
Preprint published in bioRxiv, October 2023
Technologies: CARE, DeepBacs and ZeroCostDL4Mic
Funded by: EMBO, ERC, H2021 and H2022
DOI: 10.1101/2023.10.16.562172
NanoPyx - super-fast bioimage analysis powered by adaptive machine learning
Bruno M. Saraiva, Inês M. Cunha, António D. Brito, Gautier Follain, Raquel Portela, Robert Haase, Pedro M. Pereira, Guillaume Jacquemet, Ricardo Henriques
Preprint published in bioRxiv, August 2023
Technologies: CARE, NanoJ, NanoJ-eSRRF, NanoJ-SQUIRREL, NanoJ-SRRF, NanoJ-VirusMapper and NanoPyx
Funded by: CZI, EMBO, ERC, FCT, H2021 and H2022
DOI: 10.1101/2023.08.13.553080
CLEM-Reg - An automated point cloud based registration algorithm for correlative light and volume electron microscopy
Daniel Krentzel, Matouš Elphick, Marie-Charlotte Domart, Christopher J. Peddie, Romain F. Laine, Ricardo Henriques, Lucy M. Collinson, Martin L. Jones
Preprint published in bioRxiv, May 2023
Technologies: CARE and ZeroCostDL4Mic
Funded by: CZI and ERC
DOI: 10.1101/2023.05.11.540445
CellTracksColab—A platform for compiling, analyzing, and exploring tracking data
Estibaliz Gómez-de-Mariscal, Hanna Grobe, Joanna W Pylvänäinen, Laura Xénard, Ricardo Henriques, Jean-Yves Tinevez, Guillaume Jacquemet
Preprint published in bioRxiv, January 2023
Technologies: ZeroCostDL4Mic
Funded by: CZI, EMBO, ERC, H2021 and H2022
DOI: 10.1101/2023.10.20.563252
Live-cell imaging in the deep learning era
Joanna W Pylvänäinen, Estibaliz Gómez-de-Mariscal, Ricardo Henriques, Guillaume Jacquemet
Review published in Current Opinion in Cell Biology, January 2023
Technologies: BioImage Model Zoo, CARE, DeepBacs, Fast4DReg, NanoJ, NanoJ-eSRRF, NanoJ-Fluidics, NanoJ-SRRF and ZeroCostDL4Mic
Funded by: CZI, EMBO, ERC and H2021
DOI: 10.1016/j.ceb.2023.102271
Fast4DReg–fast registration of 4D microscopy datasets
Joanna W Pylvänäinen, Romain F Laine, Bruno MS Saraiva, Sujan Ghimire, Gautier Follain, Ricardo Henriques, Guillaume Jacquemet
Paper published in Journal of Cell Science, January 2023
Technologies: CARE, Fast4DReg, NanoJ and ZeroCostDL4Mic
Funded by: CZI and ERC
DOI: 10.1242/jcs.260728
This microtubule does not exist - Super-resolution microscopy image generation by a diffusion model
Alon Saguy, Tav Nahimov, Maia Lehrman, Estibaliz Gómez-de-Mariscal, Iván Hidalgo-Cenalmor, Onit Alalouf, Ricardo Henriques, Yoav Shechtman
Preprint published in bioRxiv, January 2023
Technologies: CARE
Funded by: CZI, EMBO, ERC, H2021 and H2022
DOI: 10.1101/2023.07.06.548004
Processive movement of Staphylococcus aureus essential septal peptidoglycan synthases is independent of FtsZ treadmilling and drives cell constriction
Simon Schaeper, Antonio D Brito, Bruno M Saraiva, Georgia R Squyres, Matthew J Holmes, Ethan C Garner, Zach Hensel, Ricardo Henriques, Mariana G Pinho
Preprint published in bioRxiv, January 2023
Technologies: NanoJ
Funded by: EMBO and ERC
DOI: 10.1101/2023.06.29.547026
Roadmap on deep learning for microscopy
Giovanni Volpe, Carolina Wählby, Lei Tian, Michael Hecht, Artur Yakimovich, Kristina Monakhova, Laura Waller, Ivo F Sbalzarini, Christopher A Metzler, Mingyang Xie, Kevin Zhang, Isaac CD Lenton, Halina Rubinsztein-Dunlop, Daniel Brunner, Bijie Bai, Aydogan Ozcan, Daniel Midtvedt, Hao Wang, Nataša Sladoje, Joakim Lindblad, Jason T Smith, Marien Ochoa, Margarida Barroso, Xavier Intes, Tong Qiu, Li-Yu Yu, Sixian You, Yongtao Liu, Maxim A Ziatdinov, Sergei V Kalinin, Arlo Sheridan, Uri Manor, Elias Nehme, Ofri Goldenberg, Yoav Shechtman, Henrik K Moberg, Christoph Langhammer, Barbora Špačková, Saga Helgadottir, Benjamin Midtvedt, Aykut Argun, Tobias Thalheim, Frank Cichos, Stefano Bo, Lars Hubatsch, Jesus Pineda, Carlo Manzo, Harshith Bachimanchi, Erik Selander, Antoni Homs-Corbera, Martin Fränzl, Kevin de Haan, Yair Rivenson, Zofia Korczak, Caroline Beck Adiels, Mite Mijalkov, Dániel Veréb, Yu-Wei Chang, Joana B Pereira, Damian Matuszewski, Gustaf Kylberg, Ida-Maria Sintorn, Juan C Caicedo, Beth A Cimini, Muyinatu A Lediju Bell, Bruno M Saraiva, Guillaume Jacquemet, Ricardo Henriques, Wei Ouyang, Trang Le, Estibaliz Gómez-de-Mariscal, Daniel Sage, Arrate Muñoz-Barrutia, Ebba Josefson Lindqvist, Johanna Bergman
Preprint published in arXiv, January 2023
Technologies: BioImage Model Zoo, CARE and ZeroCostDL4Mic
Funded by: CZI, EMBO, ERC and H2021
DOI: 10.48550/arXiv.2303.03793
Mapping molecular complexes with super-resolution microscopy and single-particle analysis
Afonso Mendes, Hannah S. Heil, Simao Coelho, Christophe Leterrier, Ricardo Henriques
Review published in Open Biology, July 2022
Technologies: NanoJ-VirusMapper, Nuclear-Pores as references and ZeroCostDL4Mic
Funded by: EMBO, ERC and Wellcome Trust
DOI: 10.1098/rsob.220079
DeepBacs for multi-task bacterial image analysis using open-source deep learning approaches
Christoph Spahn, Estibaliz Gómez-de-Mariscal, Romain F. Laine, Pedro M. Pereira, Lucas von Chamier, Mia Conduit, Mariana G. Pinho, Guillaume Jacquemet, Séamus Holden, Mike Heilemann, Ricardo Henriques
Paper published in Communications Biology, July 2022
Technologies: BioImage Model Zoo, CARE, DeepBacs, NanoJ, NanoJ-SQUIRREL, NanoJ-SRRF and ZeroCostDL4Mic
Funded by: CZI, ERC, FCT and Wellcome Trust
DOI: 10.1038/s42003-022-03634-z
The LEGO® brick road to open science and biotechnology
Etienne Boulter, Julien Colombelli, Ricardo Henriques, Chloé C. Féral
Review published in Trends in Biotechnology, March 2022
Technologies: NanoJ, NanoJ-Fluidics and NanoJ-SRRF
Funded by: EMBO, ERC and Wellcome Trust
DOI: 10.1016/j.tibtech.2022.02.003
Trimethine cyanine dyes as NA-sensitive probes for visualization of cell compartments in fluorescence microscopy
Daria Aristova, Roman Selin, Hannah Sophie Heil, Viktoriia Kosach, Yuriy Slominsky, Sergiy Yarmoluk, Vasyl Pekhnyo, Vladyslava Kovalska, Ricardo Henriques, Andriy Mokhir
Paper published in ACS omega, January 2022
Funded by: EMBO, ERC and H2021
DOI: 10.1021/acsomega.2c05231
Expansion Microscopy on Saccharomyces cerevisiae
AG Korovesi, L Morgado, M Fumasoni, R Henriques, HS Heil, M Del Rosario
Paper published in microPublication Biology, January 2022
Technologies: CARE
Funded by: EMBO, ERC and Wellcome Trust
DOI: 10.17912/micropub.biology.000566
Bioimage model zoo - a community-driven resource for accessible deep learning in bioimage analysis
Wei Ouyang, Fynn Beuttenmueller, Estibaliz Gómez-de-Mariscal, Constantin Pape, Tom Burke, Carlos Garcia-López-de-Haro, Craig Russell, Lucía Moya-Sans, Cristina de-la-Torre-Gutiérrez, Deborah Schmidt, Dominik Kutra, Maksim Novikov, Martin Weigert, Uwe Schmidt, Peter Bankhead, Guillaume Jacquemet, Daniel Sage, Ricardo Henriques, Arrate Muñoz-Barrutia, Emma Lundberg, Florian Jug, Anna Kreshuk
Preprint published in BioRxiv, January 2022
Technologies: BioImage Model Zoo and ZeroCostDL4Mic
Funded by: CZI, EMBO, ERC and H2021
DOI: 10.1101/2022.06.07.495102
Nanoscale colocalization of NK cell activating and inhibitory receptors controls signal integration
David Tomaz, Pedro Matos Pereira, Nadia Guerra, Julian Dyson, Keith Gould, Ricardo Henriques
Paper published in Frontiers in Immunology, January 2022
Technologies: NanoJ and NanoJ-SQUIRREL
Funded by: BBSRC, EMBO and ERC
DOI: 10.3389/fimmu.2022.868496
eHooke - A tool for automated image analysis of spherical bacteria based on cell cycle progression
Bruno M. Saraiva, Ludwig Krippahl, Sérgio R. Filipe, Ricardo Henriques, Mariana G. Pinho
Paper published in Biological Imaging, September 2021
Technologies: CARE
Funded by: ERC and Wellcome Trust
DOI: 10.1017/s2633903x21000027
Democratising deep learning for microscopy with ZeroCostDL4Mic
Lucas von Chamier, Romain F. Laine, Johanna Jukkala, Christoph Spahn, Daniel Krentzel, Elias Nehme, Martina Lerche, Sara Hernández-Pérez, Pieta K. Mattila, Eleni Karinou, Séamus Holden, Ahmet Can Solak, Alexander Krull, Tim-Oliver Buchholz, Martin L. Jones, Loïc A. Royer, Christophe Leterrier, Yoav Shechtman, Florian Jug, Mike Heilemann, Guillaume Jacquemet, Ricardo Henriques
Paper published in Nature Communications, April 2021
Technologies: CARE, FBSR-TFM, NanoJ, NanoJ-SQUIRREL, NanoJ-SRRF and ZeroCostDL4Mic
Funded by: EMBO, ERC and Wellcome Trust
News: AZO Life Sciences, Drug Target Review, Nanotechnology Now and The Medical News
Blogs: Microbiome Digest - Bik's Picks
DOI: 10.1038/s41467-021-22518-0
Single-Molecule Super-Resolution Imaging of T-Cell Plasma Membrane CD4 Redistribution upon HIV-1 Binding
Yue Yuan, Caron A. Jacobs, Isabel Llorente Garcia, Pedro M. Pereira, Scott P. Lawrence, Romain F. Laine, Mark Marsh, Ricardo Henriques
Paper published in Viruses, January 2021
Technologies: CARE
Funded by: ERC
DOI: 10.3390/v13010142
Avoiding a replication crisis in deep-learning-based bioimage analysis
Romain F Laine, Ignacio Arganda-Carreras, Ricardo Henriques, Guillaume Jacquemet
Perspective published in Nature methods, January 2021
Technologies: CARE and ZeroCostDL4Mic
Funded by: EMBO, ERC and Wellcome Trust
DOI: 10.1038/s41592-021-01284-3
The field guide to 3D printing in microscopy
Mario Del Rosario, Hannah S Heil, Afonso Mendes, Vittorio Saggiomo, Ricardo Henriques
Review published in Adv. Biol., January 2021
Technologies: CARE, NanoJ, NanoJ-Fluidics and NanoJ-SRRF
Funded by: EMBO, ERC and Wellcome Trust
DOI: 10.1002/adbi.202100994