Enabling Live-Cell 4D Super-Resolution Microscopy Guided by Artificial Intelligence
Alias: SelfDriving4DSR
Agency: ERC
Type: Consolidator
Principal Investigator: Ricardo Henriques
Start-date: September 2021
End-date: September 2026
DOI: 10.3030/101001332
Agency: ERC
Type: Consolidator
Principal Investigator: Ricardo Henriques
Start-date: September 2021
End-date: September 2026
DOI: 10.3030/101001332
Project aims to develop a "self-driving" 4D super-resolution microscope guided by AI for long-term live cell imaging with nanoscale resolution. It will use computational optics, machine learning, and adaptive optics to optimize imaging conditions based on the biological sample. A pilot study will track HIV viral infection in cells for over 24 hours to gain new insights into virus latency and replication efficiency linked to entry events previously unobservable.
Technology explored
Supported publications
|
Harnessing artificial intelligence to reduce phototoxicity in live imaging Estibaliz Gómez-de-Mariscal, Mario Del Rosario, Joanna W. Pylvänäinen, Guillaume Jacquemet, Ricardo Henriques Perspective published in Journal of Cell Science, January 2024 Technologies: BioImage Model Zoo, CARE, DeepBacs, NanoJ-eSRRF, NanoJ-SQUIRREL, NanoJ-SRRF and ZeroCostDL4Mic Funded by: CZI, EMBO, ERC, H2021 and H2022 DOI: 10.1242/jcs.261545 |
|
|
DL4MicEverywhere - deep learning for microscopy made flexible, shareable and reproducible Iván Hidalgo-Cenalmor, Joanna W. Pylvänäinen, Mariana G. Ferreira, Craig T. Russell, Alon Saguy, Ignacio Arganda-Carreras, Yoav Shechtman, Guillaume Jacquemet, Ricardo Henriques, Estibaliz Gómez-de-Mariscal Paper published in Nature Methods, January 2024 Technologies: BioImage Model Zoo, DL4MicEverywhere and ZeroCostDL4Mic Funded by: EMBO, ERC, H2021 and H2022 News: Labonline, MSN, AZoRobotics and Aamuset Kaupunkimedia Blogs: news-medical.net DOI: 10.1038/s41592-024-02295-6 |
|
|
Structural Repetition Detector - multi-scale quantitative mapping of molecular complexes through microscopy Afonso Mendes, Bruno M Saraiva, Guillaume Jacquemet, Joao I Mamede, Christophe Leterrier, Ricardo Henriques Preprint published in bioRxiv, January 2024 Technologies: Nuclear-Pores as references and SReD Funded by: CZI, EMBO, ERC, H2021 and H2022 DOI: 10.1101/2024.09.16.613204 |
|
|
The rise of data-driven microscopy powered by machine learning Leonor Morgado, Estibaliz Gómez‐de‐Mariscal, Hannah S. Heil, Ricardo Henriques Review published in Journal of Microscopy, January 2024 Technologies: NanoJ and NanoJ-Fluidics Funded by: CZI, EMBO, ERC, FCT, H2021 and H2022 DOI: 10.1111/jmi.13282 |
|
|
PhotoFiTT - A Quantitative Framework for Assessing Phototoxicity in Live-Cell Microscopy Experiments Mario Del Rosario, Estibaliz Gómez-de-Mariscal, Leonor Morgado, Raquel Portela, Guillaume Jacquemet, Pedro M. Pereira, Ricardo Henriques Preprint published in bioRxiv, January 2024 Technologies: DL4MicEverywhere, PhotoFiTT and ZeroCostDL4Mic Funded by: CZI, EMBO, ERC, FCT, H2021 and H2022 DOI: 10.1101/2024.07.16.603046 |
|
|
Cell constriction requires processive septal peptidoglycan synthase movement independent of FtsZ treadmilling in Staphylococcus aureus Simon Schäper, António D. Brito, Bruno M. Saraiva, Georgia R. Squyres, Matthew J. Holmes, Ethan C. Garner, Zach Hensel, Ricardo Henriques, Mariana G. Pinho Paper published in Nature Microbiology, January 2024 Technologies: NanoJ Funded by: EMBO and ERC DOI: 10.1038/s41564-024-01629-6 |
|
|
Nano-org, a functional resource for single-molecule localisation microscopy data Sandeep Shirgill, Daniel J Nieves, Jeremy A Pike, Mohammad A Ahmed, Mohammed HH Baragilly, Kylie Savoye, Jonathan Worboys, Khodor Hazime, Adrian Garcia, David J Williamson, Ricardo Henriques, Steven F Lee, Dylan M Owen Preprint published in bioRxiv, January 2024 Technologies: nano-org Funded by: EMBO, ERC, H2021 and H2022 DOI: 10.1101/2024.08.06.606779 |
|
|
CLEM-Reg - An automated point cloud based registration algorithm for correlative light and volume electron microscopy Daniel Krentzel, Matouš Elphick, Marie-Charlotte Domart, Christopher J. Peddie, Romain F. Laine, Ricardo Henriques, Lucy M. Collinson, Martin L. Jones Preprint published in BioRxiv, January 2023 Technologies: BioImage Model Zoo, CLEM-Reg and ZeroCostDL4Mic Funded by: CZI and ERC DOI: 10.1101/2023.05.11.540445 |
|
|
High-fidelity 3D live-cell nanoscopy through data-driven enhanced super-resolution radial fluctuation Romain F. Laine, Hannah S. Heil, Simao Coelho, Jonathon Nixon-Abell, Angélique Jimenez, Theresa Wiesner, Damián Martínez, Tommaso Galgani, Louise Régnier, Aki Stubb, Gautier Follain, Samantha Webster, Jesse Goyette, Aurelien Dauphin, Audrey Salles, Siân Culley, Guillaume Jacquemet, Bassam Hajj, Christophe Leterrier, Ricardo Henriques Paper published in Nature Methods, January 2023 Technologies: NanoJ, NanoJ-eSRRF, NanoJ-SQUIRREL, NanoJ-SRRF, NanoPyx and Nuclear-Pores as references Funded by: CZI, EMBO, ERC, FCT, H2021, H2022, InnOValley and Wellcome Trust News: Photonics.com, The Science Times, Optics.org and Phys.org Blogs: Springer Nature Protocols and Methods Community DOI: 10.1038/s41592-023-02057-w |
|
|
Live-cell imaging in the deep learning era Joanna W Pylvänäinen, Estibaliz Gómez-de-Mariscal, Ricardo Henriques, Guillaume Jacquemet Review published in Current Opinion in Cell Biology, January 2023 Technologies: BioImage Model Zoo, DeepBacs, Fast4DReg, NanoJ, NanoJ-eSRRF, NanoJ-Fluidics and ZeroCostDL4Mic Funded by: CZI, EMBO, ERC and H2021 DOI: 10.1016/j.ceb.2023.102271 |
|
|
Fast4DReg–fast registration of 4D microscopy datasets Joanna W Pylvänäinen, Romain F Laine, Bruno MS Saraiva, Sujan Ghimire, Gautier Follain, Ricardo Henriques, Guillaume Jacquemet Paper published in Journal of Cell Science, January 2023 Technologies: CARE, Fast4DReg, NanoJ and ZeroCostDL4Mic Funded by: CZI and ERC DOI: 10.1242/jcs.260728 |
|
|
This Microtubule Does Not Exist - Super‐Resolution Microscopy Image Generation by a Diffusion Model Alon Saguy, Tav Nahimov, Maia Lehrman, Estibaliz Gómez-de-Mariscal, Iván Hidalgo-Cenalmor, Onit Alalouf, Ashwin Balakrishnan, Mike Heilemann, Ricardo Henriques, Yoav Shechtman Published in Small Methods, January 2023 Technologies: ZeroCostDL4Mic Funded by: CZI, EMBO, ERC, H2021 and H2022 DOI: 10.1002/smtd.202400672 |
|
|
NanoPyx - super-fast bioimage analysis powered by adaptive machine learning Bruno M. Saraiva, Inês M. Cunha, António D. Brito, Gautier Follain, Raquel Portela, Robert Haase, Pedro M. Pereira, Guillaume Jacquemet, Ricardo Henriques Preprint published in bioRxiv, January 2023 Technologies: NanoJ, NanoJ-eSRRF, NanoJ-SQUIRREL, NanoJ-SRRF, NanoJ-VirusMapper and NanoPyx Funded by: CZI, EMBO, ERC, FCT, H2021 and H2022 DOI: 10.1101/2023.08.13.553080 |
|
|
Processive movement of Staphylococcus aureus essential septal peptidoglycan synthases is independent of FtsZ treadmilling and drives cell constriction Simon Schaeper, Antonio D Brito, Bruno M Saraiva, Georgia R Squyres, Matthew J Holmes, Ethan C Garner, Zach Hensel, Ricardo Henriques, Mariana G Pinho Preprint published in bioRxiv, January 2023 Technologies: NanoJ Funded by: EMBO and ERC DOI: 10.1101/2023.06.29.547026 |
|
|
Transertion and cell geometry organize the Escherichia coli nucleoid during rapid growth Christoph Spahn, Stuart Middlemiss, Estibaliz Gómez-de-Mariscal, Ricardo Henriques, Helge B. Bode, Séamus Holden, Mike Heilemann Preprint published in bioRxiv, January 2023 Technologies: CARE, DeepAutoFocus, DeepBacs and ZeroCostDL4Mic Funded by: EMBO, ERC, H2021 and H2022 DOI: 10.1101/2023.10.16.562172 |
|
|
Roadmap on deep learning for microscopy Giovanni Volpe, Carolina Wählby, Lei Tian, Michael Hecht, Artur Yakimovich, Kristina Monakhova, Laura Waller, Ivo F Sbalzarini, Christopher A Metzler, Mingyang Xie, Kevin Zhang, Isaac CD Lenton, Halina Rubinsztein-Dunlop, Daniel Brunner, Bijie Bai, Aydogan Ozcan, Daniel Midtvedt, Hao Wang, Nataša Sladoje, Joakim Lindblad, Jason T Smith, Marien Ochoa, Margarida Barroso, Xavier Intes, Tong Qiu, Li-Yu Yu, Sixian You, Yongtao Liu, Maxim A Ziatdinov, Sergei V Kalinin, Arlo Sheridan, Uri Manor, Elias Nehme, Ofri Goldenberg, Yoav Shechtman, Henrik K Moberg, Christoph Langhammer, Barbora Špačková, Saga Helgadottir, Benjamin Midtvedt, Aykut Argun, Tobias Thalheim, Frank Cichos, Stefano Bo, Lars Hubatsch, Jesus Pineda, Carlo Manzo, Harshith Bachimanchi, Erik Selander, Antoni Homs-Corbera, Martin Fränzl, Kevin de Haan, Yair Rivenson, Zofia Korczak, Caroline Beck Adiels, Mite Mijalkov, Dániel Veréb, Yu-Wei Chang, Joana B Pereira, Damian Matuszewski, Gustaf Kylberg, Ida-Maria Sintorn, Juan C Caicedo, Beth A Cimini, Muyinatu A Lediju Bell, Bruno M Saraiva, Guillaume Jacquemet, Ricardo Henriques, Wei Ouyang, Trang Le, Estibaliz Gómez-de-Mariscal, Daniel Sage, Arrate Muñoz-Barrutia, Ebba Josefson Lindqvist, Johanna Bergman Preprint published in arXiv, January 2023 Technologies: BioImage Model Zoo, CARE and ZeroCostDL4Mic Funded by: CZI, EMBO, ERC and H2021 DOI: 10.48550/arXiv.2303.03793 |
|
|
Trimethine cyanine dyes as NA-sensitive probes for visualization of cell compartments in fluorescence microscopy Daria Aristova, Roman Selin, Hannah Sophie Heil, Viktoriia Kosach, Yuriy Slominsky, Sergiy Yarmoluk, Vasyl Pekhnyo, Vladyslava Kovalska, Ricardo Henriques, Andriy Mokhir Paper published in ACS omega, January 2022 Funded by: EMBO, ERC and H2021 DOI: 10.1021/acsomega.2c05231 |
|
|
The LEGO® brick road to open science and biotechnology Etienne Boulter, Julien Colombelli, Ricardo Henriques, Chloé C. Féral Review published in Trends in Biotechnology, January 2022 Technologies: NanoJ and NanoJ-Fluidics Funded by: EMBO, ERC and Wellcome Trust DOI: 10.1016/j.tibtech.2022.02.003 |
|
|
Expansion Microscopy on Saccharomyces cerevisiae AG Korovesi, L Morgado, M Fumasoni, R Henriques, HS Heil, M Del Rosario Paper published in microPublication Biology, January 2022 Funded by: EMBO, ERC and Wellcome Trust DOI: 10.17912/micropub.biology.000566 |
|
|
Mapping molecular complexes with super-resolution microscopy and single-particle analysis Afonso Mendes, Hannah S. Heil, Simao Coelho, Christophe Leterrier, Ricardo Henriques Review published in Open Biology, January 2022 Technologies: NanoJ-VirusMapper, Nuclear-Pores as references and ZeroCostDL4Mic Funded by: EMBO, ERC and Wellcome Trust DOI: 10.1098/rsob.220079 |
|
|
Bioimage model zoo - a community-driven resource for accessible deep learning in bioimage analysis Wei Ouyang, Fynn Beuttenmueller, Estibaliz Gómez-de-Mariscal, Constantin Pape, Tom Burke, Carlos Garcia-López-de-Haro, Craig Russell, Lucía Moya-Sans, Cristina de-la-Torre-Gutiérrez, Deborah Schmidt, Dominik Kutra, Maksim Novikov, Martin Weigert, Uwe Schmidt, Peter Bankhead, Guillaume Jacquemet, Daniel Sage, Ricardo Henriques, Arrate Muñoz-Barrutia, Emma Lundberg, Florian Jug, Anna Kreshuk Preprint published in BioRxiv, January 2022 Technologies: BioImage Model Zoo, CARE and ZeroCostDL4Mic Funded by: CZI, EMBO, ERC and H2021 DOI: 10.1101/2022.06.07.495102 |
|
|
DeepBacs for multi-task bacterial image analysis using open-source deep learning approaches Christoph Spahn, Estibaliz Gómez-de-Mariscal, Romain F. Laine, Pedro M. Pereira, Lucas von Chamier, Mia Conduit, Mariana G. Pinho, Guillaume Jacquemet, Séamus Holden, Mike Heilemann, Ricardo Henriques Paper published in Communications Biology, January 2022 Technologies: BioImage Model Zoo, CARE, DeepBacs, NanoJ, NanoJ-SQUIRREL and ZeroCostDL4Mic Funded by: CZI, ERC, FCT and Wellcome Trust DOI: 10.1038/s42003-022-03634-z |
|
|
Nanoscale colocalization of NK cell activating and inhibitory receptors controls signal integration David Tomaz, Pedro Matos Pereira, Nadia Guerra, Julian Dyson, Keith Gould, Ricardo Henriques Paper published in Frontiers in Immunology, January 2022 Technologies: NanoJ and NanoJ-SQUIRREL Funded by: BBSRC, EMBO and ERC DOI: 10.3389/fimmu.2022.868496 |
|
|
Democratising deep learning for microscopy with ZeroCostDL4Mic Lucas von Chamier, Romain F. Laine, Johanna Jukkala, Christoph Spahn, Daniel Krentzel, Elias Nehme, Martina Lerche, Sara Hernández-Pérez, Pieta K. Mattila, Eleni Karinou, Séamus Holden, Ahmet Can Solak, Alexander Krull, Tim-Oliver Buchholz, Martin L. Jones, Loïc A. Royer, Christophe Leterrier, Yoav Shechtman, Florian Jug, Mike Heilemann, Guillaume Jacquemet, Ricardo Henriques Paper published in Nature communications, January 2021 Technologies: CARE, NanoJ, NanoJ-SQUIRREL, NanoJ-SRRF and ZeroCostDL4Mic Funded by: EMBO, ERC and Wellcome Trust News: AZO Life Sciences, Drug Target Review, Nanotechnology Now and The Medical News Blogs: Microbiome Digest - Bik's Picks DOI: 10.1038/s41467-021-22518-0 |
|
|
Avoiding a replication crisis in deep-learning-based bioimage analysis Romain F Laine, Ignacio Arganda-Carreras, Ricardo Henriques, Guillaume Jacquemet Perspective published in Nature methods, January 2021 Technologies: BioImage Model Zoo and ZeroCostDL4Mic Funded by: EMBO, ERC and Wellcome Trust DOI: 10.1038/s41592-021-01284-3 |
|
|
The field guide to 3D printing in microscopy Mario Del Rosario, Hannah S Heil, Afonso Mendes, Vittorio Saggiomo, Ricardo Henriques Review published in Adv. Biol., January 2021 Technologies: CARE, NanoJ, NanoJ-Fluidics and NanoJ-SRRF Funded by: EMBO, ERC and Wellcome Trust DOI: 10.1002/adbi.202100994 |
|
|
eHooke - a tool for automated image analysis of spherical bacteria based on cell cycle progression Bruno M. Saraiva, Ludwig Krippahl, Sérgio R. Filipe, Ricardo Henriques, Mariana G. Pinho Paper published in Biological Imaging, January 2021 Funded by: ERC and Wellcome Trust DOI: 10.1017/s2633903x21000027 |
|
|
Single-Molecule Super-Resolution Imaging of T-Cell Plasma Membrane CD4 Redistribution upon HIV-1 Binding Yue Yuan, Caron A. Jacobs, Isabel Llorente Garcia, Pedro M. Pereira, Scott P. Lawrence, Romain F. Laine, Mark Marsh, Ricardo Henriques Paper published in Viruses, January 2021 Funded by: ERC DOI: 10.3390/v13010142 |
|