Refine
Document Type
- Preprint (2)
- Doctoral Thesis (1)
Language
- English (3)
Has Fulltext
- yes (3)
Is part of the Bibliography
- no (3)
Keywords
- deep learning (1)
- denoising (1)
- receptor tyrosine kinases (1)
- super-resolution microscopy (1)
- virtual labeling (1)
Institute
DNA points accumulation for imaging in nanoscale topography (DNA-PAINT) is a super-resolution technique with relatively easy-to-implement multi-target imaging. However, image acquisition is slow as sufficient statistical data has to be generated from spatio-temporally isolated single emitters. Here, we trained the neural network (NN) DeepSTORM to predict fluorophore positions from high emitter density DNA-PAINT data. This achieves image acquisition in one minute. We demonstrate multi-color super-resolution imaging of structure-conserved semi-thin neuronal tissue and imaging of large samples. This improvement can be integrated into any single-molecule microscope and enables fast single-molecule super-resolution microscopy.
Dynamic imaging of landmark organelles, such as nuclei, cell membrane, nuclear envelope, and lipid droplets enables image-based phenotyping of functional states of cells. Multispectral fluorescent imaging of landmark organelles requires labor-intensive labeling, limits throughput, and compromises cell health. Virtual staining of label-free images with deep neural networks is an emerging solution for this problem. Multiplexed imaging of cellular landmarks from scattered light and subsequent demultiplexing with virtual staining saves the light spectrum for imaging additional molecular reporters, photomanipulation, or other tasks. Published approaches for virtual staining of landmark organelles are fragile in the presence of nuisance variations in imaging, culture conditions, and cell types. This paper reports model training protocols for virtual staining of nuclei and membranes robust to label-free imaging parameters, cell states, and cell types. We developed a flexible and scalable convolutional architecture, named UNeXt2, for supervised training and self-supervised pre-training. The strategies we report here enable robust virtual staining of nuclei and cell membranes in multiple cell types, including neuromasts of zebrafish, across a range of imaging conditions. We assess the models by comparing the intensity, segmentations, and application-specific measurements obtained from virtually stained and experimentally stained nuclei and membranes. The models rescue the missing label, non-uniform expression of labels, and photobleaching. We share three pre-trained models, named VSCyto3D, VSCyto2D, and VSNeuromast, as well as VisCy, a PyTorch-based pipeline for training, inference, and deployment that leverages the modern OME-Zarr format.
Fluorescence microscopy has significantly impacted our understanding of cell biology. The extension of diffraction-unlimited super-resolution microscopy opened an observation window that allows for the scrutiny of cellular organization at a molecular level. The non-invasive nature of visible light in super-resolution microscopy methods renders them suitable for observations in living cells and organisms. Building upon these advancements, a promising synergy between super-resolution fluorescence microscopy and deep learning becomes evident, extending the capabilities of the imaging methods. Tasks such as image modality translation, restoration, single-molecule fitting, virtual labeling, spectral demixing, and molecular counting, are enabled with high precision. The techniques explored in this thesis address three critical facets in advanced microscopy, namely the reduction in image acquisition time, saving photon budget during measurement, and increasing the multiplexing capability. Furthermore, descriptors of protein distributions and their motion on cell membranes were developed.