Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ
Abstract
Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance (>8dB) denoising in less time than other fluorescence microscopy denoising methods.
Additional Information
© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement. Received 10 November 2021; revised 1 February 2022; accepted 6 February 2022; published 22 March 2022. We thank Prof. Joshua D. Shrout, Department of Civil and Environmental Engineering and Earth Sciences, University of Notre Dame, for providing M. xanthus cells for our experiments. Yide Zhang's research was supported by the Berry Family Foundation Graduate Fellowship of Advanced Diagnostics & Therapeutics (AD&T), University of Notre Dame. The authors further acknowledge Notre Dame's Center for Research Computing (CRC) for the use of GPUs to train the ML models and the Integrated Imaging Facility (NDIIF) for the use of the Nikon A1R MP confocal microscope and Nikon Eclipse 90i widefield microscope in NDIIF's Optical Microscopy Core. Funding: Office of Science (0019312); Division of Chemical, Bioengineering, Environmental, and Transport Systems (1554516). The authors declare no conflicts of interest. Data availability: Data and Code Availability. The FMD dataset mentioned in this paper is publicly available in [25]. The code for training the Noise2Noise plugin and DnCNN plugin architectures and underlying the results presented in the paper are publicly available in [43]. Also, this repository includes the estimation of noise parameters using MATLAB codes, Noise2Noise plugin validation on the W2S dataset, Noise2Noise plugin validation on out-of-distribution samples, and plugin source code in java with ImageJ plugins. Additional details of our Noise2Noise plugin denoising validation on the large datasets are available in [50]. The out-of-distribution structure dataset (3D RCAN dataset) used to generate underlying denoising results presented in this paper is available in [33].Attached Files
Published - optica-9-4-335.pdf
Submitted - 2021.11.10.468102v2.full.pdf
Supplemental Material - 5685036.pdf
Files
Additional details
- Eprint ID
- 111887
- Resolver ID
- CaltechAUTHORS:20211116-153719213
- Berry Family Foundation
- University of Notre Dame
- DE-SC0019312
- Department of Energy (DOE)
- CBET-1554516
- NSF
- Created
-
2021-11-16Created from EPrint's datestamp field
- Updated
-
2023-09-08Created from EPrint's last_modified field