Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published April 20, 2022 | Supplemental Material + Submitted + Published
Journal Article Open

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Abstract

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance (>8dB) denoising in less time than other fluorescence microscopy denoising methods.

Additional Information

© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement. Received 10 November 2021; revised 1 February 2022; accepted 6 February 2022; published 22 March 2022. We thank Prof. Joshua D. Shrout, Department of Civil and Environmental Engineering and Earth Sciences, University of Notre Dame, for providing M. xanthus cells for our experiments. Yide Zhang's research was supported by the Berry Family Foundation Graduate Fellowship of Advanced Diagnostics & Therapeutics (AD&T), University of Notre Dame. The authors further acknowledge Notre Dame's Center for Research Computing (CRC) for the use of GPUs to train the ML models and the Integrated Imaging Facility (NDIIF) for the use of the Nikon A1R MP confocal microscope and Nikon Eclipse 90i widefield microscope in NDIIF's Optical Microscopy Core. Funding: Office of Science (0019312); Division of Chemical, Bioengineering, Environmental, and Transport Systems (1554516). The authors declare no conflicts of interest. Data availability: Data and Code Availability. The FMD dataset mentioned in this paper is publicly available in [25]. The code for training the Noise2Noise plugin and DnCNN plugin architectures and underlying the results presented in the paper are publicly available in [43]. Also, this repository includes the estimation of noise parameters using MATLAB codes, Noise2Noise plugin validation on the W2S dataset, Noise2Noise plugin validation on out-of-distribution samples, and plugin source code in java with ImageJ plugins. Additional details of our Noise2Noise plugin denoising validation on the large datasets are available in [50]. The out-of-distribution structure dataset (3D RCAN dataset) used to generate underlying denoising results presented in this paper is available in [33].

Attached Files

Published - optica-9-4-335.pdf

Submitted - 2021.11.10.468102v2.full.pdf

Supplemental Material - 5685036.pdf

Files

2021.11.10.468102v2.full.pdf
Files (28.5 MB)
Name Size Download all
md5:ddaed84c8c988d9dca39151356f083c5
2.8 MB Preview Download
md5:63ce134bc157d4898fd986126681b739
6.6 MB Preview Download
md5:a4a20e1e6d5cbfed4a7252f653479d41
19.1 MB Preview Download

Additional details

Created:
August 20, 2023
Modified:
October 23, 2023