Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published January 2022 | Accepted Version
Journal Article Open

Classification of Astrophysics Journal Articles with Machine Learning to Identify Data for NED

Abstract

The NASA/IPAC Extragalactic Database (NED) is a comprehensive online service that combines fundamental multi-wavelength information for known objects beyond the Milky Way and provides value-added, derived quantities and tools to search and access the data. The contents and relationships between measurements in the database are continuously augmented and revised to stay current with astrophysics literature and new sky surveys. The conventional process of distilling and extracting data from the literature involves human experts to review the journal articles and determine if an article is of extragalactic nature, and if so, what types of data it contains. This is both labor intensive and unsustainable, especially given the ever-increasing number of publications each year. We present here a machine learning (ML) approach developed and integrated into the NED production pipeline to help automate the classification of journal article topics and their data content for inclusion into NED. We show that this ML application can successfully reproduce the classifications of a human expert to an accuracy of over 90% in a fraction of the time it takes a human, allowing us to focus human expertise on tasks that are more difficult to automate.

Additional Information

© 2022. The Astronomical Society of the Pacific. Received 2021 July 27; accepted 2021 November 22; published 2022 January 11. We want to acknowledge the past and continuing work of the Natural Language Processing Group at Stanford University, without which this application would have been much more difficult. We are also grateful to the American Astronomical Society Journals and IOP Publishing, the Oxford University Press, and EDP Sciences for their support in providing extensive and on-going access to their publications. We thank the anonymous referee for the critical review and comments which resulted in substantial improvements to the article. This work was funded by the National Aeronautics and Space Administration through a cooperative agreement with the California Institute of Technology. Facilities: ADS - , NED. - Software: Stanford Classifier v3.9.2, The Stanford Natural Language Processing Group, https://nlp.stanford.edu/software/classifier.shtml

Attached Files

Accepted Version - 2201.03636.pdf

Files

2201.03636.pdf
Files (473.7 kB)
Name Size Download all
md5:662374d9c1d214c74b87dfb6db7153a0
473.7 kB Preview Download

Additional details

Created:
August 22, 2023
Modified:
October 23, 2023