Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published June 5, 2012 | public
Book Section - Chapter

Extracting Knowledge from Massive Astronomical Data Sets

Abstract

The exponential growth of astronomical data collected by both ground-based and spaceborne instruments has fostered the growth of astroinformatics: a new discipline lying at the intersection between astronomy, applied computer science, and information and computation technologies. At the very heart of astroinformatics is a complex set of methodologies usually called data mining (DM) or knowledge discovery in databases (KDD). In the astronomical domain, DM/KDD are still in a very early usage stage, even though new methods and tools are being continuously deployed to cope with the massive data sets (MDSs) that can only grow in the future. In this paper, we briefly outline some general problems encountered when applying DM/KDD methods to astrophysical problems and describe the DAME (Data Mining and Exploration) Web application. While specifically tailored to work on MDSs, DAME can be effectively applied also to smaller data sets. As an illustration, we describe two applications of DAME to two different problems: the identification of candidate GCs in external galaxies and the classification of active Galactic nuclei (AGN). We believe that tools and services of this nature will become increasingly necessary for data-intensive astronomy (and indeed all sciences) in the twenty-first century.

Additional Information

© 2012 Springer Science+Business Media New York. First Online: 05 June 2012. The DAME Web application was funded in part by the Italian Ministry of Foreign Affairs through bilateral projects between Italy and the USA and by the Italian Ministry of Education, Universities, and Research through the PON 1575 S.Co.P.E. SGD and CD acknowledge partial support through NASA Grant 08-AISR08-0085, NSF Grants AST-0834235 and AST-0909182, and the Fishbein Family Foundation. We thank numerous collaborators for many interesting discussions on these and related issues over the years.

Additional details

Created:
August 19, 2023
Modified:
January 14, 2024