Shannon sampling and nonlinear dynamics on graphs for representation, regularization and visualization of complex data
- Creators
- Pesenson, M.
- McCollum, B.
- Pesenson, I.
- Byalsky, M.
- Others:
- Radziwill, Nicole M.
- Bridger, Alan
Abstract
Data is now produced faster than it can be meaningfully analyzed. Many modern data sets present unprecedented analytical challenges, not merely because of their size but by their inherent complexity and information richness. Large numbers of astronomical objects now have dozens or hundreds of useful parameters describing each one. Traditional color-color plots using a limited number of symbols and some color-coding are clearly inadequate for finding all useful correlations given such large numbers of parameters. To capitalize on the opportunities provided by these data sets one needs to be able to organize, analyze and visualize them in fundamentally new ways. The identification and extraction of useful information in multiparametric, high-dimensional data sets - data mining - is greatly facilitated by finding simpler, that is, lower-dimensional abstract mathematical representations of the data sets that are more amenable to analysis. Dimensionality reduction consists of finding a lower-dimensional representation of high-dimensional data by constructing a set of basis functions that capture patterns intrinsic to a particular state space. Traditional methods of dimension reduction and pattern recognition often fail to work well when performed upon data sets as complex as those that now confront astronomy. We present here our developments of data compression, sampling, nonlinear dimensionality reduction, and clustering, which are important steps in the analysis of large-scale, complex datasets.
Additional Information
© 2010 SPIE. This work was carried out with funding from the National Geospatial-Intelligence Agency University Research Initiative (NURI), grant HM1582-08-1-0019, and support from NASA to the California Institute of Technology and the Jet Propulsion Laboratory.Attached Files
Published - Pesenson2010p13422Adaptive_Optics_Systems_Pts_1-3.pdf
Files
Name | Size | Download all |
---|---|---|
md5:d9806477a2acb12eaeabd72254976e4f
|
2.2 MB | Preview Download |
Additional details
- Eprint ID
- 23415
- Resolver ID
- CaltechAUTHORS:20110421-141738847
- HM1582-08-1-0019
- National Geospatial-Intelligence Agency
- NASA/JPL/Caltech
- Created
-
2011-05-11Created from EPrint's datestamp field
- Updated
-
2021-11-09Created from EPrint's last_modified field
- Series Name
- Proceedings of SPIE
- Series Volume or Issue Number
- 7740