Observatory Archives in the Era of Big Data: Perspectives from the Spitzer Mission
- Creators
-
Storrie-Lombardi, Lisa J.
Abstract
Community Observatory archives, supporting disparate data sets, have traditionally been fundamentally different than homogeneous survey archives. Technological advances in the past decade, particularly with respect to the ease of connectivity, are blurring the lines between observatory archives and large sky surveys. Archives are no longer monolithic repositories of data but instead are portals for data and services as part of the broader scientific landscape. If starting today we would approach the Spitzer archive design with a very different mindset than we did fifteen years ago. We discuss here (1) design lessons learned and the evolution of the archive, (2) the benefits of having the Spitzer archive as a component of IRSA, (3) the value of serving enhanced data sets that are returned to the archive by science teams, and (4) the benefits of connectivity to large survey archives, now and in the future.
Additional Information
© 2017 Astronomical Society of the Pacific. The author thanks all of the dedicated scientists and software developers that have contributed to creating the Spitzer and IRSA archives.Attached Files
Published - 512-0029.pdf
Files
| Name | Size | Download all |
|---|---|---|
|
md5:8cfe264e35d9d2056246e953d734ae55
|
1.0 MB | Preview Download |
Additional details
- Eprint ID
- 89603
- Resolver ID
- CaltechAUTHORS:20180913-074908897
- Created
-
2018-09-13Created from EPrint's datestamp field
- Updated
-
2019-10-03Created from EPrint's last_modified field
- Caltech groups
- Infrared Processing and Analysis Center (IPAC)
- Series Name
- Astronomical Society of the Pacific Conference Series
- Series Volume or Issue Number
- 512