Proposal review rankings: the influence of reviewer discussions on proposal selection
Abstract
The telescope time allocation process for NASA's Great Observatories involves a substantial commitment of time and expertise by the astronomical community. The annual review meetings typically have 100 external participants. Each reviewer spends 3-6 days at the meeting in addition to one-two weeks of preparation time, reading and grading proposals. The reviewers grade the proposals based on their individual reading prior to the meeting and grade them again after discussion within the broad, subject-based review panels. We summarize here how the outcome of the review process for three Spitzer observing cycles would have changed if the selection had been done strictly based on the preliminary grades without having the panels meet and discuss the proposals. The changes in grading during the review meeting have a substantial impact on the final list of selected proposals. Approximately 30% of the selected proposals would not have been included if just the preliminary rankings had been used to make the selection.
Additional Information
© 2008 International Society for Optical Engineering.Attached Files
Published - 701622_1.pdf
Files
Name | Size | Download all |
---|---|---|
md5:da21fa88ff6e58c8647fe3f74574e561
|
1.1 MB | Preview Download |
Additional details
- Eprint ID
- 75341
- Resolver ID
- CaltechAUTHORS:20170323-071327576
- Created
-
2017-03-23Created from EPrint's datestamp field
- Updated
-
2021-11-15Created from EPrint's last_modified field
- Caltech groups
- Infrared Processing and Analysis Center (IPAC)
- Series Name
- Proceedings of SPIE
- Series Volume or Issue Number
- 7016