The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
- Creators
- Förster, F.
- Cabrera-Vives, G.
- Castillo-Navarrete, E.
- Estévez, P. A.
- Sánchez-Sáez, P.
- Arredondo, J.
- Bauer, F. E.
- Carrasco-Davis, R.
- Catelan, M.
- Elorrieta, F.
- Eyheramendy, S.
- Huijse, P.
- Pignata, G.
- Reyes, E.
- Reyes, I.
- Rodríguez-Mancini, D.
- Ruz-Mieres, D.
- Valenzuela, C.
- Álvarez-Maldonado, I.
- Astorga, N.
- Borissova, J.
- Clocchiatti, A.
- De Cicco, D.
- Donoso-Oliva, C.
- Hernández-García, L.
- Graham, M. J.
- Jordán, A.
- Kurtev, R.
- Mahabal, A.
- Maureira, J. C.
- Muñoz-Arancibia, A.
- Molina-Ferreiro, R.
- Moya, A.
- Palma, W.
- Pérez-Carrasco, M.
- Protopapas, P.
- Romero-Wolf, M.
- Sabatini-Gacitua, L.
- Sánchez, A.
- San Martín, J.
- Sepúlveda-Cobo, C.
- Vera, E.
- Vergara, J. R.
Abstract
We introduce the Automatic Learning for the Rapid Classification of Events (ALeRCE) broker, an astronomical alert broker designed to provide a rapid and self-consistent classification of large etendue telescope alert streams, such as that provided by the Zwicky Transient Facility (ZTF) and, in the future, the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). ALeRCE is a Chilean-led broker run by an interdisciplinary team of astronomers and engineers working to become intermediaries between survey and follow-up facilities. ALeRCE uses a pipeline that includes the real-time ingestion, aggregation, cross-matching, machine-learning (ML) classification, and visualization of the ZTF alert stream. We use two classifiers: a stamp-based classifier, designed for rapid classification, and a light curve–based classifier, which uses the multiband flux evolution to achieve a more refined classification. We describe in detail our pipeline, data products, tools, and services, which are made public for the community (see https://alerce.science). Since we began operating our real-time ML classification of the ZTF alert stream in early 2019, we have grown a large community of active users around the globe. We describe our results to date, including the real-time processing of 1.5 × 10⁸ alerts, the stamp classification of 3.4 × 10⁷ objects, the light-curve classification of 1.1 × 10⁶ objects, the report of 6162 supernova candidates, and different experiments using LSST-like alert streams. Finally, we discuss the challenges ahead in going from a single stream of alerts such as ZTF to a multistream ecosystem dominated by LSST.
Additional Information
© 2021. The American Astronomical Society. Received 2020 June 29; revised 2021 February 22; accepted 2021 February 25; published 2021 April 27. This work was funded by ANID—Millennium Science Initiative Program—ICN12_009 awarded to the Millennium Institute of Astrophysics MAS (A.C., A.M., A.M.A., A.S., C.S.C., C.D.O., C.V., D.D.C., D.R.Ma., D.R.Mi., E.C.N., E.R., F.E., F.E.B., F.F., G.C.V., G.P., I.A.M., I.R., J.A., J.B., J.R.V., L.H.G., L.S.G., M.C., M.P.C., N.A., P.A.E., P.H., P.S.S., R.C.D., S.E., R.K., and W.P.), and National Agency for Research and Development (ANID) grants: Basal Center for Mathematical Modeling grant CMM ANID PIA AFB170001 (A.M., A.M.A., C.V., C.S.C., E.C.N., E.V., D.R.Ma., D.R.Mi., F.F., I.A.M., I.R., J.C.M., J.S.M., L.S.G., and P.A.E.); Centro de Astrofísica y Tecnologías Afines AFB-170002 (D.D.C., F.E.B., M.C., P.S.S., and A.C.); FONDECYT Regular Nos. 1200710 (F.F.), 1190818 (F.E.B.), 1200495 (F.E.B.), 1171273 (M.C.), 1201793 (G.P.), and 1171678 (P.A.E.); FONDECYT Iniciacion Nos. 11200590 (F.E.) and 11191130 (G.C.V.); FONDECYT Postdoctorado Nos. 3200250 (P.S.S.) and 3200222 (D.D.C.); Magister Nacional 2019 No. 22190947 (E.R.); and ANID infrastructure funds QUIMAL140003 and QUIMAL190012. We acknowledge support from REUNA Chile, which hosts and maintains some of our infrastructure. This work has been possible thanks to the use of AWS-U.Chile-NLHPC credits. This work was funded in part by project CORFO 10CEII-9157 Inria Chile. Powered@NLHPC: This research was partially supported by the supercomputing infrastructure of the NLHPC (ECM-02). This project was supported by the Competition for Research Regular Projects, year 2019, code LPR19-22, Universidad Tecnológica Metropolitana and the high-performance computing system of PIDi-UTEM (SCC-PIDi-UTEM—CONICYT—FONDEQUIP—EQM180180). Software: Aladin (Bonnarel et al. 2000), Apache ECharts, 36 Apache Kafka, 37 Apache Spark (Zaharia et al. 2016), ASTROIDE (Brahem et al. 2018), Astropy (Astropy Collaboration et al. 2013), catsHTM (Soumagnac & Ofek 2018), Dask (Rocklin 2015), FATS (Nun et al. 2017), Grafana, 38 Imbalanced-learn (Lemaître et al. 2017), ipyladin (Boch & Desroziers 2020), Jupyter (Kluyver et al. 2016), Keras (Gulli et al. 2017), Matplotlib (Hunter 2007), NED (Steer et al. 2017), P4J (Huijse et al. 2018), Pandas (McKinney et al. 2010), Prometheus, 39 Python (Van Rossum & Drake 1995), scikit-learn (Pedregosa et al. 2011), Simbad-CDS (Wenger et al. 2000), Tensorflow (Abadi et al. 2016), Vue, 40 Vuetify, 41 PostgreSQL, 42 XGBoost. 43Attached Files
Published - Forster_2021_AJ_161_242.pdf
Submitted - 2008-03303.pdf
Files
Name | Size | Download all |
---|---|---|
md5:91092bee7325834e94a7eae9f73c9d59
|
6.2 MB | Preview Download |
md5:632dd0a063e58529864a163831916ea6
|
4.7 MB | Preview Download |
Additional details
- Eprint ID
- 108930
- Resolver ID
- CaltechAUTHORS:20210503-115703881
- ICN12_009
- Millennium Institute of Astrophysics (MAS)
- AFB-170001
- BASAL-CATA
- AFB-170002
- BASAL-CATA
- 1200710
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 1190818
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 1200495
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 1171273
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 1201793
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 1171678
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 11200590
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 11191130
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 3200250
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 3200222
- Fondo Nacional de Desarrollo Científico y Tecnológico (FONDECYT)
- 22190947
- Magster Nacional 2019
- QUIMAL140003
- Agencia Nacional de Investigación y Desarrollo (Chile)
- QUIMAL190012
- Agencia Nacional de Investigación y Desarrollo (Chile)
- REUNA Chile
- CORFO 10CEII-9157
- Centre Inria Chile
- Created
-
2021-05-06Created from EPrint's datestamp field
- Updated
-
2023-10-03Created from EPrint's last_modified field