Scalable FAIR Analysis of Heterogeneous Data Streams       

The core of AMPEL is a general platform for the analysis of stream-based data, with a focus on scalability, reproducibility and end-to-end provenance. AMPEL was originally developed to solve challenges in the context of high-throughput astronomical observatories, and astronomy-specific modules are maintained within the AmpelAstro project. A live instance hosted at DESY Zeuthen provides a public broker service for time-domain astronomy, with streams from the Zwicky Transient Facility (currently) and the Vera C. Rubin Observatory LSST (upcoming).

For Rubin/LSST, alert processing is organized into science channels that produce curated streams of transient reports for rapid discovery and follow-up. Users can explore these LSST channel streams and access the underlying Kafka topics (e.g. via Hopskotch) using Ampel-Access, which supports subscribing, caching, filtering, and interactive visualization of report sets. The links below provide an overview of LSST streams and a general entry point for working with AMPEL.