Astronomer, the company behind Astro, the leading data orchestration and observability platform powered by Apache Airflow, is unveiling the private preview of Astro Observe, a capability designed to let users set and track SLAs to ensure on-time delivery of quality data. By offering an actionable view of the data supply chain and extending the power of Astronomer to data operations, Astro Observe empowers enterprises to build, run, and observe data pipelines as code with ease.
From data’s humble beginnings as the fuel for basic internal dashboards, its evolution as a complex product which drives mission-critical use cases highlights the crucial importance of data orchestration. Furthermore, visibility into data orchestration processes acts as a key enabler of true, tangible data value.
To unite observability and orchestration within a single platform, Astro Observe employs the OpenLineage framework to make data pipelines observable through automatic information collection and correlation. Now, Astronomer offers a single destination for organizations to orchestrate, manage, and monitor pipelines, creating a centralized view for teams to quickly assess and make decisions about their project management.
"Data products have become just as business-critical as software products, and any failure can have an outsized impact on revenue and reputation," said Julian LaNeve, CTO, Astronomer. "Astro Observe unifies orchestration and observability across the full data stack on a single platform, meaning the reliability and trust of data products are improved, development velocity is increased, costs are lowered, mission-critical SLAs are respected, and critical data assets are better secured. We want to give data teams the same operational rigor as software teams."
With Astro Observe, enterprise teams can:
- Assign data product owners, set policies, and monitor thresholds for data freshness and deliver times through the SLA dashboard
- Leverage a dependency graph that illustrates upstream and downstream relationships across data products for greater context regarding issue resolution and compliance
- Adhere to best practices from Airflow via a recommendation engine that, through a comprehensive view of deployments, delivers actionable recommendations for enhancing trust and data product reliability
- Pinpoint and understand risk before data product delivery is impacted with predictive alerting, offering the time and context necessary to remediate and adjust across the stack
To learn more about Astro Observe, please visit https://www.astronomer.io/.