Introducing Apache Airflow® 3.0
Be among the first to see Airflow 3.0 in action and get your questions answered directly by the Astronomer team.
Astronomer Webinars
Join us for upcoming online events!
Optimizing your Airflow Developer Experience: Exploring DAG Versioning and Backfills
Explore how new features in Airflow 3.0, including DAG versioning and backfills, can improve your productivity and help you manage your pipelines more efficiently. Whether you are an experienced Airflow user or just getting started, you’ll learn how to quickly troubleshoot and manage your pipeline history.
New in Airflow 3.0: Data Assets and Event-Driven Scheduling Deep Dive
Learn how Airflow 3.0 is expanding on assets, the foundational datasets feature, by introducing asset watchers, the most powerful option for event-driven scheduling in Airflow to date
Airflow 3.0 Security Enhancements: Remote Execution and Task Isolation Deep Dive
In this session, we’ll break down these architectural changes and show you how to use these new features to run your tasks anywhere
Watch Recorded Webinars On-Demand
Using Airflow as a Data Analyst
A data analyst’s workflow typically involves ingesting and transforming data and Airflow is the perfect tool to orchestrate analytics workflows.
OpenLineage and Airflow: A Deeper Dive
Data lineage is the complex set of relationships between your jobs and datasets. Using OpenLineage with Apache Airflow®, you can observe and analyze these relationships, allowing you to find and fix issues more quickly. This webinar will provide a deeper dive on OpenLineage, extending beyond the basics into key implementation details and best practices.
Improve Your DAGs with Hidden Airflow Features
Apache Airflow® is flexible and powerful. It has a rich ecosystem and an incredibly active community. But are you sure you haven’t missed anything? A new feature or concept that could put your DAGs at another level? It can be challenging to keep up with the latest Airflow features, and sometimes we miss the most useful ones. For this webinar, I'd like to introduce you to a couple of lesser-known features of Apache Airflow® that can dramatically improve your data pipelines.
Scaling Out Airflow
Learn about the process of scaling out Airflow with Celery and Kubernetes Executor and the parameters that need to be tuned when adding nodes to Airflow.
Data Quality Use Cases with Airflow and Great Expectations
At this webinar, Benji Lampel (Enterprise Platform Architect @ Astronomer) and Tal Gluck (Software Engineer @ Superconductive) will present several Airflow DAGs using Great Expectations that cover more advanced DAG patterns and data quality checking cases.
The Airflow API
Learn about Airflow’s fully stable REST API. Find out how to use it and why it’s a great tool for managing and monitoring data pipelines.
Introducing Astro: Data Centric DAG Authoring
Learn about Astro, a new DAG writing experience brought by Astronomer. See how we’re taking Airflow 2.0 and the concept of providers to the next level.
Data Lineage with OpenLineage and Airflow
If one out of your hundreds of DAGs fails, how do you know which downstream datasets have become out-of-date? The answer is data lineage. Data lineage is the complex set of relationships between your jobs and datasets. In this webinar, you'll learn how to use OpenLineage to collect lineage metadata from Airflow and assemble a lineage graph - a picture of your pipeline worth way more than a thousand words.
Best Practices for Writing DAGs in Airflow 2
Because Airflow is 100% code, knowing the basics of Python is all it takes to get started writing DAGs. However, writing DAGs that are efficient, secure, and scalable requires some Airflow-specific finesse. In this webinar, you’ll learn the best practices for writing DAGs that will ensure you get the most out of Airflow. We’ll include a reference repo with DAGs you can run yourself with the Astro CLI.
