The Astronomer Blog: Data Orchestration Insights & Guides

December 1, 2023

Enhanced Authentication Security to your Data Services on Azure with Astro

Experience advanced authentication with Apache Airflow®™ on Astro, the Azure Native ISV Service. Securely orchestrate data pipelines using Entra ID. Follow our step-by-step guides and leverage open-source contributions for a seamless deployment experience.

November 28, 2023

Accelerating ML Application Development: Production-Ready Airflow Integrations with Critical AI Tools

Build production-ready ML applications with Airflow's integrations for LLMs and AI.

November 15, 2023

Introducing Apache Airflow® on Astro – an Azure Native ISV Service

Introducing Apache Airflow® on Astro, an Azure Native ISV Service. This partnership with Microsoft seamlessly embeds Apache Airflow® into the Azure ecosystem, offering a unified environment for scalable, secure, and easy-to-manage mission-critical data pipelines.

November 2, 2023

Apache Airflow® TaskFlow API vs. Traditional Operators: An In-Depth Comparison for Efficient DAGs

Explore the TaskFlow API and traditional operators and find out how to combine them for dynamic, efficient DAGs.

October 31, 2023

Orchestrating Feature Pipelines: Announcing the Tecton Airflow Provider

See how the new Tecton Airflow Provider can make your feature pipeline orchestration within Apache Airflow® more efficient.

October 24, 2023

Ask Astro: Operationalizing Data Ingest for Retrieval Augmented Generation with LLMs, Part 3

Data ingestion for RAG with LLMs: Ask Astro Part 3 covers vector stores, schema design, and chunking.

October 12, 2023

Using Astronomer’s new Cosmos to deploy dbt pipelines onto Snowflake

The state of deploying pipelines with dbt has changed considerably in the last few months. Over the last few weeks, I was working with Astronomer to test out their new tool, Cosmos, to deploy dbt workflows onto Snowflake.

October 11, 2023

Databricks vs. Airflow From a Management Perspective, Part 2

Databricks vs Airflow from a production management perspective. Explore the differences in setup, monitoring, integrations, scalability & customization.

October 10, 2023

ML for Customer Analytics with Airflow, Snowpark, and Weaviate

An example project showing how to use Apache Airflow® to orchestrate a machine learning pipeline with the Snowpark provider and Snowpark ML.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.