Apache Airflow is an open-source workflow management platform for data engineering pipelines.
Today we will see how we can deploy very easily Apache Airflow on a Compute instance in Oracle Cloud Infrastructure (OCI) using MySQL HeatWave Database Service (MDS).
I am sharing Terraform modules you can use to deploy in your architecture:
With the modules you can deploy architectures like these:
with a single MDS instancewith MDS High Availabilitywith HeatWave Cluster
We will use the exact same modules built into a stack for OCI’s Resource Manager. This will allow us to deploy the architecture just in few clicks.
We open in a browser the following GitHub repository: …[Read more]