Description
In this course, you will :
- How to Set Up a Production Ready Architecture for Airflow on AWS EKS
- How to Use Git to Deploy DAGs (public and private)
- How to Use AWS CodePipeline Deploy DAGs to Create CI/CD Pipelines
- How to Use AWS EFS to Share DAGs and Store Logs
- How to Enable AWS S3 Remote Logging in EKS
- How to Put your DAGs to the Test in CI/CD Pipelines
- How to Use AWS Secret Manager to Store Sensitive Data
Syllabus :
- Introduction
- Configuring AWS
- Exploring the DevOps world
- Creating the EKS cluster with GitOps
- Deploying Airflow with DAGs
- Building CI/CD pipelines to deploy Airflow
- Exposing the Airflow UI
- Logging with Airflow in AWS EKS
- Configuring the production environment