Description
In this course, you will learn :
- Coding Production-Grade Data Pipelines Using Hands-On Examples of Airflow
- How to Use Apache Airflow Best Practices
- Scaling Airflow with Local, Celery, and Kubernetes Wxecutors
- How to Configure Monitoring Using Elasticsearch and Grafana
- How to Secure Airflow Using Authentication, Cryptography, and the RBAC UI Core and Advanced Concepts with Benefits and Drawbacks
- Timezones, unit testing, backfill, and catchup: mastering DAGs
- Organizing and cleaning up the DAG folder
Syllabus :
- The basics of Apache Airflow
- The Forex Data Pipeline
- Mastering your DAGs
- Distributing Apache Airflow
- Improving your DAGs with advanced concepts
- Deploying Airflow on AWS EKS with Kubernetes Executors and Rancher
- Monitoring Apache Airflow
- Security in Apache Airflow
- Airflow 2.0