Summary
Keywords
Full Transcript
Airflow Python Operator and XCom: Airflow Tutorial P6 #Airflow #AirflowTutorial #Coder2j ========== VIDEO CONTENT 📚 ========== Today I am going to show you how to use Airflow PythonOperator and XComs. By watching this video, you will know: 👉 How to run a python function as a task using the python operator 👉 How to pass parameters to the python function 👉 How to share values between different tasks using Xcoms Video Request: https://forms.gle/UMp4GA3krcSMMWzy9 You don't have a running Airflow in your local setup? Check out the Apache Airflow 2.0 Installation Tutorials. Run Airflow locally 👉 https://youtu.be/z7xyNOF8tak Run Airflow in Docker 👉 https://youtu.be/J6azvFhndLg ========== L I N K S 🔗 ========== GitHub Repo 👉 https://bit.ly/3HD5oTX Airflow Documentation 👉 https://bit.ly/3wbTqv4 ========== T I M E S T A M P ⏰ ========== 00:00 - Introduction and launch airflow using docker 00:50 - Create a new DAG file 02:40 - Using the python operator to run a python function 03:50 - Pass parameters using op_kwargs 05:10 - How XCom works 07:10 - Push and pull values using XCom 09:18 - Push multiple values using key and value 12:42 - Only share small values via XCom ========== Connect with me 👏 ========== Twitter 👉 https://twitter.com/Coder2j Website 👉 https://coder2j.com GitHub 👉 https://github.com/coder2j
