Summary
Keywords
Full Transcript
Airflow Hooks S3 PostgreSQL: Airflow Tutorial P13 #Airflow #AirflowTutorial #Coder2j ========== VIDEO CONTENT π ========== Today I am going to show you how to use hooks to query data from Postgres DB, then upload it to the AWS S3 Bucket. By watching this video, you will know: π What is the Airflow hook π How to use the hook to query data from DB π How to use the hook to upload a file into S3 π How to keep your project folder clean by NamedTemporaryFile Video Request: https://forms.gle/UMp4GA3krcSMMWzy9 ========== L I N K S π ========== Airflow Documentation π https://bit.ly/3wbTqv4 Orders.csv π https://github.com/coder2j/airflow-docker/blob/main/data/Orders.csv ========== T I M E S T A M P β° ========== 00:00 - Load csv into Postgresql DB 02:23 - PostgreSQL hooks - query data 09:00 - Dynamic SQL query with Airflow maros 11:44 - AWS S3 hooks - upload local file into S3 15:45 - Keep project folder clean by Namedtemporaryfile ========== Connect with me π ========== Twitter π https://twitter.com/Coder2j Website π https://coder2j.com GitHub π https://github.com/coder2j
