?The Ultimate Guide to Continuous Release Process with GitHub Webhook & AWS ??

In this comprehensive video, we dive deep into the world of continuous release processes using the power of GitHub Webhook and AWS services.

Prerequisite:
-----------------------
Build a Github Webhook handler with API Gateway & AWS Lambda
https://youtu.be/r5hrcaqbqL8
Lambda function URLs | Trigger Lambda Function from Github events directly without API Gateway
https://youtu.be/HhIWXiTQAKk
From Poll to Push: Revolutionize Your Data Architecture with Airflow and Lambda
https://youtu.be/mntTQPtupck

Airflow Dag for Git Pull:
-----------------------------------------
import logging
import airflow
from airflow import DAG
from airflow.operators.python_operator import PythonOperator
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta
logging.basicConfig(level=logging.INFO)
logger = logging.getLogger(__name__)


args = {"owner": "Airflow", "start_date": airflow.utils.dates.days_ago(2)}

dag = DAG(
dag_id="code_sync", default_args=args, schedule_interval=None
)

with dag:
code_sync=BashOperator(
task_id="git_pull_activity",
bash_command="cd /home/ubuntu/githubtest; git pull",
)

code_sync

Other Dummy Dag Codes used in the video:
-------------------------------------------------------------------------
import logging
import airflow
from airflow import DAG
from airflow.operators.python_operator import PythonOperator
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta
logging.basicConfig(level=logging.INFO)
logger = logging.getLogger(__name__)


args = {"owner": "Airflow", "start_date": airflow.utils.dates.days_ago(2)}

dag = DAG(
dag_id="Hello_World", default_args=args, schedule_interval=None
)

def helloWorld():
print('Hello World 2nd example')

with dag:
hello_world=PythonOperator(
task_id='Hello_World',
python_callable=helloWorld,
dag=dag,
)

hello_world

Check this playlist for more Data Engineering related videos:
https://youtube.com/playlist?list=PLjfRmoYoxpNopPjdACgS5XTfdjyBcuGku

Apache Kafka form scratch
https://youtube.com/playlist?list=PLjfRmoYoxpNrs0VmIq6mOTqXP52RfZdRf

Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
https://doc.clickup.com/37466271/d/h/13qc4z-104/d4346819bd8d510

????????
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY YOUTUBE CHANNEL