Task queue Celery with Django – Network programmability stream 37 смотреть онлайн

The recording of the network programmability stream which occurred on 2018/01/13

On this stream I explored using task queue Celery with Django. This allows you to off-load long-running tasks to another system and not block your web workers.

Timecode:
0:00 – Introduction
3:15 – Announcements/news
12:12 – Intro to tasks queues, its use-cases, Celery. My experience
15:04 – My experience with Celery
18:52 – My horror story with Celery
26:25 – Good articles about Celery (I recommend to read them when you deploy it to production)
28:30 – Celery architecture
38:26 – Preparing dev environment
57:32 – Writing docker-compose for web app, Celery and redis
1:03:30 – Using Celery with Django
2:13:50 – Convert blocking task inside request-response cycle to Celery background task (Demo 2:26:00)
2:30:15 – Adding API endpoint to query task result
2:45:26 – Conclusions, summary and wrap-up

Resources:
Celery docs: http://docs.celeryproject.org/en/latest/

Please note that this content is stream-first and it is slow-paced by design. I recommend increasing playback speed in the player settings.

Don't miss my upcoming streams at https://twitch.tv/dmfigol
The code is on my GitHub: https://github.com/dmfigol/network-programmability-stream

Twitter: https://twitter.com/dmfigol
Blog: https://dmfigol.me

Background music (royalty-free):
https://www.pretzel.rocks/