Using GCP and Docker for Schedule Based Go Scripts

Timestamp:
00:00 Introduction and Bio
01:44 Set the Stage
03:03 Web Scrapper
04:45 Web Scrapper: Code Time
04:59 Web Scrapper: Vim
09:38 Web Scrapper: Pull Weekly Report
10:30 Cron Job
13:28 Cron Job: Step 1
15:36 Cron Job: Step 2
16:05 Cron Job: Step 3
18:06 Cron Job: Step 4
20:48 Cron Job: Step 5
24:41 Hurdles
20:10 Summary
32:14 Q1 Creds in docker image: security issue?
34:11 Q2 Why did you run a http service a not simplify a http client scrape and save?
37:09 Q3 How much does it cost to run?

This event is brought to you by Go Singapore. GoSG is a meetup for the Go programming enthusiasts in Singapore.

Name: Miriah Peterson (Data Engineer, Weave)
Topic: Using GCP and Docker for Schedule Based GO Scripts

Sometimes we need our apps to run via Cron style scheduling. In this talk we will explore using Cloud Run and docker images to run a cron style go app.

Currently a Data Engineer at Weave in Lehi, Utah, Miriah focuses on scaling data infrastructure platforms and pipelines.

Sharing knowledge and experiences is a focus Miriah’s career. She has given many talks on machine learning, data engineering, and data architecture strategy. Additionally she works in the community as a board member for the Forge Foundation Inc and organizer of GoWest Conference, WomenWhoGo Utah meetup, and Machine Learning Utah meetup.

*

For more updates on upcoming events, follow us on social media:
✉️ Newsletter → https://goo.gle/devspace-news
? Facebook → https://www.facebook.com/DevSpaceSG/
? Twitter → https://twitter.com/DevSpaceSG
? Meetup →https://www.meetup.com/developer-space/