Collect, Process, Visualize - Programming Social Graphs (Instagram, Python, Gephi)

Introduction to network analysis on a real-world example. In this video, we will collect social data from Instagram, process it using Python and then create a graph with Gephi, an open-source graph visualization and exploration tool. I will demonstrate the whole pipeline from start to finish, so that you can easily try out your own data science experiments. In the end, we will see how to use force-directed graph layout algorithms in Gephi and how to run a modularity analysis to visualize community structures (clusters). Join me on this journey and code along ?

? Overview
00:00 Intro
02:40 Collect data from Instagram
06:15 Process data - Disassemble .HAR files
22:06 Process data - Prepare for Gephi (nodes & edges)
29:44 Visualize data in Gephi
38:33 Bonus: Put profile pictures on nodes
48:10 Outro


? You can also find me here:
https://open.spotify.com/artist/5ftAWGcc988kE4Y8nJ1Urm
https://www.instagram.com/splinesmusic/
https://www.facebook.com/splinesmusic
https://soundcloud.com/splinesmusic
https://splines.me


? Want to dive in deeper?
Fast unfolding of communities in large networks (aka "Louvain-Method")
https://arxiv.org/pdf/0803.0476.pdf

Modularity and community structure in networks
https://www.pnas.org/content/pnas/103/23/8577.full.pdf

Maximizing Modularity is hard
https://arxiv.org/pdf/physics/0608255.pdf


? Music

Birocratic - Fresh Healthy Perspectives
https://www.youtube.com/channel/UCrEAQx48oTZy7f9ZWsDawKg

Noir Et Blanc Vie - TrueArtRealAffectionPart4
https://www.youtube.com/channel/UCIUATMnLtNo51kKuv95R1UQ

Aaron Kenny - Cocktail Hour
https://www.youtube.com/channel/UCVAggfwI4hnkA2WO6-xC06Q

E's Jammy Jams - Book Bag

John Deley and the 41 Players - Ersatz Bossa

Kevin MacLeod - Just As Soon
Subject to the Creative Commons "Attribution 4.0" license
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1100185
Artist: http://incompetech.com/

Silent Partner - Bet On It

Twin Musicom - With a Stamp
Subject to the Creative Commons "Attribution 4.0" license
Artist: http://www.twinmusicom.org/

Dan Lebowitz - Wave in the Atmosphere
https://www.youtube.com/channel/UCOg3zLw7St5V4N7O8HSoQRA

Text Me Records / Grandbankss - Soul
https://www.youtube.com/channel/UCvWuOz2bCBzZbrn2CTCyFHg

Ofshane - Sunset n Beachz
https://www.youtube.com/channel/UC34Wh4ysdP50H-ThbZFFfsA

The Brothers Records - Sleeplessness
https://www.youtube.com/channel/UCOoKFMFX1SescccH4LAIeMQ

Rondo Brothers - Man
https://www.youtube.com/channel/UC0xfvt7OZAl2jAg63i1pJBA

Dan Lebowitz - Gimme Back My Ya Ya
https://www.youtube.com/channel/UCOg3zLw7St5V4N7O8HSoQRA

Text Me Records / Social Work - Puffs
https://www.youtube.com/channel/UCOQyfUmWPaf5uA40I0Zrn2A

Chris Haugen - Fresh Fallen Snow
https://www.youtube.com/channel/UCNXDIltPLbdcAavUtL00i7g

Asher Fulero - Night Snow
https://www.youtube.com/channel/UCKn6_1iFFC5fxSmFgVC9Fsw/

Public Memory - Landing
https://www.youtube.com/channel/UCT5LDJ8VYAKfY2e8dExo2Cw