Robert Rees - Interactive data wrangling смотреть онлайн

Robert Rees a development manager at the Guardian and former startup CTO and ThoughtWorks consultant. He got started in software development as a tester and courtesy of a very flaky system, had enough free time to learn C and switch careers to software development. From there he learnt that software delivery is really a question of working effectively together on the right idea rather than being the application of technology.

"At some point every developer needs to handle data: to answer non-technical people’s questions, figure out what is actually happening with a system or simply to automate a job that would be too time-consuming to do by hand. Recently I wanted to generate a dataset for some colleagues that required cross-referencing primary keys from an SQL database with the result of a HTTP API call, then applying a transformation on the combined result and writing just the information needed to a file."

"Using Clojure made the job easy because as a general programming language it can be a HTTP client, interact with the file system and quickly process in-memory data. As a bonus its REPL allowed me to play around with individual pieces of data in an ad-hoc way or write a tested function and load it into my current session."

"Playing around awkward sized, multi-platform data has never been so easy! So let me walk you through the problem and the open-source code I wrote to solve my problems. I’ll also introduce any key Clojure syntax I use along the way so if you’re interested in data wrangling but don’t know Clojure you’ll be okay."