Chris Brown - Using "Program shaping" and algorithmic skeletons (...) (Lambda Days 2016) смотреть онлайн

"Using "Program shaping" and algorithmic skeletons to parallelise an evolutionary multi-agent system in Erlang"

Slides and more info: http://www.lambdadays.org/lambdadays2016/chris-brown

This paper considers how to use program shaping and algorithmic skele- tons to parallelise a multi-agent system that is written in Erlang. Program shaping is the process of transforming a program to better enable the introduction of paral- lelism. Whilst algorithmic skeletons abstract away the low-level aspects of parallel programming that often plague traditional techniques, it is not always easy to intro- duce them into an arbitrary program, especially one that has not been written with parallelism in mind. Amongst other issues, data may not always be in a compatible format, function calls may need to be replicated to support alternative uses, side- effects may need to be isolated, or there may be dependencies between functions and data that obstruct the introduction of parallelism. Program shaping can be used to transform such code to a form that allows skeletons to be more easily introduced. In this paper, we present a series of generic program shaping rewrite rules, provide their implementation as refactorings, and show how they can used to parallelise an Evolutionary Multi-Agent System (MAS) written in Erlang. We show that we can significantly speed up this application, obtaining super-linear speedups of over 70× the original sequential performance on a 64-core shared-memory machine.