Scalable Machine Learning With Apache Ignite, Python, And Julia: From Prototype To Production

Apache Ignite incorporates a scalable, efficient machine learning (ML) framework that enables data transformation, ML model training, and inference on Apache Ignite nodes (without data leaving the cluster). However, sometimes scalability in regard to data size and data-transfer cost is not as important as scalability in regard to the number of parallel requests and the ability to use the external, more sophisticated models that are implemented in Python and Julia.
In this talk, Peter Gagarinov shares his experience with integrating Apache Ignite with external machine Peter frameworks. Using an ML-based, automated issue-management system (Alliedium) as an example, Peter shows how the business task of building a distributed and scalable service can be efficiently performed by relying on Apache Ignite and ML frameworks from Python and Julia ecosystems. In the second part of his talk, Peter presents a lightweight Apache Ignite data migration tool that was developed in-house for the needs of Alliedium.

Peter Gagarinov: Peter is a passionate open-source enthusiast who focuses on machine learning and distributed computational systems. Peter dedicates his time to working as a consultant for various projects and as a product manager and software architect at Alliedium. Alliedium builds and offers an ML-based, automated issue-management system and provides a defect-classification and bug-triaging service for Atlassian Jira. Peter has devoted 18 years to software development, architecture, machine learning, and applied mathematical modeling for financial and electricity markets.