“Workflows Community Initiative & PSI/J Python Reference Implementation” | Python Exchange 5-31-23

Join the Python Exchange Mailing List:
https://mailchi.mp/d4206414de7c/python-exchange-for-doe
Learn more here: https://meetup.doepy.org/

Abstract
Scientific workflows are critical tools in modern scientific computing, enabling the orchestration of large and complex experiments that span multiple facilities and computational resources. The Workflows Community Initiative (https://workflows.community) is a collaborative effort aimed at advancing the state-of-the-art in workflow systems and related technologies.
The initiative brings together researchers, developers, and practitioners to foster communication and collaboration on important issues related to workflow management, including workflow design, execution, monitoring, optimization, and interoperability. As part of the DOE ECP’s ExaWorks project, we have defined PSI/J (Portable Submission Interface for Jobs), a simple and portable interface for submitting jobs to distributed computing resources, regardless of their underlying architecture or middleware. Our Python-based reference PSI/J implementation supports a range of job submission types, including batch jobs, parallel jobs, and interactive jobs.

Bio
Rafael Ferreira da Silva is a Senior Research Scientist in the National Center for Computational Sciences (NCCS) at the Oak Ridge National Laboratory (ORNL), where he also serves as the Executive Director of the Workflows Community Initiative. With a strong research focus on the efficient and resilient execution of large-scale scientific workflow applications on heterogeneous distributed systems, as well as the modeling and simulation of parallel and distributed computing systems, Dr. Ferreira da Silva has led and contributed to numerous large-scale projects related to distributed computing platforms, cyberinfrastructure systems, and applications. Dr. Ferreira da Silva's expertise also extends to community engagement and workshop organization. He has served as the principal investigator on several U.S. DOE- and NSF-funded projects, and his scholarly work includes over 100 peer-reviewed journal articles, conference proceedings articles, book chapters, editorials, and conference abstracts. Dr. Ferreira da Silva is a member of the Association for Computing Machinery (ACM), and a Senior Member of the Institute of Electrical and Electronics Engineers (IEEE). For more information about his work and accomplishments, please visit https://rafaelsilva.com.