Application of FuncX for Training and Validation of Deep Learning (BiLSTM) models

I am a CS Masters student at University of Illinois. I, along with my class project team, used FuncX to complete a final project for CS598, Deep Generative & Dyn. Models. I also work as a graduate research assistant on the FuncX project and configured a funcX endpoint on NCSA’s Delta GPU High Performance Computer. I secured the endpoint with a Globus Group and invited my teammates to support model training. Problem Statement Description: We...

Using FuncX to execute Artificial Neural Networks on Remote Industrial Edge Resources: An application for fish processing industries

Within the climate change agenda, research studies report that 15% of global energy is consumed by operations related to refrigeration and air conditioning in the fish industry, which highlights the need for smart energy management solutions. While fish processing industries have high energy costs with continuous refrigeration, air conditioning, and ice making processes, there is a real need to analyse and model energy use. One solution that can be applied to optimize energy use in...

Interacting with a Running FuncX Instance

This short report is an addendum to the report “A Look at Parsl and FuncX: Two Excellent Parallel Scripting Tools for Clouds and Supercomputers.” At the conclusion of that report it was stated that one of the missing pieces of our analysis was a description of how distributed FuncX function instances can communicate with other objects to handle remote interactions or to process streaming data. Here is another way to state the problem. FuncX gives...

A Look at Parsl and Funcx: Two Excellent Parallel Scripting Tools for Clouds and Supercomputers

In 2019, Yadu N Babuji, Anna Woodard, Zhuozhao Li, Daniel S. Katz, Ben Clifford, Rohan Kumar, Lukasz Lacinski, Ryan Chard, Justin Michael Joseph Wozniak, Michael Wilde and Kyle Chard published a paper in HPDC ’19 entitled Parsl: Pervasive Parallel Programming in Python. I have been looking forward to finding the time to dig into it and give it a try. The time did arrive and, as I started to dig, I discovered some of this...