This tutorial will focus on providing attendees exposure to state-of-the-art techniques for portable, reproducible research computing, enabling them to easily transport analyses from cloud to HPC resources. We will introduce open source technologies such as Jupyter, Docker and Singularity, the emerging "serverless" computing paradigm, and how to utilize these tools within two NSF-funded cyberinfrastucture platforms, Tapis API (formerly Agave API) and Abaco API. The approaches introduced not only increase application portability and reproducibility but also reduce or eliminate the need for investigators to maintain physical infrastructure so that more time can be spent on analysis. For the tutorial, attendees will have access to allocations on XSEDE JetStream and one or more HPC resources such as TACC’s Stampede2 or Frontera.
Target Audience: This tutorial is targeted to CI professionals and researchers that are interested in learning to use container technologies for research computing, and leveraging national cyberinfrastructure platforms to execute containerized compute jobs on cloud and HPC resources.
Content Level: Beginner 70%, Intermediate 30%
Prerequisites: Requirements before the Workshop: Basic familiarity with Linux, SSH and the command line will be assumed. A valid, active TACC account will be needed to complete the exercises (attendees can register for a TACC account for free on the TACC User Portal: https://portal.tacc.utexas.edu/account-request ). Some familiarity with Python will be helpful but not required. Attendees must bring their own laptops.
