Deploying compute nodes for a supercomputer

Overview

Teaching: 0 min
Exercises: 0 min
Questions
  • How do we deploy compute nodes and relevant software programmatically?

Objectives

1. Setup webhook in CloudLab

  • Webhook is a mechanism to automatically push any update on your GitHub repo to the corresponding CloudLab repository.

  • Login to CloudLab.
  • Top left, under Experiments, select My Profiles.

  • Click on the profile created for CSC466, then select Edit

  • Click on the Push URL bar, then click on the blue Clipboard icon.

  • Go to the corresponding GitJub repository and go to Settings.

  • Go to Webhooks.

  • Click Add webhook. You will need to re-enter the password for your GitHub account next.

  • Pass the value copied from the clipboard in CloudLab into the Payload URL box.
  • Click on Add webhook.

2. Create a new branch on your GitHub repo

  • In your GitHub repository, create a new branch called compute.

  • If you set up your webhook correctly, compute should show up on your CloudLab profile as well

  • In your GitHub repository, edit the profile.py file with THIS CONTENT.
  • Click Commit changes once done to save.

  • Create a new file called install_mpi.sh with THIS CONTENT
  • Click Commit new file once done to save.

  • Go to CloudLab, refresh the page, and confirm that the hash of your compute branch here match with the hash on GitHub repo.
  • Instantiate from the compute branch.

Key Points