Brussels / 2 & 3 February 2019


Setting up an HPC lab from scratch

with Mr-Provisioner, Jenkins and Ansible

At Linaro, we have an HPC lab where we can setup multiple clusters and machines, install OpenHPC, run the test-suite, benchmarks using Mr-Provisioner, Jenkins and Ansible automation. This allows us to test new kernels/initrd, new versions of OpenHPC, compilers, applications, etc. on different architecture at the same time, from scratch. The work we did is open source, on GitHub, and is intended to be used by other people. We started with hard-coded rules but are slowly moving towards generic configuration-based setup from the ground up, so that anyone else can clone, change the configuration files and run the Ansible playbooks. From scratch.

These are the repositories that we contribute to / use:

Mr-Provisioner, the bare metal provisioner that installs OSs on all our servers (Arm or Intel):

Our infrastructure scripts, setting up Jenkins and running the jobs logic:

Our benchmark harness, which runs benchmarks in a repeatable way:

Our OpenHPC Ansible scripts, which install OpenHPC on bare-metal/VM, clusters (Arm or Intel):


Renato Golin