Setting up an HPC lab from scratch
with Mr-Provisioner, Jenkins and Ansible
- Track: HPC, Big Data and Data Science devroom
- Room: UA2.118 (Henriot)
- Day: Sunday
- Start: 12:40
- End: 12:50
At Linaro, we have an HPC lab where we can setup multiple clusters and machines, install OpenHPC, run the test-suite, benchmarks using Mr-Provisioner, Jenkins and Ansible automation. This allows us to test new kernels/initrd, new versions of OpenHPC, compilers, applications, etc. on different architecture at the same time, from scratch. The work we did is open source, on GitHub, and is intended to be used by other people. We started with hard-coded rules but are slowly moving towards generic configuration-based setup from the ground up, so that anyone else can clone, change the configuration files and run the Ansible playbooks. From scratch.
These are the repositories that we contribute to / use:
Mr-Provisioner, the bare metal provisioner that installs OSs on all our servers (Arm or Intel): https://github.com/Linaro/mr-provisioner
Our infrastructure scripts, setting up Jenkins and running the jobs logic: https://github.com/Linaro/hpclabjenkins
Our benchmark harness, which runs benchmarks in a repeatable way: https://github.com/Linaro/benchmark_harness
Our OpenHPC Ansible scripts, which install OpenHPC on bare-metal/VM, clusters (Arm or Intel): https://github.com/Linaro/ansible-playbook-for-ohpc
Speakers
| Renato Golin |