Openstack benchmarking tools are hard to setup and require the user to dig into documentation, modify configuration files to be up and running. To solve this, we built a distributed, scalable benchmarking system. The service which can be used via a web-UI, makes it extremely easy to attach cloud-deployments and benchmark them. It builds on Openstack Rally, a CLI-only benchmarking tool and creates a benchmark-as-a-service (BaaS) system. The system can be used by multiple users in parallel to benchmark multiple Openstack deployments.
Our model can be generalized to other CLI tools such as Openstack Shaker, thereby leveraging any open-source benchmarking tool out there and adding it to the system.
In this talk, we will describe our experiences with Openstack benchmarking. We will talk about our usage of containers and microservices to achieve scalability and reuse. We will also share the results of building and benchmarking an Openstack deployment at scale.
- Design and implementation of the benchmarking service we built.
- A new approach to build a service from cli-tools.
- Results of benchmarking an Openstack deployment at scale.