Data intensive big data applications such as Kafka, Hadoop, and NoSQL are increasingly common in the modern data center, and now more than ever are being deployed at scale in OpenStack cloud environments. The performance demands placed on cloud infrastructure can be extreme, and in shared environment can often result in resource contention or outright stravation. This requires cloud infrastructure architected to support the diverse sets of requirements of these applications.
In this talk we discuss considerations and approaches for handling the requirements of data intensive big data workloads in OpenStack such as:
- Defining big data workload applications proflies
- Architecting for high performance workloads
- Synthetic workload and full stack application testing
Attendees should expect to learn about the challenges one faces when deploying high performance workloads on OpenStack, and our experiencw with approaches and architectures to addressing these challenges