OpenStack is more than just a collection of services with a great dashboard interface, it is also a platform for building applications that consume and utilize cloud resources. Combine this platform with the power of big data, and you have a recipe for scalable, cloud-aware, data processing applications.
In this talk we will follow a developer’s journey along the path of creating a real-time streaming Spark application on OpenStack, exploring methods for creating cloud applications. We will also demonstrate how to use OpenStack’s Python clients to configure message queues for data ingestion, persistent storage for processed data, and computing nodes for large scale analytics and visualizations.
Attendees should expect to walk away from this session with an understanding of how they can use OpenStack to create, deploy, update, and maintain data processing applications at scale that live entirely in the cloud.
Attendees to this presentation should expect to learn how they can use the various OpenStack Python clients to create an application that will deploy a big data Spark application that can utilize cloud resources from a variety of projects (Sahara, Trove, Zaqar, Nova). They should also expect to learn about building applications through the Murano project.