The AI Thunderdome: using OpenStack to accelerate AI training with Sahara, Spark, and Swift
OpenStack lends itself well to big data problems. With Swift and Ceph, data storage is easier than ever. One of the most consequential problems in the big data space is using AI to make sense of ever-increasing data volumes. OpenStack makes this a solvable problem: Data stored in Swift can be accessed by a Sahara cluster, which can use GPU instances to accelerate parallel AI hyperparameter tuning. This ability allows users to spin up and down huge AI training farms at a fraction of the manual effort, and in the end, isn't that what the cloud is all about?
