"Where's this cheap cloud computing everyone keeps telling me about?!" If that statement has ever crossed your mind, then you're not alone. Cloud can be cheap, for sure, but also very elusive.
We’re in the middle of our dive into techniques that are critical to getting you the compute power you need, at a fraction of the cost. The areas of focus are:
Today’s topic, efficient scaling of cloud resources.
This is likely the most critical component to financially effective use of cloud. This is, after all, the promise of cloud itself, isn’t it? Pay for what you use, and only what you use? Well, that’s easier said than done. As more and more studios transition to the cloud, we’ve seen common practices waste upwards of 40% of their render budget, just by how and when they spin up cloud resources.
So, why is this? Well, cloud is obviously a metered service, so just like metered parking, you don’t want to start putting money in the slot before your car is even parked, right?!
Seems obvious, but that’s exactly what some cloud rendering methods do. They calculate the requirements, and begin to “pre-allocate” compute resources, turning on a certain number of standard instances, perhaps another set of preemptible instances, etc., until their virtual farm is “ready”. This is an easy mistake to make when transitioning from local resources, where one tends to think in terms of local resource availability; allocating machines, pushing data to those machines, starting up the render submission, and perhaps troubleshooting dependencies; all while the cost clock is ticking.
For cloud computing, there’s a simple principle, the spikier the better! By spiky we’re referring to the time running compute on the cloud. You want to go big, really big, for as little time as humanly possible. Taking you back to your days of calculus, we want to minimize the area under the curve, because in this case, the area under the curve is cost! Take a look at the comparison example below. Here, we’re showing a gradual ramp of resources and rendering against a very quick, “spiky” render.
You can visually see that the slow-ramp of the light red render equates to almost twice the area of the spiky blue render, and thus twice the cost.
So, how do you go about achieving this spiky efficiency? There are a few things that will put you well on your way to maximum performance for the minimum cost:
So, hopefully this gives some additional insight into just how you can realize the promise of financial efficiency in the cloud. Massive scale without the massive cost is at your fingertips, if you follow these simple steps.