While the global move to cloud-based infrastructure has delivered undoubted benefits in security, storage and scalability, it’s also brought with it the risk of spiralling costs as companies struggle to adequately track their cloud use and manage their spending.
Given that the primary reason many businesses switch to the cloud in the first place is to save costs, this is a huge potential problem. So, what’s most important in keeping your cloud costs down and only paying for what your business actually needs?
We’ve worked with many businesses—from blue chips to SMEs—to reduce or control their AWS cloud costs and, regardless of size, we’ve seen the same 5 challenges recur again and again.
This is the most common reason for cloud overspending and is usually the result of inherent design problems such as:
Another often-overlooked area of potential cost is software efficiency, defined as the ‘amount of computing resource required per business transaction’ in our 7 Pillars of Software Performance. For obvious reasons, this is a huge factor in controlling your cloud costs — particularly if you’re processing a high volume of transactions. It often stems from:
This is usually the result of businesses rushing their architecture choices due to the clamour to move to the cloud as soon as possible. While this might get the C-suite off your back in the short term, it often causes problems further down the line when your architecture doesn’t fit your workload. This can lead to either purchasing capacity you don’t need or paying more for extra when what you’ve bought can’t keep up.
Using autoscaling can be a great way to manage cost by adjusting capacity to counter changing demand. However, many applications don’t autoscale quickly enough — particularly databases, caches and dated applications. The result is that you still overextend your capacity and spend money where it isn’t needed.
Forecasting what you’ll need and when you’ll need it is difficult. It requires a robust process, specialist analysis skills, and the right data. To give an accurate forecast, you’ll need to be cognisant of:
All of which makes managing your cloud costs a complex proposition, so how should you approach it?
Cloud cost management can broadly be divided into two approaches: ‘quick fixes’ that tackle low-hanging fruit such as wasted capacity and ‘long-term fixes’ that deal with more ingrained issues.
There are a number of palliative fixes to cloud overspend that offer instant results or ‘one-time’ benefits, such as:
There are plenty of powerful tools available to help you automate and track these processes, such as Amazon Cloudwatch, Trusted Advisor, Cloudability, Cloudchecker and RightScale. However, it should be stressed that the reach of these tools is limited.
Most companies with a significant volume of business transactions we come across use one of these tools, but we often find they struggle to harness its full potential. It can be hard to translate the tool’s recommendations into real-world fixes, so many businesses only ever implement a fraction of the optimisations they could.
What’s more, many of these fixes are limited in scope and won’t fix the deeper, more sustained issues that drive cloud overspending. For example, none of the listed tools is suitable for assessing the long-term efficiency or scalability of your cloud architecture. Likewise, cost-optimisation software has limited value in helping you forecast cloud spending and other OPEX costs associated with it.
For these more complex and potentially more high-risk tasks, you need something beyond a cost-optimisation tool.
Addressing problems with strategic aspects of cloud cost optimisation, such as forecasting and scalability, requires comprehensive analysis. Building upon the ‘quick fixes’ outlined in the previous section, in-depth analysis should ask questions about the long-term scalability of your cloud architecture, whether your spending can be benchmarked against the market and similar workloads and how much your choice of technology is likely to cost you in 1, 2 or 5 years’ time.
Delving a little deeper into your cloud cost management can help you avoid the 5 challenges we outlined earlier. Rather than simply dealing with immediate problems, developing a strategic, long-term plan for your cloud architecture helps you negate the root causes of cost inefficacy — long before it starts to impact on your bottom line.
This is where Capacitas can help. We’ve helped our clients save £100m’s through our capacity management and performance engineering methodologies. Our strategy builds on the instantaneous fixes offered by tools such as Cloudability and gives you the ability to forecast on the scalability, efficiency and cost-effectiveness of your cloud infrastructure long into the future, as well as tackling those ‘harder to reach areas’ of optimisation.
To learn more about our approach, as well as where to start with your own cloud cost management, download our new control cloud costs whitepaper.