
Azure GPU Inference at Scale: A Cost Optimisation Framework by Workload Type
Across more than 23,000 production Kubernetes clusters running AI workloads on AWS, Azure and GCP, average measured GPU utilisation was just 5 percent. On AKS specifically, it averaged just 2 percent. That figure comes from Cast AI’s 2026 State of…











